Integrate to BigQuery the data model description and the fields' description and label

Description

PRDE - Story default text according to the team DoR (Definition of Ready)

03 - GOAL (DESCRIBE THE PROPOSED SOLUTION):

Integrate with BigQuery the following meta-data from Data Model record from Carol:

  • Data Model’s description.
  • Data Model field’s description.
  • Data Model field’s label.

This will allow us to share the catalog we have available in BigQuery.

06 - ACCEPTANCE CRITERIA:

Integrate with BigQuery the following meta-data from Data Model record from Carol:

  • Data Model’s description.
  • Data Model field’s description.
  • Data Model field’s label.

Ps.: We should not run the process to generate the avro schema or update data models on BQ. It will be performed as needed by users.

Activity

Valcir de Bettio Júnior 19 December 2023, 17:12 Jira Internal Users

OK!

Automation for Jira 19 December 2023, 17:11 Jira Internal Users

Github user pedrobuzzi has just approved a PR (added as Shard Assignee in this Jira issue).

CAPL-5048 Done feat: Table and Fields descriptions

Automation for Jira 19 December 2023, 16:03 Jira Internal Users

Github user faustinobsd has just commited and issue was sent back to the REVIEW column.

Automation for Jira 18 December 2023, 17:53 Jira Internal Users

This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.

Automation for Jira 18 December 2023, 16:58 Jira Internal Users

Github user faustinobsd has just commited and issue was sent back to the REVIEW column.

Automation for Jira 12 December 2023, 18:04 Jira Internal Users

This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.

Automation for Jira 12 December 2023, 12:52 Jira Internal Users

This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.

Automation for Jira 11 December 2023, 20:26 Jira Internal Users

@Robson Thanael Poffo ,
@Pedro Buzzi , @Daniel Faustino ,

This issue was planned to be delivered until 2024-01-01. You can check that by consulting the issue in the Due Date field.

Dates already planned for this issue: 2023-12-11, 2024-01-01

If External Issue Link field is filled, customer was also informed on JIRA TOTVS.

Automation for Jira 11 December 2023, 17:07 Jira Internal Users

This issue was automatically transitioned to REVIEW, as its PR (not DRAFT and not WIP) was just created in Github.

CAPL-5048 Done feat: Table and Fields descriptions

Robson Thanael Poffo 24 November 2023, 20:07 Jira Internal Users

@Pedro Buzzi ,

I see you mentioned field’s description and label, but in the BQ we only have a spot for description. Should we concat Label and Description

Yes, let’s concatenate.

We are going to let the stagings also prepared to apply descriptions, other than DM’s. Do you see any problem?

That’s perfect. Only DM so far, and staging ready for it.

Pedro Buzzi 24 November 2023, 18:57 Jira Internal Users

@Robson Thanael Poffo, I have two questions about this topic:

  1. I see you mentioned field’s description and label, but in the BQ we only have a spot for description. Should we concat Label and Description, like this:

  2. We are going to let the stagings also prepared to apply descriptions, other than DM’s. Do you see any problem?
Automation for Jira 20 November 2023, 20:59 Jira Internal Users

@Robson Thanael Poffo ,
@Pedro Buzzi ,
@Geny Isam Hamud Herrera ,
This issue was planned to be delivered until 2023-12-11. You can check that by consulting the issue in the Due Date field.

Dates already planned for this issue: 2023-12-11

If External Issue Link field is filled, customer was also informed on JIRA TOTVS.