Integrate to BigQuery the data model description and the fields' description and label
Description
PRDE - Story default text according to the team DoR (Definition of Ready)
03 - GOAL (DESCRIBE THE PROPOSED SOLUTION):
Integrate with BigQuery the following meta-data from Data Model record from Carol:
- Data Model’s description.
- Data Model field’s description.
- Data Model field’s label.
This will allow us to share the catalog we have available in BigQuery.
06 - ACCEPTANCE CRITERIA:
Integrate with BigQuery the following meta-data from Data Model record from Carol:
- Data Model’s description.
- Data Model field’s description.
- Data Model field’s label.
Ps.: We should not run the process to generate the avro schema or update data models on BQ. It will be performed as needed by users.
Activity
Show:
Details
Priority
HighAssignee
Daniel Faustino
Reporter
Robson Thanael Poffo
Labels
CAROL_BACKLOG_REVIEWPLANNEDREVIEWED
Due Date
1 January 2024
Components
BIG_QUERY | PROVISIONINGDATA_MODEL | MAINTENANCE
Created
20 November 2023, 16:55
Updated
15 January 2024, 11:10
More fields
Created: 20 November 2023, 19:55
Updated:
15 January 2024, 14:10
OK!
Github user pedrobuzzi has just approved a PR (added as Shard Assignee in this Jira issue).
https://totvslabs.atlassian.net/browse/CAPL-5048#icft=CAPL-5048 feat: Table and Fields descriptions
Github user faustinobsd has just commited and issue was sent back to the REVIEW column.
This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.
Github user faustinobsd has just commited and issue was sent back to the REVIEW column.
This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.
This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.
@Robson Thanael Poffo ,
@Pedro Buzzi , @Daniel Faustino ,
This issue was planned to be delivered until 2024-01-01. You can check that by consulting the issue in the Due Date field.
Dates already planned for this issue: 2023-12-11, 2024-01-01
If External Issue Link field is filled, customer was also informed on JIRA TOTVS.
This issue was automatically transitioned to REVIEW, as its PR (not DRAFT and not WIP) was just created in Github.
https://totvslabs.atlassian.net/browse/CAPL-5048#icft=CAPL-5048 feat: Table and Fields descriptions
@Pedro Buzzi ,
Yes, let’s concatenate.
That’s perfect. Only DM so far, and staging ready for it.
@Robson Thanael Poffo, I have two questions about this topic:
I see you mentioned field’s description and label, but in the BQ we only have a spot for description. Should we concat Label and Description, like this:
We are going to let the stagings also prepared to apply descriptions, other than DM’s. Do you see any problem?
@Robson Thanael Poffo ,
@Pedro Buzzi ,
@Geny Isam Hamud Herrera ,
This issue was planned to be delivered until 2023-12-11. You can check that by consulting the issue in the Due Date field.
Dates already planned for this issue: 2023-12-11
If External Issue Link field is filled, customer was also informed on JIRA TOTVS.