Written golden record are getting by default the ingestionDateTime from stagingTable when it should consider current_datetime

Description

DAEN - Bug default text according to the team DoR (Definition of Ready)

02 - PROBLEM (GIVE MORE DETAILS HERE ABOUT SCENARIO OR PAIN TO BE RESOLVED?):

  • When writing the Golden Records, we are not saving the ingestion date time as when the record is written to BQ, we are getting the same ingestion date/time defined on ST.

12 - EXPECTED BEHAVIOR (WHAT SHOULD BE THE DEFAULT BEHAVIOR LINKED WITH THE STEPS ABOVE):

  • When writing golden records we should ignore the ingestionDatetime coming from staging record. It always should consider the current_datetime().

Activity

Automation for Jira 21 November 2023, 14:19 Jira Internal Users

This issue was automatically transitioned to DONE after being deployed to production on Github.

https://github.com/totvslabs/mdm/releases/tag/v4.85.1

Automation for Jira 21 November 2023, 14:19 Jira Internal Users

No associated issue on JIRA TOTVS BRAZIL.

Automation for Jira 21 November 2023, 13:27 Jira Internal Users

This issue was automatically transitioned to WAITING DEPLOY, as its PR was just merged into master branch in Github.

Automation for Jira 20 November 2023, 20:48 Jira Internal Users

Github user douglascoimbra has just approved a PR (added as Shard Assignee in this Jira issue).

fix: CAPL-5021 Done setting _ingestionDatetime in SQL Processing

Automation for Jira 20 November 2023, 20:10 Jira Internal Users

@Robson Thanael Poffo ,
@Geny Isam Hamud Herrera , @Cindy de Araujo Soares Moore , @Emerson Venancio

This issue was planned to be delivered until 2023-12-11. You can check that by consulting the issue in the Due Date field.

Dates already planned for this issue: 2023-11-20, 2023-12-11

If External Issue Link field is filled, customer was also informed on JIRA TOTVS.

Automation for Jira 20 November 2023, 12:31 Jira Internal Users

This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.

Douglas Coimbra Lopes 18 November 2023, 00:23 Jira Internal Users

@Cindy de Araujo Soares Moore The card has been validated by the QA tam. It is pending only the code review. cc @Gabriel DAmore Marciano

Douglas Coimbra Lopes 17 November 2023, 23:51 Jira Internal Users
  • FORCING THE DATE MODEL TO RECEIVE THE STAGING INGESTION DATIME

DM CORRECTLY BEING WRITTEN WITH ITS OWN INGESTION DATETIME

  • SQL PROCESSING STANDARD ALONG WITH REJECTED RECORDS
  • STAGING INGESTIONDATETIME VS DATAMODEL

REJECTED

UNIFIED

CUSTOMER

Automation for Jira 16 November 2023, 17:18 Jira Internal Users

Voltado ao double-check do campo `IngestionDataTime` para datamodels:
Confirmado que na master o campo NAO eh preenchido, ficando como `NULL`:

Edited on Slack

Automation for Jira 16 November 2023, 17:12 Jira Internal Users

Voltado ao double-check do campo `IngestionDataTime` para datamodels:
Confirmado que na master o campo nao eh preenchido, ficando como null:

Edited on Slack

Automation for Jira 16 November 2023, 17:11 Jira Internal Users

Voltado ao double-check do campo `IngestionDataTime` para datamodels:
COnfirmado que na master o campo nao eh preenchido, ficando como null:

Sent by Slack

Automation for Jira 14 November 2023, 16:15 Jira Internal Users

@Robson Thanael Poffo ,
@Gabriel DAmore Marciano ,
@Geny Isam Hamud Herrera ,
This issue was planned to be delivered until 2023-11-20. You can check that by consulting the issue in the Due Date field.

Dates already planned for this issue: 2023-11-20

If External Issue Link field is filled, customer was also informed on JIRA TOTVS.