Como usuário eu devo buscar os dados de staging area limitando a query pela partição da tabela
Description
PRDE - Story default text according to the team DoR (Definition of Ready)
01 - STAKEHOLDER (PERSON THAT CAN VALIDATE AND ANSWER QUESTIONS):
02 - PROBLEM (WHAT'S THE CURRENT PROBLEM SCENARIO OR PAIN TO BE RESOLVED?):
03 - GOAL (DESCRIBE THE PROPOSED SOLUTION):
Temos uma oportunidade para as consultas serem mais rapidas na tabela de staging area.
Devemos adicionar:
- Adicionar o filtro da meta-informação __IngestionDatetime: datetime.
- Adicionar a coluna (seletor de colunas) de _ingestionDateTime, permitindo adicionar/remover a coluna da tabela de visualização.
Alterações de fluxo:
- Ao eliminar o flag
Table Previewdevemos automaticamente filtrar os dados dos ultimos 3 dias, utilizando o filtro de_ingestionDatetime.- Isso vai permitir filtrar dados de forma mais otimizada.
- A condição de
_ingestionDateTimedeve sempre ser a primeira condicional, pois este atributo é a partição das tabelas na staging area.
04 - WHO CAN USE THIS FEATURE (USER ROLES):
05 - ASSETS (FIGMA LINKS, RELEVANT DOCUMENTATION LINKS, JSON EXAMPLES, ETC):
06 - ACCEPTANCE CRITERIA:
- Adicionar a coluna _ingestionDatetime no filtro e coluna.
- Ajustar fluxo do filtro automatico por _ingestionDatetime quando removemos o
Table Preview.
Activity
Show:
Details
Priority
HighAssignee
Carlos Affonso Wagner
Reporter
Robson Thanael Poffo
Labels
CAPL_4.01
Due Date
6 April 2024
Fix versions
CAPL_4.01
Components
CONNECTOR | STAGING_TABLE
Created
15 March 2024, 15:03
Updated
27 March 2024, 19:15
More fields
Created: 15 March 2024, 19:03
Updated:
27 March 2024, 23:15
This issue was automatically transitioned to WAITING DEPLOY, as its linked QA regression issue has just reached WAITING DEPLOY status (PR was just merged into master branch in Github).
This issue was automatically transitioned to REGRESSION, as its PR was just merged into qa branch in Github.
This issue was automatically transitioned to REGRESSION, as its PR was just merged into qa branch in Github.
This issue was automatically transitioned to TESTED & MERGED, as its PR was just merged into develop branch in Github. PR Approved by felabs01,douglascoimbra.
Github user douglascoimbra has just approved a PR (added as Shard Assignee in this Jira issue).
feat(ST):
CAPL-5634 Done new Ingestion Date column
This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.
Evidencia da implementacao anexada no PR https://github.com/totvslabs/carol-ui/pull/1735
This issue was automatically transitioned to REVIEW, as its PR (not DRAFT and not WIP) was just created in Github.
feat(ST):
CAPL-5634 Done new Ingestion Date column
@Robson Thanael Poffo ,
@Carlos Affonso Wagner ,
This issue was planned to be delivered until 2024-03-25. You can check that by consulting the issue in the Due Date field.
Dates already planned for this issue: 2024-03-25
If External Issue Link field is filled, customer was also informed on JIRA TOTVS.
@Robson Thanael Poffo ,
@Carlos Affonso Wagner ,
This issue was planned to be delivered until 2024-04-06. You can check that by consulting the issue in the Due Date field.
If External Issue Link field is filled, customer was also informed on JIRA TOTVS.