Schema Error: staging tables with status INACTIVE
Description
PRDE - Bug default text according to the team DoR (Definition of Ready)
01 - PERSON OF CONTACT (PERSON THAT CAN ANSWER QUESTIONS ABOUT THE PROBLEM):
@Breno Zipoli Monteiro Papa and @Robson Thanael Poffo
02 - PROBLEM (WHAT'S THE ISSUE?):
Breno is working on installing a app in some tenants, and this task is moving existing staging tables to the status INACTIVE.
On 2023-08-14 we had the following status for all staging tables:
Tasks Type:
CHANGE_IN_PROGRESS ==> 158
FAILED_TO_SYNC ==> 123
INACTIVE ==> 97
{"V3":38,"V2":4}Today, on 2023-08-15 we have:
Tasks Type:
INACTIVE ==> 1024
CHANGE_IN_PROGRESS ==> 231
FAILED_TO_SYNC ==> 133
{"V3":62,"V2":66,"V1":1}I have the status registered on this spreadsheet:
Majority of tables with status INACTIVE:
app_setting
currency
Tenant as example:
| orgName | tenantName | bqVersion | bqVersion | quantityTables | tables |
| totvstechfin | tenant03bd66a9993611ebb8830a5864613d7c | READY | V3 | 1 | [{"mdmEntityName":"currency","mdmConnectorName":"protheus_carol","mdmEntityType":"STAGING"}] |
| totvstechfin | tenant03bd66a9993611ebb8830a5864613d7c | READY | V3 | 1 | [{"mdmEntityName":"app_setting","mdmConnectorName":"internal","mdmEntityType":"STAGING"}] |
Task that installed the app: https://totvstechfin.carol.ai/tenant03bd66a9993611ebb8830a5864613d7c/carol-ui/tasks/activity/9730b81790eb43efa115c38263ce2ab6?filters=%5B%7B%22dateUpdated%22:%5B%22after%22,%222023-08-15T02:47:50.268%2B00:00%22%5D%7D,%7B%22hideInternal%22:%22true%22%7D%5D
App manifest has currency inside it:
Issue DE is working on:
DAEN-3417:Install Carol App "laketechfinprotheus" on Techfin tenants allowing Techfin t...Done
Query to fill the report:
{
"mustList": [
{
"mdmFilterType": "TYPE_FILTER",
"mdmValue": "mdmStagingSchema"
},
{
"mdmFilterType": "TERMS_FILTER",
"mdmKey": "mdmBigQuerySynchronizationStatus.raw",
"mdmValue": ["FAILED_TO_SYNC","CHANGE_IN_PROGRESS", "INACTIVE"]
}
// ,{
// "mdmFilterType": "TERMS_FILTER",
// "mdmKey": "mdmTenantId.raw",
// "mdmValue": "370ad645da8d4e078ea81d514151ad04"
// }
],
// "mustNotList": [
// {
// "mdmFilterType": "TERMS_FILTER",
// "mdmKey": "mdmBigQuerySynchronizationStatus.raw",
// "mdmValue": ["FAILED_TO_SYNC","CHANGE_IN_PROGRESS"]
// }
// ],
"aggregationList": [
{
"minDocCount": 0,
"name": "taskType",
"paramSize": "",
"params": [
"mdmStagingType.raw"
],
"shardSize": 0,
"size": 5000,
"type": "TERMS"
},
{
"minDocCount": 0,
"name": "statusType",
"paramSize": "",
"params": [
"mdmBigQuerySynchronizationStatus.raw"
],
"shardSize": 0,
"size": 5000,
"type": "TERMS"
},
{
"minDocCount": 0,
"name": "tenantAgg",
"paramSize": "",
"params": [
"mdmTenantId.raw"
],
"shardSize": 0,
"size": 5000,
"type": "TERMS",
"subAggregations": [
{
"minDocCount": 0,
"name": "connectors",
"paramSize": "",
"params": [
"mdmConnectorId.raw"
],
"shardSize": 0,
"size": 5000,
"type": "TERMS",
"subAggregations": [
{
"minDocCount": 0,
"name": "tables",
"paramSize": "",
"params": [
"mdmStagingType.raw"
],
"shardSize": 0,
"size": 5000,
"type": "TERMS"
}
]
}
],
}
]
}03 - STEPS TO REPRODUCE (STEP (1...N), VIDEO, SCREENSHOTS, LOGS FOLDER, HEARTBEAT, ETC. – IF IS NOT POSSIBLE TO REPRODUCE EXPLAIN THE REASON):
04 - LINKS (ADD A LINK TO THE BUG OR TO THE TENANT):
05 - EXPECTED BEHAVIOR (LIST THE EXPECTED BEHAVIORS TO CONSIDER THIS BUG AS DONE):
- Install a Carol App and staging table keeps with right status.
Details
Priority
Highest