The SQL Efficiency shouldn't depend on the integration of the customer tenant and the unified tenant on allowed list

Description

PRDE - Story default text according to the team DoR (Definition of Ready)

01 - PERSON OF CONTACT (PERSON THAT CAN ANSWER QUESTIONS ABOUT THE PROBLEM):
02 - PROBLEM (WHAT'S THE CURRENT PROBLEM SCENARIO OR PAIN TO BE RESOLVED?):

We are unable to bring the SQL Processing Efficiency to Techfin pipelines (Antecipa and Mais Negócios) because it is requiring us to integrate the customers tenant to the unified tenant.

As right now, we have some limitations and activities with Techfin in order to be able to integrate these customers tenant to the unified app of each app.

We need to review the dependency of the SQL Processing Efficiency and the integration of the customer tenant to the Unified tenant in order to enable the SQL Processing Efficiency.

For tenants we enabled, we are seeing this message:

Pipeline mdbusinesspartner not found for carol app techfinplatform and tenant 5e41099e20e743eab9263ce6c83d02b7

Task: [https://totvstechfin.carol.ai/tenant827efd96a3764afa80ef43e1f42fa06c/carol-ui/tasks/act[…]er=DESC&filters=%5B%7B%22hideInternal%22:%22false%22%7D%5D|https://totvstechfin.carol.ai/tenant827efd96a3764afa80ef43e1f42fa06c/carol-ui/tasks/activity/47c62324bcf24eb3a8fd04633cb152bf?p=1&ps=25&sort=dateUpdated&order=DESC&filters=%5B%7B%22hideInternal%22:%22false%22%7D%5D]

TaskID: 47c62324bcf24eb3a8fd04633cb152bf

When we check the tenant’s document we see it has no relation with unified tenant:

{
  "mdmAllowSmsLogin": false,
  "mdmAllowSmsUsage": false,
  "mdmAvroSchemaProvisionStatusType": "UPDATED",
  "mdmBigQueryProvisionId": "87a57c42-ebda-41a4-9bb7-1ba4e531f66d",
  "mdmBigQueryProvisionVersion": "V3",
  "mdmBigQueryStatusType": "READY",
  "mdmCdsShortURLAuthentication": false,
  "mdmConsolidateBlocklist": false,
  "mdmCreated": "2023-03-13T15:49:48.356Z",
  "mdmCreatedUser": "jamir.araujo@totvs.com.br",
  "mdmDataDecorationEnabled": false,
  "mdmDataflowIgnoreRealtime": false,
  "mdmDescription": {
    "pt-BR": "POLIMOLD INDUSTRIAL SA-1678706360202"
  },
  "mdmEnableAddressCleansing": false,
  "mdmEnableKafkaRt": false,
  "mdmEnableSSO": false,
  "mdmEntityType": "mdmTenant",
  "mdmExternalLoginConfiguration": {},
  "mdmFeatureLevelByQtUsers": "HIGH",
  "mdmFeatureLevelByShortURL": "HIGH_3",
  "mdmId": "5e41099e20e743eab9263ce6c83d02b7",
  "mdmIsPublicData": false,
  "mdmLabel": {
    "en-US": "tenant827efd96a3764afa80ef43e1f42fa06c",
    "pt-BR": "tenant827efd96a3764afa80ef43e1f42fa06c"
  },
  "mdmLastUpdated": "2023-11-23T14:39:32.090Z",
  "mdmLocale": "pt-BR",
  "mdmMappingsPending": false,
  "mdmName": "tenant827efd96a3764afa80ef43e1f42fa06c",
  "mdmOrgId": "f4e4697e021d4f68b849fa4971607b80",
  "mdmProcessingPriority": 0,
  "mdmQueueSuffix": "",
  "mdmRealtimeDisabled": true,
  "mdmSQLProcessingOnly": true,
  "mdmSampleDataEnabled": true,
  "mdmSendEmailSmsCode": false,
  "mdmSmsProvider": "TWW",
  "mdmStatus": "ACTIVE",
  "mdmStatusDate": "2023-11-15T03:51:18.367Z",
  "mdmStopProcessing": false,
  "mdmSubdomain": "tenant827efd96a3764afa80ef43e1f42fa06c",
  "mdmTag": "PRODUCTION",
  "mdmTenantId": "8cd6e43115e9416eb23609486fa053e3",
  "mdmTotvsCustomerCode": "T13221",
  "mdmUnifiedTenantsMapping": {
    "0483dfa91ba54cd4b97b1613f1171932": [
      {
        "connectorId": "1934a0399cd34351ab323de325376de3",
        "connectorName": "protheus_carol",
        "stagingName": "sc2"
      },
      {
        "connectorId": "1934a0399cd34351ab323de325376de3",
        "connectorName": "protheus_carol",
        "stagingName": "ct2"
      },
...
    ],
    "15ca47ade9db450e83a3a7d8e5a1f524": [
      {
        "connectorId": "7d9fce0fbe3846c182216a68d0beaecf",
        "connectorName": "protheus_carol",
        "stagingName": "abb"
      },
...
      {
        "connectorId": "3f63dac21cba4d089d84e8c86597d54e",
        "connectorName": "protheus_carol",
        "stagingName": "mapping"
      }
    ]
  },
  "mdmUpdatedUser": "jose.delmondes@totvs.com.br",
  "mdmUseSqlProcessingPriorityChannel": false,
  "mdmWhiteListDomains": [
    "*"
  ],
  "provisionReady": true,
  "tenantType": "CUSTOMER"
}


orgId: f4e4697e021d4f68b849fa4971607b80
orgName: totvstechfin

tenantId: 5e41099e20e743eab9263ce6c83d02b7
tenantName: tenant827efd96a3764afa80ef43e1f42fa06c

https://totvstechfin.carol.ai/tenant827efd96a3764afa80ef43e1f42fa06c

03 - GOAL (DESCRIBE THE PROPOSED SOLUTION):
04 - WHO CAN USE THIS FEATURE (USER ROLES):
05 - ASSETS (FIGMA LINKS, RELEVANT DOCUMENTATION LINKS, JSON EXAMPLES, ETC):
06 - ACCEPTANCE CRITERIA:

  • Allow to enable the SQL Processing Efficiency on customers tenant without integration with unified tenant.
    • The customer data is running the SQL Processing defining the carol app name and pipeline name.

Activity

Automation for Jira 7 December 2023, 14:38 Jira Internal Users

This issue was automatically transitioned to DONE after being deployed to production on Github.

https://github.com/totvslabs/mdm/releases/tag/v4.91.0

Automation for Jira 7 December 2023, 14:38 Jira Internal Users

No associated issue on JIRA TOTVS BRAZIL.

Automation for Jira 7 December 2023, 13:44 Jira Internal Users

This issue was automatically transitioned to WAITING DEPLOY, as its linked QA regression issue has just reached WAITING DEPLOY status (PR was just merged into master branch in Github).

Automation for Jira 6 December 2023, 13:54 Jira Internal Users

This issue was automatically transitioned to REGRESSION, as its PR was just merged into qa branch in Github.

Automation for Jira 6 December 2023, 13:54 Jira Internal Users

This issue was automatically transitioned to REGRESSION, as its PR was just merged into qa branch in Github.

Automation for Jira 6 December 2023, 13:54 Jira Internal Users

This issue was automatically transitioned to REGRESSION, as its PR was just merged into qa branch in Github.

Automation for Jira 5 December 2023, 14:11 Jira Internal Users

This issue was automatically transitioned to TESTED & MERGED, as its PR was just merged into develop branch in Github. PR Approved by cindysoares,douglascoimbra.

Automation for Jira 5 December 2023, 14:11 Jira Internal Users

Github user douglascoimbra has just approved a PR (added as Shard Assignee in this Jira issue).

fix: Removed dependency with unified tenant to enable SQL efficiency for customer tenants

Douglas Coimbra Lopes 5 December 2023, 14:10 Jira Internal Users

First SQL processing for metrics generation

UNIFIED FLOW PRESERVED

ORCHESTRATOR WITH UNIFIED

Automation for Jira 4 December 2023, 22:08 Jira Internal Users

This issue was automatically transitioned to QA REVIEW, as its PR was just approved in Github.

Automation for Jira 4 December 2023, 21:48 Jira Internal Users

This issue was automatically transitioned to REVIEW, as its PR (not DRAFT and not WIP) was just created in Github.

fix: Removed dependency with unified tenant to enable SQL efficiency for customer tenants

Automation for Jira 4 December 2023, 18:20 Jira Internal Users

This issue was automatically transitioned to IN PROGRESS, as its branch was just created in Github.

Automation for Jira 4 December 2023, 16:40 Jira Internal Users

@Gabriel DAmore Marciano ,

@Geny Isam Hamud Herrera ,
This issue was planned to be delivered until 2023-12-11. You can check that by consulting the issue in the Due Date field.

Dates already planned for this issue: 2023-12-11

If External Issue Link field is filled, customer was also informed on JIRA TOTVS.