When adding or editing a Data Subscription Carol should not create the feed task - the process to feed is through a SQL Pipeline
Description
DESCRIBE THE ISSUE YOU'RE HAVING:
When user config a new Data Subscription (DS), Carol is creating the Subscription Feeder task. It looks like this task read the data from CDS and send via sub. It looks like this feature is not necessary anymore.
DESCRIBE ALTERNATIVES YOU CONSIDERED:
It would be nice to discuss if this feature is necessary or not.
ADD AS MUCH CONTEXT AS POSSIBLE:
- Link to the task: https://protege.carol.ai/protege/carol-ui/tasks/activity/7afc9fa421d9444dba277e3219320a4f
Acceptance Criteria
- Do not start the task Subscription Feeder when creating a new data subscription or editing it.
- The alternative for this flow is to process a SQL pipeline.
- This task increases cost, and it could be more performance effective by using SQL pipelines.
- Remove the endpoints that gets data from CDS and another getting data from RT (endpoints to be removed: `
/api/v1/subscription/${dataSubscriptionId}/feedQuery
/api/v1/subscription/${dataSubscriptionId}/feed?startCounter=${counter}
NOT COVERED:
- Only allow creating this task through the specific endpoint that feeds the subscription (There is an endpoint getting data from CDS and another getting data from RT).