Call JDBC Query Executor
Hi,
I have a requirement to execute few post update/delete statements in my pipeline after data is loaded into Target.
My pipeline source is JDBC Query Consumer and target is Apache Kudu Database. I produced events on JDBC Query Consumer and connected to JDBC Query Executor (included post update/delete statements in this). With JDBC Query Consumer, after the no more data event is generated...this stage of JDBC Query Executor should be executed.
Current behavior: JDBC Query Executor statements are executing before completing the data loading into the target.
Expected behavior: JDBC Query Executor statements should start executing after completing data loading into Target Destination. I tried to produce events with Kudu DB Destination but it doesn't have it.
Can you please suggest if I can use JDBC Query Executor to perform post update/delete scripts or some other way. Below is the screenshot of pipeline:
Thanks,
Srinath
@iamontheinet...please suggest ?
Can you update your question with the current behavior (when you run the pipeline with existing setup) and what your desired behavior is? It's unclear right now.
@iamontheinet...updated the question.
I'd try using Stop Event of the pipeline and then select JDBC Query and enter the details on Stop Event - JDBC Query tab.
My pipeline should be running continuously...so I specified Query Interval of 1 hour in JDBC Query Consumer. This cycle of data loading to target and executing of post SQL Statements should happen every 1 hour.