Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

JDBC Query Consumer - Pipeline Finisher Not Working

We are using ORACLE source to pull data using JDBC Query Consumer as a part of Incremental MODE. We have configured pipeline to work as batch mode (precondition of ${record:eventType() == 'no-more-data'}) and scheduled this job using Control-M. Our query interval was ${10 * SECONDS}. It was working fine as expected in lower environment (DEV/TEST).

But in production, our pipeline was consuming data continuously (Never STOP). After analyzing the production source data, we noticed that records are getting updated every 1 second or less.

We need your help to fix this issue.

JDBC Query Consumer - Pipeline Finisher Not Working

We are using ORACLE source to pull data using JDBC Query Consumer as a part of Incremental MODE. We have configured pipeline to work as batch mode (precondition of ${record:eventType() == 'no-more-data'}) and scheduled this job using Control-M. Our query interval was ${10 * SECONDS}. It was working fine as expected in lower environment (DEV/TEST).

But in production, our pipeline was consuming data continuously (Never STOP). After analyzing the production source data, we noticed that records are getting updated every 1 second or less.

We need your help to fix this issue.