Ask Your Question

Revision history [back]

To run pipelines after reading from db,you can create pipelines with database supported origin and then use an expression evaluator or stream selector according to your need and at the end place a shell executor where you can write pipeline start stop commands(CLI commands ) https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Administration/Administration_title.html#concept_ywx_d5x_pt

An example pipeline structure:

image description

To run pipelines after reading from db,you can create pipelines with database supported origin and then use an expression evaluator or stream selector according to your need and at the end place a shell executor where you can write pipeline start start, stop commands(CLI commands ) https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Administration/Administration_title.html#concept_ywx_d5x_pt

An example pipeline structure:

image description