Ask Your Question

Revision history [back]

You can parameterize pipelines using runtime parameters.

A single instance of Data Collector can only run one instance of a given pipeline, so to run multiple instances you would need to install multiple instances of Data Collector, or use StreamSets Control Hub, which allows you to create jobs that associate parameters with a pipeline, and run multiple jobs across one or more Data Collector instances.