Ask Your Question

Is there any way to run a pipeline from the command prompt?

asked 2019-12-11 02:43:25 -0600

Shashank Shukla gravatar image

updated 2019-12-11 10:11:50 -0600

metadaddy gravatar image

I want to know, if there is any way to execute a pipeline from the command line interface?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-12-11 10:11:22 -0600

metadaddy gravatar image

Yes, StreamSets Data Collector has a command line interface that allows you to perform some of the same actions that you can complete from the Data Collector UI.

Specifically, you can start a pipeline with:

bin/streamsets cli \
(-U <sdcURL> | --url <sdcURL>) \
[(-a <sdcAuthType> | --auth-type <sdcAuthType>)] \
[(-u <sdcUser> | --user <sdcUser>)] \
[(-p <sdcPassword> | --password <sdcPassword>)] \
[(-D <dpmURL> | --dpmURL <dpmURL>)] \
manager start \
(-n <pipelineID> | --name <pipelineID>) \
[(-r <pipelineRev> | --revision <pipelineRev>)] \
[--stack] \
[(-R <runtimeParametersString> | --runtimeParameters <runtimeParametersString>)]

For example:

bin/streamsets cli -U http://localhost:18630 manager start -n MyPipelinejf45e1f1-dfc1-402c-8587-918bc6e831db
edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-12-11 02:43:25 -0600

Seen: 12 times

Last updated: Dec 11 '19