Ask Your Question

How to export a pipeline using REST api?

asked 2019-09-02 23:58:10 -0500

hcbharath gravatar image

I have a requirement to automate exporting a pipeline. So, how can I export a pipeline using REST api?

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted

answered 2019-09-03 12:00:10 -0500

metadaddy gravatar image

All of the Data Collector APIs are accessible from the UI by going to Help / RESTful API. Scroll down to the store section and you'll see GET /v1/pipeline/{pipelineId}/export. You can supply a pipeline id there to try it out, or, from curl:

curl -u admin:admin http://localhost:18630/rest/v1/pipeline/{pipelineId}/export -H "X-Requested-By:sdc"

You'll receive the JSON pipeline in response.

edit flag offensive delete link more


How could we know which Data Collector holds this pipeline id automatically.

Souvik gravatar imageSouvik ( 2020-02-09 22:05:20 -0500 )edit

If you just have a set of Data Collector instances, you would need to keep track of which pipeline was where. StreamSets Control Hub provides a centralized repository that the Data Collector instances can share

metadaddy gravatar imagemetadaddy ( 2020-02-10 12:00:41 -0500 )edit

answered 2019-09-03 10:35:05 -0500

Sasi Eswaran gravatar image
  1. From within Data Collector, click the Question mark (at the right top corner)
  2. Choose RESTful API from the pop-up menu
  3. //You will see a page with all Data Collector RESTful APIs grouped under various categories
  4. Choose Store group
  5. You will see the API /v1/pipeline/{pipelineId}/export Obviously, you will have to prefix the path in #5 above with the Data Collector URL.
edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-09-02 23:58:10 -0500

Seen: 627 times

Last updated: Sep 03 '19