How to export a pipeline using REST api?

asked 2019-09-02 23:58:10 -0600

hcbharath
33 ●11 ●12 ●17

I have a requirement to automate exporting a pipeline. So, how can I export a pipeline using REST api?

edit retag flag offensive close merge delete

add a comment

1

answered 2019-09-03 12:00:10 -0600

metadaddy

5464 ●26 ●41 ●82 https://about.me/patpa...

All of the Data Collector APIs are accessible from the UI by going to Help / RESTful API. Scroll down to the store section and you'll see GET /v1/pipeline/{pipelineId}/export. You can supply a pipeline id there to try it out, or, from curl:

curl -u admin:admin http://localhost:18630/rest/v1/pipeline/{pipelineId}/export -H "X-Requested-By:sdc"

You'll receive the JSON pipeline in response.

edit flag offensive delete link

Comments

How could we know which Data Collector holds this pipeline id automatically.

Souvik ( 2020-02-09 22:05:20 -0600 )edit

If you just have a set of Data Collector instances, you would need to keep track of which pipeline was where. StreamSets Control Hub provides a centralized repository that the Data Collector instances can share https://streamsets.com/products/dataops-platform/control-hub/

metadaddy ( 2020-02-10 12:00:41 -0600 )edit

add a comment

2

answered 2019-09-03 10:35:05 -0600

Sasi Eswaran
106 ●1 ●3

From within Data Collector, click the Question mark (at the right top corner)
Choose RESTful API from the pop-up menu
//You will see a page with all Data Collector RESTful APIs grouped under various categories
Choose Store group
You will see the API /v1/pipeline/{pipelineId}/export Obviously, you will have to prefix the path in #5 above with the Data Collector URL.

edit flag offensive delete link

add a comment

How to export a pipeline using REST api?

2 Answers

Comments

Question Tools

Stats

Related questions

How to export a pipeline using REST api? edit

2 Answers

Comments

Question Tools

Stats

Related questions

How to export a pipeline using REST api?