Ask Your Question

how can i duplicate my Transfer configuration to other resources and Target

asked 2017-09-28 08:41:55 -0600

Sigalits gravatar image

hi StreanSets Team,

we are looking into streamset as solution to replicate data from muli mysql servers into correlated schemas on memsql. after setting up the first test case, can i duplicate the same configuration of tables and data to the other connections?

what would be the easy way to keep adding the same mapping from other server? can i create template and mamage it , instead of manage eache mapping?

is there api to manage those configurations , instead of using the gui? Thanks Sigalit

edit retag flag offensive close merge delete


Are you talking about at design time? I.e. resusing some configurations to design more pipelines? Or at runtime? I.e. deploying a single pipeline with different configurations N times.

jeff gravatar imagejeff ( 2017-10-05 12:52:30 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2019-10-16 07:26:07 -0600

ahmed_alashrafy gravatar image

updated 2019-10-16 07:26:18 -0600

you can use http client in streamsets to export the pipeline with /rest/v1/pipelines/export?includePlainTextCredentials=true then edit the destination and upload it again using the /rest/v1/pipelines/import you can generate that as a pipeline in streamsets and run it automatically

edit flag offensive delete link more
Login/Signup to Answer

Question Tools



Asked: 2017-09-28 08:41:55 -0600

Seen: 297 times

Last updated: Oct 16 '19