Ask Your Question
0

Copy/Re-use Stages between Pipelines

asked 2019-07-19 15:38:11 -0500

DataAnalyst1029 gravatar image

updated 2019-07-19 15:38:39 -0500

I have multiple pipelines that I am making regular changes to, and require a way to quickly copy a stage, configurations and all, into another pipeline. Is there a specific way to do this? I see that there is a Sharing ability in pipelines, but am not sure from documentation whether this is for my specific issue.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2019-07-19 17:43:36 -0500

iamontheinet gravatar image

Hi!

Not sure if you're aware of duplicating pipelines. The other option is pipeline fragments, available via StreamSets Control Hub.

Cheers, Dash

edit flag offensive delete link more

Comments

The pipelines are already configured, so I would have to transfer existing processing logic over to any duplicated pipeline. The pipeline fragments approach does look promising, I will look into this!

DataAnalyst1029 gravatar imageDataAnalyst1029 ( 2019-07-20 11:09:10 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-07-19 15:38:11 -0500

Seen: 45 times

Last updated: Jul 19