Ask Your Question

reusable templates

asked 2017-11-14 08:57:01 -0500

Boris Tyukin gravatar image

I am looking at NiFi and StreamSets and really enjoying the ease of use of SDC. One feature I am missing to find in UI or docs is reusable templates which is one of the core features of NiFi. The idea is to create a reusable processes aka black boxes with predefined inputs and outputs.

In my case, I need to design 200 pipelines which are very similar. With NiFi, I could create a template and then reuse it. More importantly, if I need to make changes, I only need to change the template and that change will be applied to all the pipelines based on that template.

Is there a similar concept with SDC?


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2017-11-16 10:50:56 -0500

metadaddy gravatar image

Runtime parameters go part of the way towards this - you can factor out configuration values into parameters and then set them when you start the pipeline. As of now, though, you can't run multiple copies of that pipeline simultaneously with different parameters. SDC-5885 tracks this.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-11-14 08:57:01 -0500

Seen: 530 times

Last updated: Nov 16 '17