Ask Your Question

Feeding events from many pipelines to a single pipeline

asked 2018-06-12 23:40:49 -0500

Trans gravatar image

updated 2018-06-13 00:15:51 -0500

metadaddy gravatar image

Suppose I have some 50 pipelines running and for each pipeline I have one common functionality. For that I am using Directory Produce events (new or finished file event) to send notification.

Now I want to separate the produce event to another pipeline and have all these 50 pipelines to connect to single pipeline for execution

Any ideas ?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-06-13 00:15:12 -0500

metadaddy gravatar image

You can connect the event output to a destination (rather than an executor) and feed the events to a single pipeline via you preferred transport: RPC, HTTP, Kafka, etc.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-06-12 23:40:49 -0500

Seen: 68 times

Last updated: Jun 13 '18