Ask Your Question

Pipeline failover configuration

asked 2019-04-02 13:50:47 -0500

Prady gravatar image

I have 2 instances of Streamsets Data Collector(Open source edition) running on 2 separate machines. Can i configure pipeline failure without Streamsets hub ?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-04-04 00:39:05 -0500

metadaddy gravatar image

It's possible, but it would take a lot of manual setup. You would have to continuously monitor the pipeline definition and offset files for each pipeline, copying them to somewhere safe, detect that the node had failed, then provision the pipeline definition and offset to another node.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-04-02 13:50:47 -0500

Seen: 134 times

Last updated: Apr 04 '19