Ask Your Question
0

Pipeline failover configuration

asked 2019-04-02 13:50:47 -0500

Prady gravatar image

I have 2 instances of Streamsets Data Collector(Open source edition) running on 2 separate machines. Can i configure pipeline failure without Streamsets hub ?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2019-04-04 00:39:05 -0500

metadaddy gravatar image

It's possible, but it would take a lot of manual setup. You would have to continuously monitor the pipeline definition and offset files for each pipeline, copying them to somewhere safe, detect that the node had failed, then provision the pipeline definition and offset to another node.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-04-02 13:50:47 -0500

Seen: 68 times

Last updated: Apr 04