Ask Your Question
1

Does SDC give message order preservation guarantee?

asked 2019-11-06 02:48:07 -0600

Gill Bates gravatar image

Hello! I'm searching an answer for a question whether SDC preserves order of the incoming messages when writing them to destinations. Is such a guarantee established in the design of SDC?

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted
2

answered 2019-11-06 12:38:01 -0600

metadaddy gravatar image

StreamSets Data Collector will only preserve the order of incoming messages in pipelines with single-threaded origins and no Stream Selectors. When you allow multiple threads and multiple paths for records, things get non-deterministic.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-11-06 02:48:07 -0600

Seen: 17 times

Last updated: Nov 06