Ask Your Question

Does streamsets have any concept of persistent flow state?

asked 2018-09-05 09:38:09 -0600

dcwatson84 gravatar image

updated 2018-09-06 08:02:11 -0600

Shruthi gravatar image

If I have a pipeline in streamsets that operates on a batch/scheduled basis, can streamsets automatically manage persistent state variables for the pipeline? By "automatically" I mean without me having to use lookup processors to read/populate variables in some external source. So does the flow itself offer any persistence of state (similar to the built-in concept of state in something like Apache Nifi?)

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-09-05 16:58:25 -0600

iamontheinet gravatar image

Hi! I don't believe there's a built-in state persistence across restarts. For other options you may find this thread useful --

edit flag offensive delete link more
Login/Signup to Answer

Question Tools



Asked: 2018-09-05 09:38:09 -0600

Seen: 552 times

Last updated: Sep 05 '18