Ask Your Question
1

Does streamsets have any concept of persistent flow state?

asked 2018-09-05 09:38:09 -0500

dcwatson84 gravatar image

updated 2018-09-06 08:02:11 -0500

Shruthi gravatar image

If I have a pipeline in streamsets that operates on a batch/scheduled basis, can streamsets automatically manage persistent state variables for the pipeline? By "automatically" I mean without me having to use lookup processors to read/populate variables in some external source. So does the flow itself offer any persistence of state (similar to the built-in concept of state in something like Apache Nifi?)

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-09-05 16:58:25 -0500

iamontheinet gravatar image

Hi! I don't believe there's a built-in state persistence across restarts. For other options you may find this thread useful -- https://ask.streamsets.com/question/1...

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

2 followers

Stats

Asked: 2018-09-05 09:38:09 -0500

Seen: 109 times

Last updated: Sep 05