Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Does streamsets have any concept of persistent flow state?

If I have a pipeline in streamsets that operates on a batch/scheduled basis, can streamsets automatically manage persistent state variables for the pipeline? By "automatically" I mean without me having to use lookup processors to read/populate variables in some external source. So does the flow itself offer any persistence of state (similar to the built-in concept of state in something like Apache Nifi?)

Does streamsets have any concept of persistent flow state?

If I have a pipeline in streamsets that operates on a batch/scheduled basis, can streamsets automatically manage persistent state variables for the pipeline? By "automatically" I mean without me having to use lookup processors to read/populate variables in some external source. So does the flow itself offer any persistence of state (similar to the built-in concept of state in something like Apache Nifi?)