Get pipeline to make a DB entry on finish

asked 2018-10-03 11:46:38 -0500

Spiced Cider gravatar image

updated 2018-10-03 12:16:19 -0500

jeff gravatar image

I have a pipeline (with Elasticsearch origin) and I need it to make a DB entry when it finishes processing (this pipeline is called from Rest API) How do I get it to do that? Below is what I've explored / tried so far:

SDC version:

  • Tried to get a finished event from one of the stages, but does not look like that is an option.
  • Pass data to another pipeline using SDC RPC: but this needs original pipeline to send data to SDC RPC.
  • Tried to use pipeline start/stop config - but usable options are JDBC query (which is a query and does not allow saving data) or writing to another pipeline (which results in the next point).
  • Have it kick off another pipeline: with this, how then do I make the second pipeline make a DB entry and finish?
edit retag flag offensive close merge delete