Ask Your Question

How to get response/feedback from streamsets

asked 2018-02-09 03:21:50 -0600

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

How do I get a response from StreamSets when a set of operation is completed? For example, how can I get a response to my Kafka producer once the data is inserted into MongoDB.

I get data from Kafka producer by creating a Kafka consumer and save the data to MongoDB. Now I have an id for the data inserted. I have to give back the same id to the producer which called.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-02-09 17:29:29 -0600

metadaddy gravatar image

Right now, there's no way of doing this for MongoDB. A similar scenario is possible for relational databases - the JDBC Tee processor writes data to a database table, receives generated column values, such as id fields, in the response and passes them along the pipeline. It would be possible to pass the id to a Kafka producer.

Feel free to file an issue for a MongoDB Tee processor.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-02-09 03:21:50 -0600

Seen: 348 times

Last updated: Feb 09 '18