Ask Your Question

S3 Origin Event Generation not generating any events

asked 2019-04-05 15:53:43 -0600 gravatar image

I am reading a csv file from S3 with event generation turned on. When the pipeline runs and reads all of the lines within the csv, no event is generated so we are unable to stop the pipeline. The documentation says it should generate an event when there is no more data but seemingly doesnt. Any suggestions?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-04-05 18:43:23 -0600 gravatar image

According to Streamsets slack: "The Amazon S3 origin failing to generate no-more-data event issue has been fixed in 3.8.x." I was on 3.7

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-04-05 15:53:43 -0600

Seen: 163 times

Last updated: Apr 05 '19