Ask Your Question

Pipeline finisher not working with Directory Origin.

asked 2019-12-18 05:17:12 -0500

Shashank Shukla gravatar image

I am trying to load data from csv file which contains more than a million records, and loading it to a JDBC query executor. I have also attached a Pipeline finisher to the ORIGIN, but the pipeline gets finished just after the origin reads first 1000 records. It is not going above it. Can someone please suggest me how to stop the pipeline only after all the records in the csv file have been processed.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-12-18 13:21:16 -0500

metadaddy gravatar image

Ensure that you have set a precondition in the pipeline finisher of ${record:eventType()=='no-more-data'} and set On Record Error to Discard

image description

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-12-18 05:17:12 -0500

Seen: 262 times

Last updated: Dec 18 '19