Ask Your Question

Pipeline finisher is not stopping pipeline

asked 2018-03-01 03:21:51 -0600

VijayJaiswal gravatar image

updated 2018-03-02 10:16:13 -0600

metadaddy gravatar image

I have added pipeline finisher after origin but it doesn't stop running stage to finish.

I have done below steps.

  1. In Origin(Directory) checked oprion produce event
  2. Add pipeline finisher with below condition

    ${record:eventType() == 'no-more-data'}

    On error record:Discard.

  3. Then connected Origin to pipeline finisher

my pipeline never coming to finished stage.

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted

answered 2018-03-02 10:23:34 -0600

metadaddy gravatar image

The most likely problem here is Batch Wait Time in the Directory Origin. The origin will for this amount of time before deciding that no more data will arrive, and emitting the no-more-data event. Reduce Batch Wait Time and see if it finishes as expected.

edit flag offensive delete link more

answered 2018-03-08 04:06:15 -0600

VijayJaiswal gravatar image

Thanks a lot, setting batch time has resolved problem

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-03-01 03:21:51 -0600

Seen: 624 times

Last updated: Mar 08 '18