Ask Your Question

Stop Event - Amazon S3

asked 2018-02-19 15:13:44 -0600

Shilpesh gravatar image

updated 2018-02-28 15:43:30 -0600

metadaddy gravatar image

I am trying to configure a "Stop Event - Amazon S3" in a pipeline and was looking to publish data like "input record count", "Output record count", "Pipeline Start Time", "Pipeline End Time" when a pipeline is stopped (manually or otherwise).

I could get the pipeline name by using ${pipeline:title()} however I am not sure how to get other parameters? Any help will be greatly appreciated.

edit retag flag offensive close merge delete


Hi Team, I am still having trouble getting "input record count", "Output record count", "Pipeline Start Time", "Pipeline End Time" through "Stop Event-Amazon S3", Please suggest how can we achieve this. Also I am not sure how to refer field values inside the Stop event-Amazon s3 as record:value(/).

Shilpesh gravatar imageShilpesh ( 2018-02-27 09:54:55 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2018-02-28 15:53:34 -0600

metadaddy gravatar image

You can access the relevant fields in the Amazon S3 Origin's no-more-data event record with:

  • ${record:value('/record-count')
  • ${record:value('/error-count')
  • ${record:value('/file-count')

See the Amazon S3 Origin Documentation

For pipeline start and stop time, you would need to use Pipeline Events.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-02-19 15:13:44 -0600

Seen: 92 times

Last updated: Feb 28 '18