how to fetch latest file

asked 2020-03-25 11:33:56 -0500

Venkat gravatar image

How to pick the latest file and if the latest file not exist job will be succeeded without any error.

Ex: Source is .csv file test_03242020.csv test_03252020.csv

This is daily scheduled job if the job triggered on 03/25 the latest file "test_03252020.csv" file should fetch and for the job triggered on 03/26 if the latest file not exist the job should execute without any error.

Can you please suggest how to proceed streamsets pipeline with this scenario

edit retag flag offensive close merge delete