how to trigger the pipeline only after a particular file is available in the source

asked 2020-10-29 05:50:07 -0600

Gaja gravatar image

I have created a pipeline with Directory Origin component by which I will read the data from file and stream to next component in pipeline. Every time new input data files will be copied to pipeline's source path from another server.

How to trigger the pipeline to process the input data only after input file is completely copied to the input path. We are using shell script to copy file from another server and it will trigger a separate file(.done file) to notify that file has copied completely. So my pipeline should start only after .ok file is created in input path? How to accomplish it?

edit retag flag offensive close merge delete