Ask Your Question
1

Can we delete the file created the source location using the SFTP/FTP Client Stage in streamsets

asked 2018-05-17 09:40:21 -0500

Janmejay gravatar image

While using SFTP/FTP Client in my pipeline I want to delete the file from the original location once the pipeline is successfully executed.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-05-18 07:45:23 -0500

tmcgrath gravatar image

updated 2018-05-18 07:48:23 -0500

One way could be triggering the deletion of the file via "Produce Events" in the SFTP origin. The event could call a shell script executor which could be customized for your environment and delete the file. Skeleton example screenshot

image description

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-05-17 09:40:21 -0500

Seen: 45 times

Last updated: May 18