Ask Your Question

SFTP Client (Post Processing Function)

asked 2017-11-28 01:03:18 -0500

Vivian Y gravatar image

updated 2017-11-29 12:57:24 -0500

metadaddy gravatar image

Directory (origin) contains a post processing function , where streamsets will move the files to the expected directory or delete after finish processing the files.

SFTP Client does not have this function, in this case, is there any alternatives way in order for SFTP client to do Post Processing function same as Directory in origin.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2017-11-28 13:21:20 -0500

jeff gravatar image

You are right that it's not yet implemented. Please watch SDC-4688, which is the Jira for that feature. In the meantime, you can try using a shell executor at the end of the pipeline to execute a shell script (which can call whatever ftp commands you like).

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-11-28 01:03:18 -0500

Seen: 463 times

Last updated: Nov 28 '17