Ask Your Question

SFTP Client (Post Processing Function)

asked 2017-11-28 01:03:18 -0600

Vivian Y gravatar image

updated 2017-11-29 12:57:24 -0600

metadaddy gravatar image

Directory (origin) contains a post processing function , where streamsets will move the files to the expected directory or delete after finish processing the files.

SFTP Client does not have this function, in this case, is there any alternatives way in order for SFTP client to do Post Processing function same as Directory in origin.

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted

answered 2017-11-28 13:21:20 -0600

jeff gravatar image

You are right that it's not yet implemented. Please watch SDC-4688, which is the Jira for that feature. In the meantime, you can try using a shell executor at the end of the pipeline to execute a shell script (which can call whatever ftp commands you like).

edit flag offensive delete link more


Thanks, but what about the case where files to be deleted are present at different server from SDC?

Abhishek gravatar imageAbhishek ( 2018-11-14 13:54:42 -0600 )edit

Hi, Is this feature implemented now? are there any other alternatives to move a file to archive after processing other than shell executor?

Tutgirl gravatar imageTutgirl ( 2018-12-14 11:20:18 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-11-28 01:03:18 -0600

Seen: 903 times

Last updated: Nov 28 '17