SFTP Client (Post Processing Function)

sftp
ftp

asked 2017-11-28 01:03:18 -0500

Vivian Y
273 ●33 ●36 ●46

updated 2017-11-29 12:57:24 -0500

metadaddy

5464 ●26 ●41 ●81 https://about.me/patpa...

Directory (origin) contains a post processing function , where streamsets will move the files to the expected directory or delete after finish processing the files.

SFTP Client does not have this function, in this case, is there any alternatives way in order for SFTP client to do Post Processing function same as Directory in origin.

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2017-11-28 13:21:20 -0500

jeff
3180 ●18 ●41 ●71

You are right that it's not yet implemented. Please watch SDC-4688, which is the Jira for that feature. In the meantime, you can try using a shell executor at the end of the pipeline to execute a shell script (which can call whatever ftp commands you like).

edit flag offensive delete link

Comments

Thanks, but what about the case where files to be deleted are present at different server from SDC?

Abhishek ( 2018-11-14 13:54:42 -0500 )edit

Hi, Is this feature implemented now? are there any other alternatives to move a file to archive after processing other than shell executor?

Tutgirl ( 2018-12-14 11:20:18 -0500 )edit

add a comment

Question Tools

1 follower

Stats

Asked: 2017-11-28 01:03:18 -0500

Seen: 826 times

Last updated: Nov 28 '17

SFTP Client (Post Processing Function) edit

1 Answer

Comments

Question Tools

Stats

Related questions

SFTP Client (Post Processing Function)