SFTP Client (Post Processing Function)

sftp
ftp

asked 2017-11-28 01:03:18 -0600

Vivian Y
273 ●28 ●33 ●42

updated 2017-11-29 12:57:24 -0600

metadaddy

2349 ●23 ●31 ●58 https://about.me/patpa...

Directory (origin) contains a post processing function , where streamsets will move the files to the expected directory or delete after finish processing the files.

SFTP Client does not have this function, in this case, is there any alternatives way in order for SFTP client to do Post Processing function same as Directory in origin.

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2017-11-28 13:21:20 -0600

jeff
1967 ●17 ●30 ●53

You are right that it's not yet implemented. Please watch SDC-4688, which is the Jira for that feature. In the meantime, you can try using a shell executor at the end of the pipeline to execute a shell script (which can call whatever ftp commands you like).

edit flag offensive delete link

Comments

Thanks, but what about the case where files to be deleted are present at different server from SDC?

Abhishek ( 2018-11-14 13:54:42 -0600 )edit

add a comment

Question Tools

1 follower

Stats

Asked: 2017-11-28 01:03:18 -0600

Seen: 496 times

Last updated: Nov 28 '17

SFTP Client (Post Processing Function) edit

1 Answer

Comments

Question Tools

Stats

Related questions

SFTP Client (Post Processing Function)