Ask Your Question
1

How to execute a query (or stored procedure), generate a file and send it through SFTP

asked 2019-01-23 14:56:45 -0600

tatia7d gravatar image

updated 2019-01-23 15:19:22 -0600

metadaddy gravatar image

Hi I appreciate the help with this, i am fairly new to SDC. Essentially i need a pipeline, that: executes a query with parameters, possibly a Stored Procedure, generates a file (could be excel or csv), and then that file would need to be transfer through SFTP to a server.

Thanks a lot, Tatiana

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
1

answered 2019-01-23 15:25:08 -0600

metadaddy gravatar image

At present there is no SFTP destination, so you would use the JDBC Query Consumer origin to execute the query, the Local FS destination to write the results in CSV (delimited) format to the local filesystem, and the Shell Executor to run the sftp command when the file is closed. See the documentation on dataflow triggers for some similar use cases.

edit flag offensive delete link more

Comments

Thank you very much!!! i have something to start with.

tatia7d gravatar imagetatia7d ( 2019-01-24 13:14:36 -0600 )edit
1

answered 2019-01-23 15:32:35 -0600

iamontheinet gravatar image

There's also an existing ticket for SFTP/FTP destination if you'd like to watch and vote -- https://issues.streamsets.com/browse/SDC-4188.

Cheers, Dash

edit flag offensive delete link more

Comments

Thank you Dash, i am going to take a look.

tatia7d gravatar imagetatia7d ( 2019-01-24 13:12:28 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-01-23 14:56:45 -0600

Seen: 31 times

Last updated: Jan 23