Ask Your Question

Which among the StreamSets origin best suitable to write our own code and fetch data?

asked 2017-11-20 00:17:11 -0600

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

I am trying to fetch data from Postgresql ,my requirement is to fetch data through my codes.Can anyone suggest me is there any origin which i can use in StreamSets to write my code and fetch data? Not as processor but an origin!

edit retag flag offensive close merge delete


Can you give a bit more detail on what you're trying to do and why the JDBC origins aren't working for you?

metadaddy gravatar imagemetadaddy ( 2017-11-20 10:07:25 -0600 )edit

I am trying to fetch data from Postgresql database which is in odoo .JDBC origins worked when i tried to connect to postgresql db in local directly.But I am not able to fetch the data from postgresql db which is the db for odoo and that is on server.

Maithri gravatar imageMaithri ( 2017-11-20 22:31:17 -0600 )edit

So my requirement is if i can use my python codes in any of the StreamSets origin and fetch the data

Maithri gravatar imageMaithri ( 2017-11-20 22:32:20 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2017-11-20 09:49:49 -0600

jeff gravatar image

What do you mean by "code"? If you are talking about custom code to process the data, consider using a scripting processor (Javascript, Jython, or Groovy). If you have specialized requirements or need better performance than the scripting processors offer, you can write your own processor. In either case, you should be able to use the JDBC Query or JDBC Multi Table origins for your pipeline.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-11-20 00:17:11 -0600

Seen: 108 times

Last updated: Nov 20 '17