Ask Your Question

Need to lookup using a web service

asked 2018-10-09 05:43:43 -0500

Jmbertoncelli gravatar image


I need to augment my data by calling a web service (rest/API) but I cannot see how this could be done using streamsets.

any idea will be welcome.

Thank you!


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-10-12 08:44:14 -0500

daveh gravatar image

Hello JM, I too had a need for a web service lookup. Although new to StreamSets, what worked for me was the HTTPClient processor. It will let you enter in the connection information for the web service you want to call (url, header values such as api key) and the response body from the http call is put into a record variable you define in the HTTP tab/Output Field. You can then extract any field items from that variable using the other processing stages. The 'update' http verbs will also allow you to put in a "Request Data". The GET verb only allows for a url (with query string).

Here is the link to the documentation:

Hope it helps!

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-10-09 05:43:43 -0500

Seen: 156 times

Last updated: Oct 09 '18