Ask Your Question
1

Need to lookup using a web service

asked 2018-10-09 05:43:43 -0600

Jmbertoncelli gravatar image

Hello

I need to augment my data by calling a web service (rest/API) but I cannot see how this could be done using streamsets.

any idea will be welcome.

Thank you!

JM

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2018-10-12 08:44:14 -0600

daveh gravatar image

Hello JM, I too had a need for a web service lookup. Although new to StreamSets, what worked for me was the HTTPClient processor. It will let you enter in the connection information for the web service you want to call (url, header values such as api key) and the response body from the http call is put into a record variable you define in the HTTP tab/Output Field. You can then extract any field items from that variable using the other processing stages. The 'update' http verbs will also allow you to put in a "Request Data". The GET verb only allows for a url (with query string).

Here is the link to the documentation: https://streamsets.com/documentation/...

Hope it helps!

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-10-09 05:43:43 -0600

Seen: 53 times

Last updated: Oct 09