Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Hello JM, I too had a need for a web service lookup. Although new to StreamSets, what worked for me was the HTTPClient processor. It will let you enter in the connection information for the web service you want to call (url, header values such as api key) and the response body from the http call is put into a record variable you define in the HTTP tab/Output Field. You can then extract any field items from that variable using the other processing stages. The 'update' http verbs will also allow you to put in a "Request Data". The GET verb only allows for a url (with query string).

Here is the link to the documentation: https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/HTTPClient.html#concept_ghx_ypr_fw

Hope it helps!