Ask Your Question

How do I execute several HTTP calls per record?

asked 2020-07-29 08:56:49 -0500

Jorge Arévalo gravatar image

updated 2020-07-29 09:20:34 -0500

I'm creating a pipeline that starts fetching data from an external API by using HTTP Client.

From that call, I get a JSON response, formatted as several JSON objects. Inside each one of those JSON objects, there's a field containing an array of one or more strings. And each string is an URI that needs to be resolved (by another HTTP call, of course)

Here, a simplified example of my data

image description

So, how do I resolve all uris in the same pipeline step? I could create a Jython evaluator with a loop of HTTP requests, but I'd like to know if there's another approach not involving coding.

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted

answered 2020-07-29 13:44:52 -0500

iamontheinet gravatar image


Not sure about your overarching use case, but looking into using Field Pivoter to create individual records for each URI in the list -- which you can then pass along to HTTP Client processor.

Hope this helps.

Cheers, Dash

edit flag offensive delete link more



Thanks! That's the approach a coworker just suggested me :-)

Jorge Arévalo gravatar imageJorge Arévalo ( 2020-07-30 04:27:09 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2020-07-29 08:56:49 -0500

Seen: 88 times

Last updated: Jul 29