Parameterized file path

asked 2018-11-20 08:43:11 -0600

anonymous user

Anonymous

I have a lot of technical experience with ETL (SSIS and Talend), but not Streamsets, so forgive me. I may be "that guy" asking the questions with not enough details - sorry, that makes me crazy too. Our development team is retrieving JSON responses from an API. We have multiple responses from the API to process that we would like to iterate through. For instance, the source data could be:

https://the.api.com/123/detail OR https://the.api.com/456/detail OR https://the.api.com/ABC/detail

We don't know the value we need in the URL until runtime. I've done something similar in both SSIS and Talend. The list of values for the URL comes from the response from a previous API call, but could come from a database table if that makes it easier.

So the question is... Is there a way to create a parameterized URL for something like this at runtime?

Thank you!

edit retag flag offensive close merge delete