runtime parameter

asked 2019-05-09 15:17:33 -0500

Carol gravatar image

I have a pipeline with a number of runtime parameters. One parameter in particular needs to have its value populated each time it runs because its value changes frequently. Its value comes from a column in a table within SQL Server database. What is the best way to provide the runtime value to the pipeline? I am using Control Hub with Jobs having parameters. Just need a way to dynamically provide the value to the Job.

edit retag flag offensive close merge delete

Comments

Is this essentially the same question as https://ask.streamsets.com/question/5065/jdbc-consumer-query-run-once/ ? It seems like you're trying to solve the same problem.

metadaddy gravatar imagemetadaddy ( 2019-05-13 20:13:03 -0500 )edit

It is related yes -- trying a different approach. It seems that Job Templates might be useful, but i think the parameter values in a file might work except it seems the values in the file are static? I don't see how to refresh those values in the file.

Carol gravatar imageCarol ( 2019-05-15 11:21:10 -0500 )edit