Ask Your Question

How to retrieve input data directory name dynamically

asked 2019-10-20 12:33:29 -0500

cvjere gravatar image

I am new to streamsets. I am processing series of dynamically generated csv files in directory /data-01/abc/*.csv. I want to record the directory abc for each record as well .Can anyone help to get this achieved. Thanks for your help in advance.

edit retag flag offensive close merge delete

3 Answers

Sort by ยป oldest newest most voted

answered 2019-10-21 11:08:10 -0500

iamontheinet gravatar image


Refer to the file functions outlined in the documentation.

Cheers, Dash

edit flag offensive delete link more

answered 2019-10-23 15:54:50 -0500

cvjere gravatar image

Thanks All. I added the directory as parameter and got the stripped portion of the directory path as field

edit flag offensive delete link more

answered 2019-10-22 08:13:49 -0500

sandeep grandhi gravatar image


Please try the below


Cheers, Sandeep

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-10-20 12:33:29 -0500

Seen: 176 times

Last updated: Oct 21 '19