Ask Your Question
1

How to retrieve input data directory name dynamically

asked 2019-10-20 12:33:29 -0600

cvjere gravatar image

I am new to streamsets. I am processing series of dynamically generated csv files in directory /data-01/abc/*.csv. I want to record the directory abc for each record as well .Can anyone help to get this achieved. Thanks for your help in advance.

edit retag flag offensive close merge delete

3 Answers

Sort by ยป oldest newest most voted
1

answered 2019-10-21 11:08:10 -0600

iamontheinet gravatar image

Hi!

Refer to the file functions outlined in the documentation.

Cheers, Dash

edit flag offensive delete link more
1

answered 2019-10-23 15:54:50 -0600

cvjere gravatar image

Thanks All. I added the directory as parameter and got the stripped portion of the directory path as field

edit flag offensive delete link more
1

answered 2019-10-22 08:13:49 -0600

sandeep grandhi gravatar image

Hi,

Please try the below

${file:parentPath('/data-01/abc')}

Cheers, Sandeep

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-10-20 12:33:29 -0600

Seen: 100 times

Last updated: Oct 21