Ask Your Question
0

HDFS Target file name

asked 2018-02-02 08:22:08 -0500

ashishprem gravatar image

Hi, I am loading file from S3 to HDFS. I am able to load the file successfully. My question is how can we can get the source file name to be used for HDFS destination file name. Currently it is appending the execution_id (i guess) to file name).. I want to use the source_file_name_YYMMDDSS in the destination. Thanks your help.

Thanks, Ashish

edit retag flag offensive close merge delete

Comments

can anyone please advise on it?

ashishprem gravatar imageashishprem ( 2018-02-06 23:34:00 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-02-12 01:04:29 -0500

Jisun gravatar image

You can refer to this doc: https://streamsets.com/documentation/...

If you are using whole file data format, the file information can be found in record field: "fileInfo".

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-02-02 08:22:08 -0500

Seen: 50 times

Last updated: Feb 12