Ask Your Question

HDFS Target file name

asked 2018-02-02 08:22:08 -0600

ashishprem gravatar image

Hi, I am loading file from S3 to HDFS. I am able to load the file successfully. My question is how can we can get the source file name to be used for HDFS destination file name. Currently it is appending the execution_id (i guess) to file name).. I want to use the source_file_name_YYMMDDSS in the destination. Thanks your help.

Thanks, Ashish

edit retag flag offensive close merge delete


can anyone please advise on it?

ashishprem gravatar imageashishprem ( 2018-02-06 23:34:00 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2018-02-12 01:04:29 -0600

Jisun gravatar image

You can refer to this doc:

If you are using whole file data format, the file information can be found in record field: "fileInfo".

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-02-02 08:22:08 -0600

Seen: 207 times

Last updated: Feb 12 '18