copy the data into two different destinations

asked 2019-11-01 06:25:13 -0600

Vss@2019 gravatar image


I want to copy the data into two different destinations It throws an issue when i am processing the whole file.

Orgin --> HadoopFs(Destination) --> HadoopFS(Executor)Destination

I don't want to do it parallel it has to be sequential one after another.

Error when it is copying from HadoopFs(Destination) to HaddopFS(executor) Destination

REcord does not contain the mandatory fields /fileRef,/fileInfo, etc.. for whole file format

FilePath expression in HadoopFs(Executor) Destination is


edit retag flag offensive close merge delete


Any suggestions

Vss@2019 gravatar imageVss@2019 ( 2019-11-02 12:06:34 -0600 )edit

Could you please attach the pipeline and the complete error message?

Ranjith gravatar imageRanjith ( 2019-11-06 04:03:48 -0600 )edit