Ask Your Question
0

SFTP Origin not processing empty file

asked 2019-10-21 10:54:45 -0500

StreamNooby gravatar image

Hi,

I am trying to copy a file from a remote server over SFTP to HDFS the case is that when the file is not empty i can copy the file into HDFS and create the new directory correctly but when the file on the server is empty (0 kb) the new file is not created on HDFS but i get no error on the pipeline.

Can someone make some light over what might be the problem ?

Thanks in advance.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2020-01-09 09:38:17 -0500

StreamNooby gravatar image

Just to close the question.

I got the solution by calling the "reset origin" command prior to the execution of the pipeline in my bash file.

Hope it can help you guys.

Thanks

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-10-21 10:50:18 -0500

Seen: 50 times

Last updated: Oct 21 '19