Ask Your Question

SFTP Origin not processing empty file

asked 2019-10-21 10:54:45 -0600

StreamNooby gravatar image


I am trying to copy a file from a remote server over SFTP to HDFS the case is that when the file is not empty i can copy the file into HDFS and create the new directory correctly but when the file on the server is empty (0 kb) the new file is not created on HDFS but i get no error on the pipeline.

Can someone make some light over what might be the problem ?

Thanks in advance.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2020-01-09 09:38:17 -0600

StreamNooby gravatar image

Just to close the question.

I got the solution by calling the "reset origin" command prior to the execution of the pipeline in my bash file.

Hope it can help you guys.


edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-10-21 10:50:18 -0600

Seen: 62 times

Last updated: Oct 21 '19