HDFS origin produces result in preview but it just keeps running forever doing nothing

asked 2018-01-19 03:28:20 -0500

kapa gravatar image

I want to pull data out of hdfs and land them to a local fs. When i preview the pipeline it shows the data coming from hdfs and the data that land in the local fs. But when i push play, the pipeline stays in a starting mode for around three minutes, and then it keeps running for ever without doing nothing (i left it for 15 hours). It does not even pull data out of hdfs and all the meters are 0. I am attacing pictures with the pipeline, the preview of each block and the running process.

edit retag flag offensive close merge delete

Comments

Could you attach the pictures you mention?

metadaddy gravatar imagemetadaddy ( 2018-01-19 16:17:43 -0500 )edit