Issue reading files from HDFS

asked 2020-07-20 03:37:27 -0500

hcbharath gravatar image


I'm trying to read files from the source Hadoop FS Standalone. It is able to read some files, but it is ignoring other files with the message ,

Ignoring file '/data/file/dir1/dir2......./ae.csv' in spool directory as is lesser than offset file '/data/file/dir/........../sr.csv'.

Below are the configurations I'm using, image description

Thank you.

edit retag flag offensive close merge delete