Defect of directory origin (empty dir)

asked 2018-11-28 00:41:04 -0600

foxgarden gravatar image

updated 2018-11-28 00:43:15 -0600

Use directory origin to monitor a dir, say '/home/hdfs/weblog', and this is an EMPTY dir. If the Read Order is set to 'Lexicographically Ascending File Names', it cannot handle new files. Try:

  1. Keep the dir EMPTY, and start the pipeline
  2. Under '/home/hdfs/weblog', execute vi (filename) and enter something, or mv (filename) into this dir

If the Read Order is set to 'Last Modified Timestamp', it works fine.

Version 3.5.2

edit retag flag offensive close merge delete