how to process all file in a directory?

asked 2020-10-21 04:03:26 -0600

Zhanghan gravatar image

updated 2020-10-26 21:10:58 -0600

I configure the origin to read from subdirectories, it should reads files from all subdirectories but it only read files in the first subdirectory,is there anyone have the same problem?

Here are my orign file configuation:

Files Directory:/tmp/out/wsxf

Number of Threads:3

File Name Pattern Mode:Glob

File Name Pattern:*.json

Read Order:Last modified TimeStamp

Process Subdirectories:true

Batch Size (recs):1000

Batch Wait Time (secs):60

Allow Late Directory:true

First File to Process :

Max Files Soft Limit :1000

Spooling Period (secs):5

Buffer Limit (KB):128

Sorry to update my question like this ,because i do not have the poits to upload images

edit retag flag offensive close merge delete


Can you update your question and provide details around how you've configured your origin?

iamontheinet gravatar imageiamontheinet ( 2020-10-26 14:08:53 -0600 )edit