Only Reset Origin s3 Helps

asked 2018-12-16 07:56:15 -0600

dror-arm gravatar image


Iv'e configured pipes with S3 Origin, with delete post-processing

After a while there are files in the directory and the pipe seems to be idle. Only Reset Origin helps to read those 'Skipped' files, and clear that directory as expected.

Is there a way to solve it? don't want manually keep resetting.

edit retag flag offensive close merge delete


set s3ConfigBean.s3FileConfig.objectOrdering to TIMESTAMP instead of LEXICOGRAPHIC

dror-arm gravatar imagedror-arm ( 2018-12-20 08:22:37 -0600 )edit