Delete S3 objects

asked 2019-04-01 11:34:21 -0600

divyang gravatar image

I am having two pipelines A & B.

A - It dumps multiple objects in specified s3 bucket.

B - reads from s3 bucket does some processing and dumps the records in mysql Db.

I have given the post processing parameter as delete in the S3 origin but still after reading multiple objects from the s3 bucket the objects are not getting deleted .

Also when I am reading from only 1 object in the bucket that object is getting deleted.

edit retag flag offensive close merge delete