Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Delete S3 objects

I am having two pipelines A & B.

A - It dumps multiple objects in specified s3 bucket.

B - reads from s3 bucket does some processing and dumps the records in mysql Db.

I have given the post processing parameter as delete in the S3 origin but still after reading multiple objects from the s3 bucket the objects are not getting deleted .

Also when I am reading from only 1 object in the bucket that object is getting deleted.