Ask Your Question

Get records

asked 2019-04-11 13:35:49 -0500

anonymous user


I am using as origin a S3 bucket, for testing purposes I have 2 avro files with 3 row each one. When I execute the pipeline, I am getting only the first 3 records. How can I get the six of them?

edit retag flag offensive close merge delete


Have you tried resetting the origin?

metadaddy gravatar imagemetadaddy ( 2019-04-11 13:49:16 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2019-04-11 15:42:20 -0500

lilian gravatar image

Yes, it is working with Reset Origin, but works only once and then I need to do it again, otherwise reads only one Avro. Is it a way to get consistence?

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-04-11 13:35:49 -0500

Seen: 105 times

Last updated: Apr 11 '19