Offset in mongodb oplog

asked 2019-05-14 11:09:40 -0600

srinath_222 gravatar image

updated 2019-05-21 09:25:38 -0600


I am using Monodb Oplog as my origin in my pipeline.

When I start the pipeline for first time, I set the Initial Timestamp to some value (will set to current EPOCH time in seconds).

We are having frequent restarts on our server, so every time it is loading the data from that timestamp mentioned initially.

Does MongoDB Oplog store the last offset in its memory, so that next time it loads from that offset for incremental ones.

Please suggest.

edit retag flag offensive close merge delete


@metadaddy any suggestions ?

srinath_222 gravatar imagesrinath_222 ( 2019-05-21 09:25:53 -0600 )edit