Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Offset in mongodb oplog

Hi,

I am using Monodb Oplog as my origin in my pipeline.

When I start the pipeline for first time, I set the Initial Timestamp to some value (will set to current EPOCH time in seconds).

We are having frequent restarts on our server, so every time it is loading the data from that timestamp.

Does MongoDB Oplog store the last offset in its memory, so that next time it loads from that offset for incremental ones.

Please suggest.

Offset in mongodb oplog

Hi,

I am using Monodb Oplog as my origin in my pipeline.

When I start the pipeline for first time, I set the Initial Timestamp to some value (will set to current EPOCH time in seconds).

We are having frequent restarts on our server, so every time it is loading the data from that timestamp.timestamp mentioned initially.

Does MongoDB Oplog store the last offset in its memory, so that next time it loads from that offset for incremental ones.

Please suggest. suggest.