JDBC Producer keeps getting all the data in incremental mode
The pipeline just keeps looping over the same data, even though it’s set to Incremental Mode. There are 6M records in my table; I stopped it at 10M.
This is my configured query:
SELECT "timestamp", "id"
FROM pages
WHERE received_at > '${OFFSET}'
ORDER BY received_at DESC
LIMIT 1000