Ask Your Question
0

SDC upgraded to 3.11.0: CDC Postgres not capturing any data change

asked 2019-10-09 17:11:02 -0600

Torkia Boussada gravatar image

Hello, Today, we have upgraded sdc to version 3.11.0 After the upgrade CDC Postgres pipeline is not capturing any data change. Pipeline running and not showing any error in the log.

Postgres library is installed and replication slot is active in the database. Postgres DB version is: 9.5.14.

Pipeline was working fine before the upgrade (previously running sdc 3.7.1) Please advice!

Regards, Torkia

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2019-11-08 19:21:14 -0600

bob gravatar image

Check if there are any errors in the sdc.log which might relate to this issue - such as connection issues, etc.

If there are no issues in the log, please try setting the batch size to 1. The batch size behavior was changed and that might be the problem.

edit flag offensive delete link more

Comments

Hi Bob, Thanks for your response. Yes, I have changed max batch size to 1 and it's working fine. So the pipeline doesn't keep waiting indefinitely for having a full batch (was 100). This would produce a new batch every time there is data available at the origin. Thanks again for your help!

Torkia Boussada gravatar imageTorkia Boussada ( 2019-11-13 05:37:44 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-10-09 17:11:02 -0600

Seen: 406 times

Last updated: Nov 08