sql server cdc OOM

asked 2019-07-07 23:32:24 -0500

lichanghong gravatar image

updated 2019-07-08 04:53:20 -0500

I start a pipeline with sqlserver cdc as origin. It run smoothly before last Friday。But Today when I check the pipeline , I found the oom error。then I checked the log,it shows java heap OOM error。 after dumping the hprof file, I find the largest Object is com.microsoft.sqlserver.jdbc.TDSPacket. One instance of "com.microsoft.sqlserver.jdbc.TDSPacket" loaded by "com.streamsets.pipeline.SDCClassLoader @ 0x637d8d810" occupies 8,191,982,208 (97.76%) bytes. Finally I reboot the streamset process,and reRun the sqlserver cdc pipeline 。After a while , a few sql query later, the oom error show again. check the hprof file again , the biggest memory occupier is still com.microsoft.sqlserver.jdbc.TDSPacket . Can anyone tell me why this happen and how should I tackle this problem.

edit retag flag offensive close merge delete