Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

JDBC Multitable- Pipeline stall

Hello, I'm using JDBC Multitable origin in a pipeline to load tables from Postgres database to Hive in a dev environment. I had to restart the pipeline 4 times before Streamsets finished and didn’t stall during the process (pipeline stay in running status, input/output records not changing after loading 3 125 696 records). I checked the log, there is no error.

Does anyone see this issue before?

We need to figure out this issue, as this could really impact the production transfer. If it happens in production where we think the pipeline will take days to finish we could be attempting to run it for weeks before it finishes. This would greatly impact our timelines to have to keep restarting the full load pipeline.

streamsets version: 3.7.1 Regards, Torkia