IOException reading from Oracle, writing to Postgres

asked 2018-06-29 00:12:18 -0500

xiaoxu gravatar image

updated 2018-07-01 22:01:47 -0500

metadaddy gravatar image

pg An I/O error occured while sending to the backend. Cause: java.io.IOException: Stream closedimage description

Exception: JDBC_14 - Error processing batch.
SQLState: 08006
Error Code: 0
Message: An I/O error occured while sending to the backend.
Cause: java.io.IOException: Stream closed

com.streamsets.pipeline.api.StageException: JDBC_14 - Error processing batch.
SQLState: 08006
Error Code: 0
Message: An I/O error occured while sending to the backend.
Cause: java.io.IOException: Stream closed

        at com.streamsets.pipeline.lib.jdbc.JdbcBaseRecordWriter.handleSqlException(JdbcBaseRecordWriter.java:582)
        at com.streamsets.pipeline.lib.jdbc.JdbcMultiRowRecordWriter.write(JdbcMultiRowRecordWriter.java:202)
        at com.streamsets.pipeline.lib.jdbc.JdbcMultiRowRecordWriter.writeBatch(JdbcMultiRowRecordWriter.java:133)
        at com.streamsets.pipeline.lib.jdbc.JdbcUtil.write(JdbcUtil.java:824)
        at com.streamsets.pipeline.stage.destination.jdbc.JdbcTarget.write(JdbcTarget.java:208)
        at com.streamsets.pipeline.api.base.configurablestage.DTarget.write(DTarget.java:34)
        at com.streamsets.datacollector.runner.StageRuntime.lambda$execute$2(StageRuntime.java:249)
        at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:195)
        at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:257)
        at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:219)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:801)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.lambda$executeRunner$3(ProductionPipelineRunner.java:846)
        at com.streamsets.datacollector.runner.PipeRunner.executeBatch(PipeRunner.java:136)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.executeRunner(ProductionPipelineRunner.java:845)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runSourceLessBatch(ProductionPipelineRunner.java:823)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:563)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:383)
        at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:512)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:112)
        at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:74)
        at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:756)
        at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:152)
        at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226)
        at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33)
        at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222)
        at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:226)
        at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33)
        at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:222)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
edit retag flag offensive close merge delete

Comments

When do you get the exception -- Preview or Start/run mode?

iamontheinet gravatar imageiamontheinet ( 2018-06-29 09:17:48 -0500 )edit

Also, please post the full stack trace from sdc.log

metadaddy gravatar imagemetadaddy ( 2018-06-29 10:22:02 -0500 )edit

@metadaddy Please help you to see the following. Thank you

xiaoxu gravatar imagexiaoxu ( 2018-07-01 21:33:24 -0500 )edit