Ask Your Question
0

Streamsets pipeline Error while writing Data in Hadoop

asked 2018-09-12 15:16:21 -0600

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

I implemented one of the pipeline that communicate Streamsets with Hadoop servers , it throwing below exception

Pipeline Status: RUNNING_ERROR: com.streamsets.pipeline.api.StageException: HADOOPFS_13 - Error while writing to HDFS: com.streamsets.pipeline.api.StageException: HADOOPFS_14 - Cannot write record: java.io.IOException: Failed on local exception: java.io.IOException: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "server1"; destination host is: "server2":9000;

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
3

answered 2018-09-13 11:19:21 -0600

Maithri gravatar image

updated 2018-09-13 23:04:07 -0600

1) Try changing the stage library versions for hadoop

2) Check if the port number is 8020

edit flag offensive delete link more

Comments

Thank you very much now it is working fine there is problem of hdfs URI port number

dastagiri gravatar imagedastagiri ( 2018-09-14 05:13:46 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-09-12 15:16:21 -0600

Seen: 95 times

Last updated: Sep 14