Ask Your Question
0

HADOOPFS_13 - Error while writing to HDFS: java.lang.IllegalArgumentException: Cannot convert List to com.streamsets.pipeline.api.impl.StringTypeSupport

asked 2018-02-26 23:24:36 -0500

rthebest gravatar image

Hello, my pipeline looks like this as I'm ingesting an XML file. image description

When I preview it, all is fine, but when I go to run it I get this error: Pipeline Status: RUNNING_ERROR: com.streamsets.pipeline.api.StageException: HADOOPFS_13 - Error while writing to HDFS: java.lang.IllegalArgumentException: Cannot convert List to com.streamsets.pipeline.api.impl.StringTypeSupport@

Any ideas on how to fix this?

Thanks!

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
0

answered 2019-03-03 12:49:30 -0500

Same issue here with stream that processes CSV file inbound > Encryption > Outbound CSV. Hangs on the outbound file write part of the process.

Changing file types defeats the purpose of having a stream so not a useful option for me.

Running under docker for windows streamsets 3.8.0-latest from dockerhub

edit flag offensive delete link more
0

answered 2018-10-17 08:09:09 -0500

MarcoM gravatar image

updated 2018-10-17 08:09:51 -0500

The problem seems to be the final type of the file you want to save. To me, it happend when i parse a JSON and I wanted to save as AVRO. Didn't work, same error as you. I saved as JSON multiple object and everything was fine.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-02-26 23:24:36 -0500

Seen: 411 times

Last updated: Oct 17 '18