Ask Your Question
0

HADOOPFS_13 - Error while writing to HDFS: java.lang.IllegalArgumentException: Cannot convert List to com.streamsets.pipeline.api.impl.StringTypeSupport

asked 2018-02-26 23:24:36 -0500

rthebest gravatar image

Hello, my pipeline looks like this as I'm ingesting an XML file. image description

When I preview it, all is fine, but when I go to run it I get this error: Pipeline Status: RUNNING_ERROR: com.streamsets.pipeline.api.StageException: HADOOPFS_13 - Error while writing to HDFS: java.lang.IllegalArgumentException: Cannot convert List to com.streamsets.pipeline.api.impl.StringTypeSupport@

Any ideas on how to fix this?

Thanks!

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
0

answered 2019-03-03 12:49:30 -0500

Same issue here with stream that processes CSV file inbound > Encryption > Outbound CSV. Hangs on the outbound file write part of the process.

Changing file types defeats the purpose of having a stream so not a useful option for me.

Running under docker for windows streamsets 3.8.0-latest from dockerhub

edit flag offensive delete link more

Comments

Hi FlowTracker, Have you tried to use the "Field Order" component just before the destination? Due to the format in CSV it might help you create the list-map/map you need to write without error

MarcoM gravatar imageMarcoM ( 2019-04-19 05:09:00 -0500 )edit
0

answered 2018-10-17 08:09:09 -0500

MarcoM gravatar image

updated 2018-10-17 08:09:51 -0500

The problem seems to be the final type of the file you want to save. To me, it happend when i parse a JSON and I wanted to save as AVRO. Didn't work, same error as you. I saved as JSON multiple object and everything was fine.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-02-26 23:24:36 -0500

Seen: 459 times

Last updated: Oct 17 '18