Ask Your Question
0

HIVE_30 - Invalid column name

asked 2020-03-13 04:41:51 -0500

Venkat gravatar image

updated 2020-03-13 13:40:07 -0500

metadaddy gravatar image

Hi, I am trying to load zip file to hive database using streamsets pipeline getting the below error.

Error:
com.streamsets.pipeline.api.base.OnRecordErrorException: HIVE_30 - Invalid column name remarks stress
    at com.streamsets.pipeline.stage.processor.hive.HiveMetadataProcessor.process(HiveMetadataProcessor.java:594)
    at com.streamsets.pipeline.api.base.RecordProcessor.process(RecordProcessor.java:52)

Configured compressed format = archive and with header line

I found the issue is source csv file column having spaces between

Ex : Strem sets

please suggest how to add "_" instead of spaces from the source column.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2020-03-13 13:43:42 -0500

metadaddy gravatar image

You can use Field Mapper to rename the field:

image description

edit flag offensive delete link more

Comments

this is working fine but order of the columns are changing while creating table into hive db with this expression. ex: Source Target Stream Sets hive hive Stream_sets Also pls suggest how to remove if any special characters are included in this series. Ex: Stream sets#

Venkat gravatar imageVenkat ( 2020-03-16 04:19:47 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2020-03-13 04:41:51 -0500

Seen: 29 times

Last updated: Mar 13