Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

xml to hive processing

Hi, I am new to streamsets and trying to process xml file to hive table. The pipeline is failing because of list data types. I cannot convert list to string using field type converter. is there any way i can process xml.

Source : xml file (configuration - reading in xml data format) Target: Hive table

Let me know if you need any other info.

Thanks

xml to hive processing

Hi, I am new to streamsets and trying to process xml file to hive table. The pipeline is failing because of list data types. I cannot convert list to string using field type converter. is there any way i can process xml.

Source : xml file (configuration - reading in xml data format) Target: Hive tabletable <root version="3.0"> <header> <company>TEST COMPANY</company> <sendername>TEST SENDER</sendername> <senderphone>222-333-4444</senderphone> </header> <a1 action="A" id="1234567"> <account id="1234"/> <subaccount id="123"/> <qty>20</qty> <type id="10456"/> <post id="1"/> <num> </a1> <a1 action="A" id="23456789"> <account id="141004"/> <subaccount id="20"/> <qty>30</qty> <type id="10456"/> <pos id="1"/> <num> </a1> <footer> <recordcount>2</recordcount> </footer> </root>

Let me know if you need any other info.

Thanks