HIVE Metadata into JSON

asked 2020-03-20 14:22:19 -0500

avdsa gravatar image

Is it possible to easily extract the metadata from the HIVE Metastore into JSON format?

I am looking at using the Einstein Analytics destination, and the Impala table I am sending over successfully sends the data, but the destination requires I send the metadata in JSON manually for each object. Is there a way to build a pipeline that extracts the Hive metadata and dumps it into the Einstein Analytics JSON field?

Thanks for any and all help you can provide.

edit retag flag offensive close merge delete

Comments

Could you elaborate on what Hive metadata you need?

metadaddy gravatar imagemetadaddy ( 2020-03-24 12:37:59 -0500 )edit

I need to loop through the table to extract the field names and datatypes to populate the JSON structure Einstein requires for uploading a custom metadata file. Some of the objects I am sending over have 1000's of fields, so going through manually just isn't feasible.

avdsa gravatar imageavdsa ( 2020-04-02 07:37:53 -0500 )edit