Ask Your Question
0

origin jdbc destination hive / data drift - datetime columns are string in hive.

asked 2018-08-28 11:57:23 -0500

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

Hello,

how can I ensure that the datetime data type will be propagated as datetime in hive???

Thank you

JM

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-08-28 13:11:45 -0500

iamontheinet gravatar image

updated 2018-08-30 12:28:06 -0500

Hi JM,

I've learned that the decision to store timestamps as strings was made based on the fact that Impala and Hive have/had different ways of interpreting timestamps. (Hence storing them as strings would make them compatible across both.) You may want to keep an eye on this open JIRA ticket -- https://issues.streamsets.com/browse/....

Cheers, Dash

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-08-28 11:57:23 -0500

Seen: 135 times

Last updated: Aug 30