Hive Streaming Support with Parquet File Format
From Kafka we wanted to write the data into HDFS as Parquet File Format which is mapped to a Hive Table. To avoid small file issues using Hive Streaming is an Option. However it supports only ORC File Format (this is not a StreamSets limitation, indeed it is a Hive Streaming limitation).
Kafka has HDFS Sink Connector to achieve this. Do we have similar options in StreamSets to achieve this?