Multiple Hadoop FS Destinations in Hive Drift Sync?

asked 2020-10-10 11:25:21 -0500

erik gravatar image

Using the Hive Drift Sync solution, is there a way to connect a second Hadoop FS destination to the data output stream of the Hive Metadata processor? I would like to write/copy data to a second HDFS directory as Avro files. I am running into an AVRO_GENERATOR error due to a schema conflict at the moment with this strategy. Again the goal is to simply copy or duplicate the output Avro files into a second directory, quickly and securely.

edit retag flag offensive close merge delete