How to configure Mysql to HDFS data flow? I have streamsets on digital ocean, mysql on different azure VM and HDFS on different Azure VM?

asked 2017-12-27 02:49:38 -0600

ImPranjalk

111 ●4 ●11 ●13 http://www.seedolabs.com/

I have to configure and and ingest data from Mysql DB to HDFS.

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2018-01-04 12:58:33 -0600

iwrigley
221 ●3 ●5 http://streamsets.com/

You can pull from MySQL using the JDBC Query Consumer origin or the MySQL-specific MySQL Binary Log origin. You can write to HDFS using the Hadoop FS destination. Full documentation is at https://streamsets.com/documentation/...

edit flag offensive delete link

add a comment

Question Tools

1 follower

Stats

Asked: 2017-12-27 02:49:38 -0600

Seen: 142 times

Last updated: Jan 04 '18

here is how

How to configure Mysql to HDFS data flow? I have streamsets on digital ocean, mysql on different azure VM and HDFS on different Azure VM? edit

1 Answer

Question Tools

Stats

How to configure Mysql to HDFS data flow? I have streamsets on digital ocean, mysql on different azure VM and HDFS on different Azure VM?