Ask Your Question
0

how to create pipeline load all CDC from multiple tables in a MySQL DB

asked 2018-09-18 08:38:10 -0500

ThuyLe gravatar image

hi all,

May you share how to create pipeline load all CDC from multiple tables of a DB and backup to other db in a MySQL ?

Many thanks

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-09-18 09:45:17 -0500

Maithri gravatar image

updated 2018-09-18 23:10:25 -0500

Use Mysql Binarylog origin for CDC . Specify all the required tables in this format db1_name.table1_name,db1_name.table2_name,db2_name.table1_name in the Advanced tab for specific tables. To fetch all the tables in a particular database you can specify db_name.%

edit flag offensive delete link more

Comments

hi Maithri, If I want to load all tables in database do you know any dynamic way to do it? Many thanks

ThuyLe gravatar imageThuyLe ( 2018-09-18 10:22:02 -0500 )edit

under Tables tab of mySQL binlog origin config, set Table Name Pattern to %.

todd gravatar imagetodd ( 2018-09-18 12:03:57 -0500 )edit

Hi all, after load all data from MySQL how we can import/insert/update automatic data to other MySQL database ?

ThuyLe gravatar imageThuyLe ( 2018-09-18 14:02:35 -0500 )edit

https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/JDBCProducer.html

ThuyLe gravatar imageThuyLe ( 2018-09-21 15:09:02 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-09-18 08:38:10 -0500

Seen: 58 times

Last updated: Sep 18