JDBC Producer Dynamic Table Name

asked 2020-07-29 04:35:23 -0500

Manish N gravatar image

I am trying to setup a pipeline with MySQL Binlog as Origin and JDBC Producer as destination. I want to setup pipeline for one MySQL instance to the other MySQL instance.

However, JDBC Producer expects each table name to be specified explicitly and I have hundreds of tables How can I specify table name dynamically in JDBC Producer destination for MySQL db ?.

I noticed in below given link that if origin is Oracle, it is possible to pass table name dynamically by specifying ${str:toLower(record:attribute('oracle.cdc.table'))} , however what should be given for MySQL Binlog Origin ?


edit retag flag offensive close merge delete


So in the MySQL Binary Log Origin documentation (link below) there is a screenshot of the generated record, it looks like the record attribute might just be 'Table'. https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MySQLBinaryLog.html#concept_rfd_15l_d

KateF gravatar imageKateF ( 2020-08-14 09:10:42 -0500 )edit