Ask Your Question

MySQL BinLog Stage Library install manually

asked 2019-01-08 11:00:07 -0500

khorevr gravatar image

updated 2019-01-09 23:50:38 -0500

Maithri gravatar image

Running StreamSets data collector on Docker, Windows. No internet connection is available on the machine. How to install "MySQL BinLog" Stage Library manually, without Package Manager?

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted

answered 2019-01-09 08:29:42 -0500

khorevr gravatar image

Thanks to metadaddy, I can confirm that the way he suggested is working.

  1. Download the tgz and put it to some directory on windows, temp123 in my case.
  2. Run docker with mapping directories by

    docker run --restart on-failure -p 18630:18630 -d -v c:/temp123:/tmp --name streamsets-dc streamsets/datacollector dc

    get the docker GUID (XYZdockerID)

  3. go to the command line by running

    docker exec -u 0 -it XYZdockerID /bin/sh

  4. unzip the tgz to /opt/ by running

    tar -xvf /tmp/streamsets-datacollector-mysql-binlog-lib-3.6.1.tgz -C /opt/

  5. see the MySQL Binary Log in the Package manager list. Don't forget install java JDBC driver for it.

edit flag offensive delete link more

answered 2019-01-08 11:12:22 -0500

metadaddy gravatar image

updated 2019-01-08 11:16:49 -0500

You can download the stage library tar file from (change the version numbers as necessary), and then manually extract it to the StreamSets runtime directory ($SDC_DIST). The archive is structured so that the jar files will go in $SDC_DIST/streamsets-libs/streamsets-datacollector-mysql-binlog-lib/lib.

edit flag offensive delete link more


I downloaded the tgz and extracted it to the /etc/sdc/ The path created as following: /etc/sdc/streamsets-libs/streamsets-datacollector-mysql-binlog-lib/lib and the jars are inside. Restarted the Data Collector. Unfortunately the MySQL BinLog Stage Library doesn't appear in the Package Manager List.

khorevr gravatar imagekhorevr ( 2019-01-09 04:54:00 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-01-08 10:59:31 -0500

Seen: 467 times

Last updated: Jan 09 '19