Ask Your Question

How do I enable a hidden conf object if I really want to?

asked 2017-05-09 09:36:09 -0500

devaudio gravatar image

Let's say, for example, I have compressed gzip rabbit data (application/gzip encoded) and I want to have that work in streamsets? How would I accomplish that?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2017-05-09 09:41:02 -0500

devaudio gravatar image

updated 2017-05-19 09:52:56 -0500

LC gravatar image

I'm glad you asked, you handsome devil, you.

It's really quite simple -- in this example I am specifically enabling it for 2.5.0 version of Data Collector -- change values/files edited as needed:

Grab The Code:

  1. git clone
  2. git clone
  3. git clone

Build Maven Artifacts needed:

  1. cd datacollector-api/
  2. mvn clean install -DskipTests
  3. cd ../datacollector-plugin-api/
  4. mvn clean install -DskipTests

Comment out the @HiddenConf Variable (in this example, in

  1. cd ../datacollector
  2. git checkout -b remotes/origin/2.5
  3. vim rabbitmq-lib/src/main/java/com/streamsets/pipeline/stage/origin/rabbitmq/

Build Data Collector (I don't always build releases, but when I do, I use -DskipTests)

  1. mvn package -Drelease -DskipTests

copy the resulting jar you want out to production, restart, and you are good to go with your hidden (and unsupported) options now available

edit flag offensive delete link more


Sounds like this shouldn't actually be hidden. Is there a JIRA to unhide this?

adam gravatar imageadam ( 2017-05-10 10:36:27 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-05-09 09:36:09 -0500

Seen: 254 times

Last updated: May 19 '17