Ask Your Question
3

How do I enable a hidden conf object if I really want to?

asked 2017-05-09 09:36:09 -0600

devaudio gravatar image

Let's say, for example, I have compressed gzip rabbit data (application/gzip encoded) and I want to have that work in streamsets? How would I accomplish that?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2017-05-09 09:41:02 -0600

devaudio gravatar image

updated 2017-05-19 09:52:56 -0600

LC gravatar image

I'm glad you asked, you handsome devil, you.

It's really quite simple -- in this example I am specifically enabling it for 2.5.0 version of Data Collector -- change values/files edited as needed:

Grab The Code:

  1. git clone http://github.com/streamsets/datacollector-plugin-api
  2. git clone http://github.com/streamsets/datacollector-api
  3. git clone https://github.com/streamsets/datacollector

Build Maven Artifacts needed:

  1. cd datacollector-api/
  2. mvn clean install -DskipTests
  3. cd ../datacollector-plugin-api/
  4. mvn clean install -DskipTests

Comment out the @HiddenConf Variable (in this example, in RabbitDSource.java)

  1. cd ../datacollector
  2. git checkout -b remotes/origin/2.5
  3. vim rabbitmq-lib/src/main/java/com/streamsets/pipeline/stage/origin/rabbitmq/RabbitDSource.java

Build Data Collector (I don't always build releases, but when I do, I use -DskipTests)

  1. mvn package -Drelease -DskipTests

copy the resulting jar you want out to production, restart, and you are good to go with your hidden (and unsupported) options now available

edit flag offensive delete link more

Comments

Sounds like this shouldn't actually be hidden. Is there a JIRA to unhide this?

adam gravatar imageadam ( 2017-05-10 10:36:27 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2017-05-09 09:36:09 -0600

Seen: 65 times

Last updated: May 19 '17