Custom Solr Stage?

asked 2018-02-26 12:44:14 -0600

badcat914 gravatar image

Asked and unanswered on sdc-user (https://groups.google.com/a/streamset...).

Since the Solr stuff in Streamsets 2.7 - 3.1 does not work in a Kerberized environment (https://ask.streamsets.com/question/1...), I'm exploring a custom stage using Solr, maybe a processor stage that executes a Solr query).

Thus far, I am unable to query or update a Kerberized Solr collection in a Streamsets stage. Usually, all that is needed is for a JAAS.conf file to be available with the appropriate credentials in it. I keep getting the HTML "Authorization Required" error back from Solr.

Now I can see that the DataCollector has some sort of JAAS.conf available, because when you shut down the DataCollector, it prints the contents to the log....

Debug is true storeKey true useTicketCache false useKeyTab true doNotPrompt true ticketCache is null isInitiator true KeyTab is /var/run/cloudera-scm-agent/process/1767-streamsets-DATACOLLECTOR/streamsets.keytab refreshKrb5Config is true principal is sdc/---03..local@.LOCAL tryFirstPass is false useFirstPass is false storePass is false clearPass is false Refreshing Kerberos configuration principal is sdc/---03.*.local@.LOCAL Will use keytab Commit Succeeded

The only thing I see is when I examine the streamsets.keytab, is that the sdc principal is the only principal in there. The solr.keytab generated by Cloudera has the solr principal as well as the HTTP principal. Could that be causing the problem?

The krb5.conf file is in its usual place (/etc) and I've tried specifically assigning that path to the java.security.krb5.conf env variable...no dice.

Any clue on how to do this guys and gals?

edit retag flag offensive close merge delete