Ask Your Question
0

HTTP Client request logging

asked 2018-10-02 06:55:37 -0600

peter_f gravatar image

updated 2018-10-04 06:07:18 -0600

According to the documentation request logging can be enabled by defining the required granularity and payload type. You also have to adjust the log level of the datacollector to actually make the request logging work.

Is it possible to limit the datacollector part to just the HTTP Client? Generally raising the datacollector log level to debug to get request logging finer/finest just bloats everything up and makes it difficult to track down just request issues.

Tested with sdc 3.4.3

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
-1

answered 2018-10-02 10:01:51 -0600

jeff gravatar image

Yes, you certainly can. As indicated in the documentation, the name of that particular logger is com.streamsets.http.RequestLogger. You can set up a different threshold for just that logger using the steps outlined here.

edit flag offensive delete link more

Comments

Hi Jeff, I already did this and have consulted the docs and have read your post before I posted the question. I tried log4j.logger.com.streamsets.http.RequestLogger=DEBUG, but it was not working. I have to set log4j.logger.com.streamsets=DEBUG to get it working. best Peter

peter_f gravatar imagepeter_f ( 2018-10-02 10:20:34 -0600 )edit

If you want to paste your full log4j config, as well as the level you selected in the pipeline, I can take another look.

jeff gravatar imagejeff ( 2018-12-07 12:06:48 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-10-02 06:55:37 -0600

Seen: 35 times

Last updated: Oct 03