Ask Your Question
0

How to change preview mode batch size?

asked 2018-02-02 13:13:58 -0500

lampshadesdrifter gravatar image

How can the pipeline preview batch size be increased beyond size=10 (would like to use for debugging malformed data)? Looking at the docs, they say that the batch size in the web UI cannot go beyond the "data collector preview batch size" (10 by default). Yet, looking in $SDC_DIST, I can't find any sort of conf file that would have this property (not even sdcd-env.sh). Would appreciate if anyone could give me some more info on this. Thanks.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-02-02 13:58:02 -0500

jeff gravatar image

Look for the preview.maxBatchSize line in your sdc.properties file.

edit flag offensive delete link more

Comments

As a related note to self, sdc.properties is located in "/etc/sdc/sdc.properties" (rather than in the $SDC_DIST/libexec directory as I had expected).

lampshadesdrifter gravatar imagelampshadesdrifter ( 2018-02-05 18:36:27 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-02-02 13:13:58 -0500

Seen: 39 times

Last updated: Feb 02