Ask Your Question

How to change preview mode batch size?

asked 2018-02-02 13:13:58 -0600

lampshadesdrifter gravatar image

How can the pipeline preview batch size be increased beyond size=10 (would like to use for debugging malformed data)? Looking at the docs, they say that the batch size in the web UI cannot go beyond the "data collector preview batch size" (10 by default). Yet, looking in $SDC_DIST, I can't find any sort of conf file that would have this property (not even Would appreciate if anyone could give me some more info on this. Thanks.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-02-02 13:58:02 -0600

jeff gravatar image

Look for the preview.maxBatchSize line in your file.

edit flag offensive delete link more


As a related note to self, is located in "/etc/sdc/" (rather than in the $SDC_DIST/libexec directory as I had expected).

lampshadesdrifter gravatar imagelampshadesdrifter ( 2018-02-05 18:36:27 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-02-02 13:13:58 -0600

Seen: 330 times

Last updated: Feb 02 '18