Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

average record throughput

HI,

Brand new to Streamsets. Trying to figure out how to get the average total record throughput from end to end.

I have a pipeline and I'm feeding in a very large amount of data into it. I'd like to see one number that tells me the average number of records being processed per second through the entire pipeline.

I've gone to the RestAPI>manager>metrics and I retrieve the metrics stats json object, but I don't know what to look at to get this number I want.

Also when I look at the metrics dashboard it is unclear to me if I can deduce this number from the charts there.

Any help appreciated!

Thanks