average record throughput

asked 2020-08-27 09:59:58 -0500

AntGo gravatar image

HI,

Brand new to Streamsets. Trying to figure out how to get the average total record throughput from end to end.

I have a pipeline and I'm feeding in a very large amount of data into it. I'd like to see one number that tells me the average number of records being processed per second through the entire pipeline.

I've gone to the RestAPI>manager>metrics and I retrieve the metrics stats json object, but I don't know what to look at to get this number I want.

Also when I look at the metrics dashboard it is unclear to me if I can deduce this number from the charts there.

Any help appreciated!

Thanks

edit retag flag offensive close merge delete