about resource allocation for 2 same structure pipelines

asked 2018-10-23 08:41:14 -0600

Dean Han gravatar image

updated 2018-10-23 08:44:51 -0600

Hey Expert, Please see this situation: I have two pipelines with same structure, ideally or as I thought, they should spend same time to process about 500 k records, total 1M records. But I found, after I started these 2 pipepiles at the same time, one of them ran very fast, but another one ran very slow, so I want to know if these 2 pipelines get different resource allocation? or they have a diff priortiy to process? Or, with enough max resource(cpu,mem,etc) , this situation would disapprear? Please answer. thanks.


edit retag flag offensive close merge delete