Patent ID: 8869149

Claim:
A system for identifying a maximum concurrency level of a first processing stage of a plurality of processing stages in a distributed system, comprising: an interface unit configured to receive measurement data indicating a starting time and an ending time of the first processing stage for each of a plurality of job requests; a concurrency determination unit comprising a processor and a memory and configured to sort the measurement data in an increasing arrival time order; and a concurrency determination database configured to store the sorted measurement data, wherein the concurrency determination unit is further configured to initialize an observed concurrency level and the maximum concurrency level of the first processing stage to zero, traverse the sorted measurement data beginning with a first portion of the measurement data having an earliest starting time, increase the observed concurrency level upon determining that a current portion of the measurement data indicates a starting time of the first processing stage for one or more of the job requests, decrease the observed concurrency level upon determining that the current portion of the measurement data indicates an ending time of the first processing stage for one or more of the job requests, and increase the maximum concurrency level if the observed concurrency level was increased, wherein the interface unit is further configured to output the maximum concurrency level of the first processing stage for the plurality of job requests upon determining that the current portion of the measurement data indicates a last portion of the measurement data having the latest ending time, wherein the maximum concurrency level of a processing stage refers to a maximum number of job requests that the system can process at that stage at the same time.