Patent ID: 8677375

Claim:
A non-transitory computer readable medium including code that when executed by a computer system performs a method of selecting application requests that are executing to preempt, the method comprising: determining whether an application is in an overload condition; in response to determining the application is in an overload condition, identifying each request that is being executed by the application; determining a value for each request that is executing, wherein determining the value comprises calculating a utility measure, calculating an amount of executing time, and estimating a probability distribution of a residual lifetime for each request; utilizing the probability distribution for estimating a utility per unit consumed by each request and utilizing the probability distribution for estimating a mean utility per additional resource consumed, wherein the mean utility per additional resource consumed includes a quantity of financial resource per additional resource consumed; determining a mean utility per resource consumed to complete the request based on the probability distribution as the value; and selecting executing requests to preempt based on the values for the requests.