Patent ID: 9614782
Date: 2017-04-04
CPC Classifications: H04L

Claim:
1. A method performed by a computing system, comprising: executing multiple pools of servers in a distributed computing system, the pools of servers including: a first pool of servers executing multiple instances of a first version of an application, and a second pool of servers executing multiple instances of a second version of the application; determining that the first pool is in a positive state and the second pool is in a negative state as a function of a load of servers in the corresponding pool; predicting a response latency of the first pool of servers if the load of servers in the first pool is increased by a specified percentage above a current load of servers, wherein the predicting the response latency includes: progressively increasing a load of the first pool of servers in a number of increments to generate multiple response latency values corresponding to the increments, the load increased until one of the multiple response latency values exceeds a specified threshold, selecting a specified response latency value from the multiple response latency values that are below the specified threshold, identifying the specified percentage above the current load to which the specified response latency value corresponds, and determining a specified number of servers to be moved from the first pool to the second pool, wherein the specified number is determined as a particular percentage of a total number of servers in the first pool, wherein the particular percentage is determined as a mathematical approximation of the specified percentage; and moving the specified number of servers from the first pool to the second pool, wherein the moving causes the second pool to switch to a positive state.