Patent ID: 9733983
Date: 2017-08-15
CPC Classifications: G06F,H04L

Claim:
1. A system for use in a networked computing environment which includes a traffic director component, comprising: a first physical node having a microprocessor and a computer memory; a traffic director operating on the first physical node, and comprising having at least one active traffic director server instance; a collection of resource servers, wherein each resource server operates on at least one physical resource node, wherein the at least one physical resource node and the first physical node are separate nodes, and wherein the at least one physical resource node and first physical node are connected via the networked computing environment; a configuration which defines an origin-server pool, wherein the defined origin-server pool includes a plurality of resource servers from the collection of resource servers, wherein each of the included plurality of resource servers host the same application or service, and wherein the configuration includes, for each of the included plurality of resource servers, a specified maximum number of network connections and a specified ramp-up time; a traffic monitor at the traffic director, which monitors traffic, including a number of current network connections between the at least one active traffic director server instance and each resource server in the defined origin-server pool, wherein the current network connections serve client requests through, and received by, the at least one active traffic director server instance; and wherein the traffic monitor is configured to determine the availability of a particular resource server of the plurality of resource servers, the particular resource server being previously unavailable to receive current network connections from the at least one traffic director server instance; and wherein the at least one active traffic director server instance is configured to use information provided by the traffic monitor, including the number of current network connections between the at least one active traffic director and the particular resource server, to: wait to open new current network connections with the particular resource server until after the passing of a specified delay time: after the passing of the specified delay time, gradually increase the number of current network connections to the particular resource server over the ramp-up time that is specified for the particular resource server in the configuration; and increase the number of current network connections to the particular resource server up to the maximum number of network connections that is specified for the particular resource server in the configuration, at which point client request traffic is temporarily direct away from the particular resource server and directed to a connection queue.