Remote dynamic configuration of a web server to facilitate capacity on demand

The present invention relates to a method and system for the remote and dynamic configuration of a webserver to facilitate capacity on demand. The present invention provides a solution to the problem of the management and administration of one or more servers within an environment such as a server farm with regards to the rigid infrastructure and architecture of the servers due to the definition of roles the servers play in relation to the data the servers are publishing. A solution is provided in the form of autonomic modular computing components to allow a server to process a URL and the server to associate it with a remote data source without the need for a restart or manual intervention of the server and to allow the introduction of new services and or hardware resources by collating and analyzing performance data collected from the server to determine if the server is over or under utilized.

FIELD OF THE INVENTION

The invention relates to the field of network services and in particular to the remote and dynamic configuration of a server to facilitate capacity on demand.

BACKGROUND OF THE INVENTION

Many companies offer hosting services to provide customers with a secure, robust and flexible infrastructure in which to host a variety of applications for example web applications such as on-line banking, on-line shopping, information services and hosting service such as ‘pay for used capacity’ which, enable a customer to only pay for the processing power that they use and allows the customer to deploy the most up-to-date equipment in a cost effective manner. Hosting services provide many businesses with an alternative solution to building and running their technology infrastructure in-house by tapping into computer systems in other company's data centers to provide the management of software applications and hardware resources such as servers. The management and administration of these servers and services provide a tremendous challenge to many hosting companies, as a key problem with the management and administration of the servers within an environment such as a server farm is the rigid infrastructure and architecture of the servers due to the definition of roles the servers play in relation to the data the servers are publishing.

The rigid allocation of a resource to for example, a web server which supports a particular customer's product can result in an under utilized yet expensive web server resource not being used to it's full capability, while other web servers supporting other products are stretched to the point of breaking. Further today's current state of the art web server software is complex and flexible and can be configured and extended through Application Protocol Interfaces (API) to facilitate powerful processing beyond the standard serving of basic Hypertext Markup Language (HTML) pages. However current deployment practices and technologies require that the web servers are configured manually using either configuration files or binary registries and thus remain static during their operation, handling requests for a specific website or websites. When an additional or a different resource for a particular HTML page or a different web site URL needs publishing or a need arises for a new server to be added to, or removed from a server pool, the servers must be restarted for any change to take effect. This requires a tremendous administration effort on the part of the server farm administrator because it takes a considerable amount of time to manually configure a server and it is not always convenient to shut down a server and restart the server to allow for any changes to take effect as this can cause loss of service for a period of time.

US patent application publication US 2002/0002602 (2602) describes a system for serving web pages to a client in response to a client request specifying a resource that aims to serve a web page in a coordinated fashion from multiple cooperating web servers and maintaining a reliable connection so that the server and clients remain synchronized and information is not lost. In order for the above to take place such that a web server processes a URL and associates the URL with a data source, the web server will require manual intervention and the web server will have to be shut down and restarted for the changes to take effect.

DISCLOSURE OF THE INVENTION

In accordance with the present invention there is now provided a method for the remote and dynamic configuration of a server to facilitate capacity on demand comprising the steps of: (a) a client device requesting a resource from a first server in a communications network; (b) the first server receiving the request for the resource from the client device; (c) the first server routing the client request for the resource to a dynamic content module, the dynamic content module identifying an available third server from which the requested resource can be served and routing the requested resource to the client device; (d) collating performance data from the first and third server and the first server reporting the performance data to a second server; (e) a second server analysing the performance data collated in step (d) to determine performance capabilities of the first and the third server and identifying if the first or the third server has reached a predetermined threshold; and (f) the second server adjusting the allocation of the first server or the third server in response to step (e) and issuing a configuration update instruction for the first server or the third server to a dynamic configuration module of the first server and determining if a resource update is successful.

The present invention advantageously allows for the optimisation of a servers performance such that a server can be allocated or deallocated from a server pool depending on the server's performance for example if a server is stretched to capacity or equally if a server is under utilised. Further using modular autonomic computing components the system is able to configure and reconfigure itself under varying and unpredictable conditions. Further the method allows for making a change to a hardware resource or a data resource without the need for the server to be restarted as with other prior art systems.

Preferably the invention provides for the dynamic content module requesting a connection configuration file for the third server from the dynamic configuration module. This allows for the first server to determine which data source server has the resource requested by the client.

Preferably the invention provides for the adjusting of the allocation or deallocation of one or both the first server and the third server from a free server pool or to a free server resource pool. The present invention can therefore monitor a servers performance and either add an additional resource or de-allocate a resource depending on the work load of the server.

Preferably the invention provides for the requested resource being decoupled from the first server allowing the introduction of a new service or the removal of a redundant service.

Viewed from another aspect the present invention provides a system for the remote and dynamic configuration of a server to facilitate capacity on demand, the system comprising a client device for requesting and receiving a resource in a communications network, the system further comprising:

a first server, the first server comprising a dynamic content module, a dynamic configuration module and a reporting module; means for routing the client request for the resource to the dynamic content module; means for the dynamic content module identifying a third server from which the requested resource can be served and means for retrieving a connection configuration file associated with the third server stored in the dynamic configuration module; means for the reporting module collating performance data from the first server and the third server and means for routing the performance data to a second server;
a second server comprising an analyser module, a resource allocation module and a resource update module, the second server sending the performance data to the analyser module; means for the analyser module determining the performance capabilities of the first server and the third server and means for identifying if the first server and third server has reached a predetermined threshold; means for the resource allocation module adjusting the allocation of one or both the first server and the third server in response to the identifying means; means for the resource update module issuing an configuration update instruction for one or both the first server and the third server to the dynamic configuration module of the first server and means for determining if a resource update is successful; and a third server comprising one or more resources and means for the third server to serve a requested resource to the first server.

A another advantage is that an HTTP URL can be processed by a server and associated with a remote data source without the need for the server to be restarted or requiring manual intervention. A further advantage of the present invention is the secure and centralised administration for the dynamic plug and play of data sources and hardware resources such that a web site can be served ‘on the fly’. Another advantage of the present invention is for the provision of multiple protocol support for other mechanisms such as FTP, XML, SOAP and file sharing.

A computer program product comprising computer program code stored on a computer readable storage medium, which when executed on a data processing system, instructs the data processing system to carry out the following method: A method for the remote and dynamic configuration of a server to facilitate capacity on demand comprising the steps of:

(a) a client device requesting a resource from a first server in a communications network;

(b) the first server receiving the request for the resource from the client device;

(c) the first server routing the client request for the resource to a dynamic content module, the dynamic content module identifying an available third server from which the requested resource can be served and routing the requested resource to the client device;
(d) collating performance data from the first and third server and the first server reporting the performance data to a second server;
(e) a second server analysing the performance data collated in step (d) to determine performance capabilities of the first and the third server and identifying if the first or the third server has reached a predetermined threshold; and
(f) the second server adjusting the allocation of the first server or the third server in response to step (e) and issuing a configuration update instruction for the first server or the third server to a dynamic configuration module of the first server and determining if a resource update is successful.

FIG. 1illustrates a server farm in which the present invention may be implemented. The server farm includes a plurality of client devices100and105which are connected to a network such as the Internet110. The client devices100and105perform transactions by sending and receiving requests for a resource over the network110. Routers115and120provide a connection between the network110and the local area network (LAN)125which could be a high speed Ethernet network or any other suitable transmission medium or topology. The routers115and120receive an incoming request and forward the request over a network135to a router/firewall130which filters the request to a server145to155. The present invention embodies a management server140for the central control point for servers145to155. Management server140includes a CPU231, operating system232, RAM233and storage234, Server145includes a CPU331, operating system332, RAM333, and storage334. The servers140to155may implement one or more server technologies including, for example UNIX which is a registered trademark of The Open Group in the United States and other countries, Novell which is a registered trademark of Novell Inc in the United States and other countries, or Windows NT which is a registered trademark of Microsoft Corporation in the United States and other countries or both, and/or a peer to peer networking arrangement. Although the present invention has been described with reference to a server farm, the present invention could equally be applicable to pervasive computing environments as well as other server networking arrangements.

Application data is stored in a data store in one or more data source servers175and180which are separate from the servers140to155. A request is sent from any one of the servers145to155across a network160. The request is received by a router/firewall165and routed over a further network170to the appropriate data source server175and180storing the resource that was requested by one or more client devices100and105.

Referring toFIG. 2, a schematic view of the system is shown. The system comprises modular autonomic computing components to provide self diagnostic capabilities to detect performance issues with servers145to155. Further by using modular components the system is able to provide the ‘plug and play’ of data sources for the easy introduction of new services.

The system comprises a server145with a reporting module205for collating performance and request data from each server145to155in an allocated server pool; a dynamic content module215which routes the request for a resource through the most appropriate interface to access a requested resource either using the native data access capability of the server145to155or by establishing and managing the connection to a remote server itself; a dynamic configuration module216for the update, processing and storing of a configuration file for each server in the allocated server pool and a client device100for requesting a resource from the server. The configuration file is used to hold the configuration settings for a particular server145to155for example a registration key, port settings, an installation path, authentication settings, user settings, SMPT settings, connection settings, web browser settings and log in settings.

The system further comprises a management server140for providing a central control point for all servers in an available server pool; an analyser module230for analysing the performance and request data from the reporting module205; a resource allocation module235to determine whether there is a free resource in the free server resource pool to be added to the pool of allocated servers or if necessary to deallocate a server and place it back in the free server resource pool; a resource update module240for determining whether a resource has been successfully allocated or deallocated to or from the available resource pool and a management client245for the entry of manual configuration tasks into the system. The management client245can receive administration requests from a server administrator. The management client functions as a graphical user interface and provides greater flexibility in terms of providing connectivity to the management server for example providing connectivity remotely in another site via the Internet using a standard HTTP connection between the servers145to155and the management server140. To enable only authorised administrators to make configuration changes, an interface may be provided to a security directory for handling authentication and entitlement requests (not shown in the figures).

Data streams220and225are sent to and from the server145to155and the management server140using an Extensible Markup Language (XML) as the transport mechanism220and225over an HTTP session. XML is the universal format for structured documents and data on the Web. XML uses tags similar to HTML, and allows data to be structured in a manner that is understood by many people. Further information on XML can be found at the World Wide Web Consortium.

The client device100sends a request for a specific resource to the server145. One such request that may be received by a server145to150is a HTTP URL for example http://www.ibm.com requesting an HTML page. To allow the server to translate the HTTP URL, the server will use a Domain Name Service (DNS) which translates Internet domain names to network addresses such as 129.42.19.99. The resource could be a standard HTML page or an .exe file. The server145receives the request for the resource from the client device100and105and the request is sent to the dynamic content module215.

AlthoughFIG. 2illustrates a management server140and a server145, it should be appreciated that the system may comprise a plurality of servers145to155as shown inFIG. 1, each server containing the modules as shown inFIG. 2.

The operation of the dynamic content module215will now be explained with reference toFIG. 3. It should be noted that the dotted line inFIG. 3represents data flow and the solid single line represents control flow. The dynamic content module215receives the request for a resource from the client device at step300and compares the content stored on the server145with the requested resource at step305. For example if a client requested a resource from www.ibm.com/news/today.html, the dynamic content module compares the today.html page stored on the server with the today.html page stored on a source server to determine if the today.html page has been updated therefore, sending the client device the most up to date today.html page. At step310the server determines whether the content has been cached and if the cached content is current and up to date at step360. If the cache is current control flows to step355and the requested resource is retrieved from the content cache store350, equally if the content is not cached, the server which contains the requested resource is identified at step315. Further at step355information concerning the server's145activities is sent to the reporting module205. The information can include data such as the number of requests for each resource such as a product, the time it takes the server to respond or the type of service requested such as HTTP or File Transfer Protocol (FTP).

To enable the server145to identify the data source server175the server retrieves the connection configuration file for the source server at step325from a connection configuration store320. Preprocessing is performed on the content request at step330. At step335a request is issued to the data source server175and at step340the server145receives the content as requested by the client device300from the source server. The retrieved content is either stored in the content cache data store350or the existing content is refreshed with the retrieved content at step345and stored in the content cache data store350.

Referring back to step355, information regarding the resource requested from the client device100at step300along with performance information is sent to the reporting module210. With reference toFIG. 4the reporting module205receives the content information from the dynamic content module215and records the information at step400. These details are stored in a server statistics data store at step405and the server statistics (response times, number of pages requested, how many times, what pages, which server, server config details and performance data) associated with each server145to155are sent to the management server140at step410via an XML data streams220.

Referring toFIG. 5, the analyser module230of the management server140receives the server statistics in the XML data streams220and at step500the analyser module230analyses the server statistics to determine whether the server145to155has reached a predetermined threshold at step505, if the server's performance has not reached the predetermined threshold control flows back to step500, else control flows to step510and the analyser module230analyses the server's current configuration settings and the server's configuration settings are sent to the resource allocation module235.

Referring toFIG. 6at step600, the resource allocation module235determines whether a new server should be added to a current pool of allocated severs145to155if the performance threshold has been exceeded or if a server should be removed from the current pool of allocated servers and returned to the free resource pool. If the analyser module230determines that an additional server is to be added, control flows to step605and the resource allocation module identifies whether there exists a spare resource at step610. A spare resource could be for example an additional server or equally some other hardware resource. If a spare resource can not be located control flows to step630and at step635an exception error is created and displayed in the management console245to alert a technician that the resource update has failed at step635. Referring back to step610if a spare resource has been located control flows to step615and a new server is selected and information regarding the server's configuration settings file is requested from the configuration database615of the particular server140to155. At step620once the configuration setting file has been received, the configuration setting file is updated with the current instruction for the selected server and sent to the resource update module240and the dynamic configuration module216via XML data streams225.

Referring toFIG. 7, at step700the configuration update information is issued to the dynamic configuration module216of the server145via XML data streams225. The resource update module240waits for acknowledgment from the server145at step710. If a configuration update is successful at step715control flows to step720and the configuration database730is updated. Referring back to step720if the acknowledgment from the server145is successful control also passes to step735and a configuration update request for a load balancing infrastructure is requested. Equally if at step720the update is not successful control flows to step745and an exception handling alert is generated and the resource update is deemed to have failed at step750.