Abstract:
A method and system for creating service instances in a computing grid. The method can include scheduling a service in the computing grid to process at least a portion of a requested transaction. At least one additional service related to the scheduled service can be identified, and a load condition can be assessed in the at least one additional service related to the scheduled service. A new instance of the at least one additional service can be created if the load condition exceeds a threshold load. In this way, an enhanced capacity for processing transactions can be established in the related services in advance of a predicted increase in load in the grid.

Description:
BACKGROUND OF THE INVENTION  
         [0001]    1. Statement of the Technical Field  
           [0002]    The present invention relates to the field of distributed computing, including Web services and Grid services, and more particularly to the anticipatory creation of distributed service instances through the operation of a grid mechanism.  
           [0003]    2. Description of the Related Art  
           [0004]    Web services represent the leading edge of distributed computing and are viewed as the foundation for developing a truly universal model for supporting the rapid development of component-based applications over the World Wide Web. Web services are known in the art to include a stack of emerging standards that describe a service-oriented, component-based application architecture. Specifically, Web services are loosely coupled, reusable software components that semantically encapsulate discrete functionality and are distributed and programmatically accessible over standard Internet protocols.  
           [0005]    Conceptually, Web services represent a model in which discrete tasks within processes are distributed widely throughout a value net. Notably, many industry experts consider the service-oriented Web services initiative to be the next evolutionary phase of the Internet. Typically, Web services can be defined by an interface such as the Web services definition language (WSDL), and can be implemented according to the interface, though the implementation details matter little so long as the implementation conforms to the Web services interface. Once a Web service has been implemented according to a corresponding interface, the implementation can be registered with a Web services registry, such as Universal Description, Discover and Integration (UDDI), as is well known in the art. Upon registration, the Web service can be accessed by a service requestor through the use of any supporting messaging protocol, including for example, the simple object access protocol (SOAP).  
           [0006]    In a service-oriented application environment supporting Web services, locating reliable services and integrating those reliable services dynamically in realtime to meet the objectives of an application has proven problematic. While registries, directories and discovery protocols provide a base structure for implementing service detection and service-to-service interconnection logic, registries, directories, and discovery protocols alone are not suitable for distributed interoperability. Rather, a more structured, formalized mechanism can be necessary to facilitate the distribution of Web services in the formation of a unified application.  
           [0007]    Notably, the physiology of a grid mechanism through the Open Grid Services Architecture (OGSA) can provide protocols both in discovery and also in binding of Web services, hereinafter referred to as “grid services”, across distributed systems in a manner which would otherwise not be possible through the exclusive use of registries, directories and discovery protocols. As described both in Ian Foster, Carl Kesselman, and Steven Tuecke,  The Anatomy of the Grid , Intl J. Supercomputer Applications (2001), and also in Ian Foster, Carl Kesselman, Jeffrey M. Nick and Steven Tuecke,  The Physiology of the Grid , Globus.org (Jun. 22, 2002), a grid mechanism can provide distributed computing infrastructure through which grid services instances can be created, named and discovered by requesting clients.  
           [0008]    Grid services extend mere Web services by providing enhanced resource sharing and scheduling support, support for long-lived state commonly required by sophisticated distributed applications, as well as support for inter-enterprise collaborations. Moreover, while Web services alone address discovery and invocation of persistent services, grid services support transient service instances which can be created and destroyed dynamically. Notable benefits of using grid services can include a reduced cost of ownership of information technology due to the more efficient utilization of computing resources, and an improvement in the ease of integrating various computing components. Thus, the grid mechanism, and in particular, a grid mechanism which conforms to the OGSA, can implement a service-oriented architecture through which a basis for distributed system integration can be provided-even across organizational domains.  
           [0009]    In operation, grid services can be instantiated as need be to accommodate incoming requests to access specified grid services. Ordinarily, once access to a grid service has been requested, the grid mechanism can locate an asserted compatible implementation based upon which an instance of the grid service can be created to satisfy the access request. Alternatively, the access request can be satisfied by an already created instance of the asserted compatible implementation. As the capacity of the created instance becomes increasingly taxed so that the created instance no longer can adequately satisfy all access requests from all client requestors, the grid mechanism can create new instances of the grid service to satisfy the overflow of requests. Notably, as grid services instances are deemed unnecessary in view of a measured load, already created instances of the grid service can be unloaded as required.  
           [0010]    Nevertheless, new instances of a requested, but overloaded grid service will not be created until the load experienced by the already created instances of the requested grid service reach inappropriate levels. Furthermore, as individual grid services can form and usually do form merely a portion of an application, related grid services can become overloaded in step with the overloading experienced by the individual grid services. Yet, new instances of the related grid services are not created until a separate and independent analysis concludes that new instances of the related grid services will be required. Accordingly, valuable computing resources can be consumed needlessly in determining when to create new instances of grid services to accommodate an increase in load. Furthermore, in many cases more grid services instances than necessary can be created in a knee-jerk response to increased load.  
         SUMMARY OF THE INVENTION  
         [0011]    The present invention is a method and system for creating service instances in a computing grid. The method can include scheduling a service in the computing grid to process at least a portion of a requested transaction. At least one additional service related to the scheduled service can be identified, and a load condition can be assessed in the at least one additional service related to the scheduled service. A new instance of the at least one additional service can be created if the load condition exceeds a threshold load. In this way, an enhanced capacity for processing transactions can be established in the related services in advance of a predicted increase in load in the grid.  
           [0012]    In one aspect of the invention, the scheduling step can include locating a service instance in the computing grid which has been created from a service configured to access resources required to satisfy at least a portion of the requested transaction. A load condition can be assessed in the located service instance. Subsequently, a new instance of the configured service can be created if the load condition in the located service instance exceeds a threshold load. Otherwise, the portion of the requested transaction can be assigned to the located service instance where the load condition does not exceed a threshold load. In this regard, the creating step can include the step of creating a new instance of the at least one additional service if the load condition exceeds a threshold load specified according to the terms of a service level agreement (SLA).  
           [0013]    In another aspect of the invention, the identifying step can include monitoring individual resources accessed by different types of transactions processed by different services in the computing grid. Additionally, the different services can be queried to determine underlying resource capabilities of the different services. Finally, selected ones of the different services can be identified as the related services where individual ones of the resources accessed by the selected ones of the different services, and the underlying resource capabilities are pre-determined by way of transaction type to relate to transactions processed in the scheduled service.  
           [0014]    A predictive grid service instance creation system can include a service creation factory disposed in a grid services host and configured to instantiate grid services on demand in a corresponding computing grid. The system also can include a monitor programmed to monitor transactions scheduled in the computing grid to identify related grid services, and to assess contemporaneous load conditions in individual instantiated ones of grid services in the computing grid. Finally, the system can include a scheduler coupled both to the service creation factory and to the monitor.  
           [0015]    Notably, the scheduler can schedule received transaction requests to be processed by selected instantiated ones of the grid services in the computing grid where load conditions in the instantiated ones permit. The scheduler further can request that the service creation factory create new instances of the grid services where load conditions in the instantiated ones require. Finally, the scheduler yet further can request that the service creation factory create new instances of related grid services identified by the monitor where load conditions in the related grid services require.  
           [0016]    In one important aspect of the present invention, at least one SLA further can be included which can specify at least one of availability and responsiveness terms based upon which it can be determined when load conditions permit scheduling of a specified grid service, and when load conditions require creating a new instance of a specified grid service. In another important aspect of the invention, a data store of transaction metrics can be provided in which the metrics are collected by the monitor for use in identifying the related grid services. To that end, the transaction metrics can include resources used by types of transactions processed by the grid services, and resource capabilities specified by the grid services in accessing the resources.  
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0017]    There are shown in the drawings embodiments which are presently preferred, it being understood, however, that the invention is not limited to the precise arrangements and instrumentalities shown, wherein:  
         [0018]    [0018]FIG. 1 is a block illustration of a Web services grid having a predictive system for creating Web service instances in the Web services grid in accordance with the present invention; and,  
         [0019]    [0019]FIG. 2 is a flow chart illustrating a process for predictively creating instances of Web services in the Web services grid of FIG. 1.  
     
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS  
       [0020]    The present invention is a method and system for creating instances of Web services within a computing grid based upon heuristics to predict service demand. In accordance with the inventive arrangements, relationships between different Web services in the grid can be determined. Based upon the determination, the instantiation of one Web service can cause the pre-emptive instantiation of other, related Web services so as to predict an imminent need to create additional service instances of the related Web services to satisfy an impending load. Notably, the anticipatory load threshold for creating instances of related services can be based upon the terms of a service level agreement (SLA).  
         [0021]    [0021]FIG. 1 is a block illustration of a Web services grid having a predictive system for creating Web service instances in the Web services grid in accordance with the present invention. As will be apparent to the skilled artisan, the Web services grid can be configured with one or more grid hosts  120  communicatively linked to one another in a grid fashion across a computer communications network  110 , for instance the Internet. Individual requesting clients  190  can request access to Web services from one or more of the grid hosts  120 . Specifically, as is well-known in the art, SOAP encoded messages can be exchanged between requesting clients  190  and the grid hosts  120 . The messages can include requests to discover the location of particular Web services and well as responses to the requests in which the network location of the requested Web services are revealed.  
         [0022]    The grid hosts  120  can be disposed within a server computing device in a centralized fashion, or across multiple server computing devices in a distributed fashion. In either case, a Web server  140  can be provided which can be configured to respond to network requests for content, such as markup documents. As will be understood by one of ordinary skill in the art, the Web server  140  can be configured to handle hypertext transfer protocol (HTTP) messages and to distribute markup such as hypertext markup language (HTML) formatted documents, extensible markup language (XML) formatted documents, and the like.  
         [0023]    The Web server  140  can be communicatively linked in the grid host  120  to an application server  150 . Application servers are well-known in the art and typically are configured to process machine code, whether in an interpreted manner, or in a native format. Conventional application servers process server-side logic such as scripts and servlets. In any event, the application server  150  can be linked to a Web services engine  160  configured to instantiate individual Web services in one or more Web services containers  130 . Importantly, each Web services container  130  can access one or more supporting applications  180 , such as a markup parser or a markup transcoder. As a result, Web services operating within a container  130  can access the operational functionality of the supporting applications  180 .  
         [0024]    Importantly, a grid service mechanism  170  can be disposed in each grid host  120 . The grid service mechanism  170  can implement a grid services interface such as that defined by OGSA and specified, for example, according to the Globus Project,  Globus Toolkit Futures: An Open Grid Services Architecture , Globus Tutorial, Argonne National Laboratory (Jan. 29, 2002). As is well-known in the art, an OGSA compliant grid services interface can include the following interfaces and behaviors:  
         [0025]    1. Web service creation (Factory)  
         [0026]    2. Global naming (Grid Service Handle) and references (Grid Service Reference)  
         [0027]    3. Lifetime management  
         [0028]    4. Registration and discovery  
         [0029]    5. Authorization  
         [0030]    6. Notification  
         [0031]    7. Concurrency  
         [0032]    8. Manageability  
         [0033]    In that regard, the grid services mechanism  170  can include a factory interface able to clone instances of selected Web services into new or pre-existing application containers using a “Factory Create Service”.  
         [0034]    Significantly, the grid services mechanism  170  can instantiate clone instances of a requested Web service across one or more remote grid hosts  120 . In particular, consistent with the intent of grid architectures, where processing loads experienced by individual remote grid hosts  120  exceed acceptable or pre-specified capacities, others of the individual remote grid hosts  120  can be selected to host new instances of selected Web services. Unlike a conventional grid services mechanism, the grid services mechanism  170  also can predictively create instances not only of required Web services, but also, the grid services mechanism  170  can create instances of related Web services to accommodate an anticipated load.  
         [0035]    More specifically, a monitoring process  200 A can monitor resources utilized by different application transaction types. A transaction, for purposes of the present invention, can include any process performed by an application hosted in the grid. Exemplary transactions can include an inquiry operation in a management information system, or a debit operation in a financial processing system. The set of resources utilized by the application transaction types can be written to fixed storage  200 C for later use in predictively and heuristically determining whether to create new instances of a Web service and related Web services.  
         [0036]    In addition to utilized resources, the monitoring process  200 A can query Web services in the grid to identify their respective underlying resource capabilities. In particular, the monitoring process  200 A can determine what types of resources can be accessed by the respective Web services, and at what level those resources can be accessed by the respective Web services. Finally, the monitoring process  200 A can query Web services in the grid to determine an experienced load. In each of the foregoing cases, though, it will be recognized by the skilled artisan that the invention is not so limited to a proactive querying. Rather, in the case of a subscription or observer model, the Web services in the grid can proactively report the underlying resource capabilities and load to the monitoring process  200 A. In each case, however, the collected metrics can be stored in fixed storage  200 C.  
         [0037]    Subsequent to the monitoring process  200 A, a scheduler  200 B can receive a request for a transaction, responsive to which the scheduler  200 B can retrieve the metrics stored in fixed storage  200 B. The scheduler  200 B subsequently can heuristically apply the retrieved metrics to determine the manner of scheduling the received transaction. More specifically, the scheduler  200 B can identify specific Web services in particular containers  130  within particular grid hosts  120  to satisfy portions of the requested transaction. Where required, additional Web service instances can be created to satisfy portions of the requested transaction. Finally, related Web service instances can be created not necessarily to satisfy a contemporaneous load experienced by already created Web service instances in the grid, but to satisfy an anticipated load predicted heuristically according to the metrics stored in fixed storage  200 C.  
         [0038]    [0038]FIG. 2 is a flow chart illustrating a process for predictively scheduling instances of Web services in the Web services grid of FIG. 1. Beginning in block  210 , a transaction request can be received. In block  220 , the transaction type can be identified. In block  230 , the resources required to service the transaction can be determined based upon the identified transaction type. In block  240 , known service providers in the grid can be located which have been configured to access the required resources.  
         [0039]    In block  250 , each located service provider can be queried to determine the contemporaneously experienced load. In decision block  260 , if a new service instance must be created to access one or more of the resources required by the requested transaction, in block  280  an instance of the service can be created in a grid host in the grid. As it will be apparent to one skilled in the art, new service instances can be created for each service able to access the required resource, but whose load exceeds a threshold load above which the service cannot adequately provide access to the required resource. Notwithstanding, if new service instances will not be required to access the required resources, in block  270 , the transaction can be scheduled according to existing instances of the located services.  
         [0040]    In decision block  290 , additional services which are known to be related to the created service instance can be identified based upon previously gathered metrics. In decision block  300 , the load for each identified related services can be tested to determine whether a new instance of the related service should be created to satisfy an anticipated, impending request. Finally, in block  310 , where appropriate, instances of selected related services can be created as the load determination requires, subsequent to which in block  270  the received transaction can be scheduled.  
         [0041]    The present invention can be realized in hardware, software, or a combination of hardware and software. An implementation of the method and system of the present invention can be realized in a centralized fashion in one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system, or other apparatus adapted for carrying out the methods described herein, is suited to perform the functions described herein.  
         [0042]    A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which, when loaded in a computer system is able to carry out these methods.  
         [0043]    Computer program or application in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following a) conversion to another language, code or notation; b) reproduction in a different material form. Significantly, this invention can be embodied in other specific forms without departing from the spirit or essential attributes thereof, and accordingly, reference should be had to the following claims, rather than to the foregoing specification, as indicating the scope of the invention.