Patent ID: 8869160

Claim:
A computer-implemented method for dynamically managing accelerator resources, the computer-implemented method comprising: initially assigning a first set of hardware accelerator resources to a first information processing system and a second set of hardware accelerator resources to a second information processing system, wherein each hardware accelerator resource in the first and second sets of hardware accelerator resources is one of a special-purpose hardware component and a special-purpose appliance that is separate from and located outside of the first and second information processing systems; monitoring, by at least one processor, a plurality of jobs running on the first and second information processing systems; determining, based on the monitoring, a set of performance parameters for each of the plurality of jobs, wherein the set of performance parameters comprises at least an amount of time at least one of the plurality of jobs stays within an accelerator queue waiting to be performed; identifying, based on the determining, a service class associated with each of the plurality of jobs; determining, for each identified service class, a performance related goal associated with the service class based on the set of performance parameters that has been determined; determining that at least one job running on the first information processing system fails to satisfy the performance related goal associated with the service class of the job; and dynamically reassigning, based on the determining, at least one hardware accelerator resource in the second set of hardware accelerator resources from the second information processing system to the first information processing system, wherein the dynamically reassigning is based on generating a queuing model associated with the service class of the job; learning, based on the queuing model, how long each job in the service class waits for hardware accelerator resource in the first set of hardware accelerator resources relative to a number of hardware accelerator resources in the first set of hardware accelerator resources; and estimating, based on the learning, an impact on an average response time of the service class if at least one hardware accelerator resource in the second set of hardware accelerator resources is dynamically reassigned to the first information processing system.