Patent ID: 11886919
Assignee: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A system comprising:
a cluster comprising a gateway and a host system comprising a processing resource and a plurality of hardware accelerators, wherein the host system or a hardware accelerator of the plurality of hardware accelerators comprises a primary node of the cluster, and the host system and the plurality of hardware accelerators comprise a plurality of worker nodes of the cluster,
wherein the gateway comprises a non-transitory storage medium comprising instructions executable at the gateway to:
receive queries at the gateway; and
determine a distribution of the queries among the plurality of worker nodes of the host system and the plurality of hardware accelerators based on a queuing model that takes into consideration respective compute capacities of the host system and the plurality of hardware accelerators,

wherein the host system is to perform auto-scaling to run a quantity of instances of an application in the plurality of worker nodes, and
wherein the queries are directed to the plurality of worker nodes according to the distribution for processing, by the plurality of worker nodes, the quantity of instances of the application.