Patent ID: 11922304
Assignee: NEUREALITY LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A remote artificial intelligence (AI) acceleration system, comprising:
a plurality of application servers, wherein each of the plurality of application server is configured to execute AI applications over an AI software framework;
at least one artificial intelligence accelerator (AIA) appliance server configured to execute AI processing tasks in response to requests from the AI applications; and
at least one switch configured to allow connectivity between the plurality of application servers and the at least one AIA appliance server, wherein each of the at least one AIA appliance server includes:
a plurality of network-attached artificial intelligence accelerator (NA-AIA) engines; and
at least one least one AIA switch directly coupled to the plurality of NA-AIA engines and a network, wherein the at least one AIA switch allows direct communication between the plurality of application servers and the plurality of NA-AIA engines through the network,
wherein each of the plurality of NA-AIA engines is configured to execute at least one processing AI task upon a request from an AI application executed by an application server, wherein data required for execution of an AI task is directly copied, over the network, from the application server to a NA-AIA engine executing the AI task,
and wherein each of the plurality of NA-AIA engines includes an embedded network interface controller (eNIC), the eNIC is configured to connect the NA-AIA engine to the AIA switch and to implement a remote direct memory access to allow the application server to copy data directly to the NA-AIA engine over the network.