Patent ID: 11915041
Assignee: NEUREALITY LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A method for sequencing artificial intelligence (AI) jobs, comprising:
receiving, from a server, a plurality of different AI jobs over a network;
assigning each of the received AI jobs to a respective first queue;
processing each AI job in its respective first queue to generate an execution sequence for each of the received AI jobs;
assigning each received AI job to a second respective queue which is each associated with at least one designated AI accelerator to process the respective received AI job according to a determined execution sequence;
dispatching each received AI job from its respective second queue to the designated AI accelerator associated with the respective second queue to be processed thereby;
receiving processing results from each of the at least one designated AI accelerator; and
sending the processing results to the server over the network;
wherein each AI accelerator is a dedicated processor configured to process a specific AI function of the AI job;
wherein each AI job is dispatched to minimize any possible idle time of the AI accelerators; and
whereby the AI jobs are dispatched so that at any point in time different ones of the AI accelerators are executing different AI jobs.