Patent ID: 11941503
Assignee: ECHONOUS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. One or more instances of computer-readable media collectively having contents configured to cause a computing system to perform a method, the one or more instances of computer-readable media not constituting transitory signals per se, the method comprising:
receiving a sequence of data items;
for each data item, in response to its receipt:
forwarding the data item to a server;
subjecting the data item to a local machine learning model to produce a local inference result for the data item;
adding the produced local inference result to a queue;
aggregating the inference results contained by the queue to obtain an output inference result; and
removing the oldest inference result from the queue;

receiving from the server a plurality of cloud inference results each obtained by applying a server machine learning model to one of the data items forwarded to the server; and
for each received cloud inference result, in response to its receipt, substituting the cloud inference result in the queue for the local inference result for the same data item.