Patent ID: 11941503
Assignee: ECHONOUS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 29:
30. A method in a computing system for configuring hybrid inference for sequence of data items generated by a local device, the method comprising:
installing on a cloud server:
a cloud inference model, and
server software adapted to:
receive data items from the local device;
subject the data items received from the local device to the cloud inference model to obtain a cloud inference result for each; and
return the cloud inference results to the local device as they are obtained, and

installing on the local device:
a local inference model that can be evaluated using lesser computational resources than are needed to evaluate the cloud inference model, and
local software adapted to:
access data items as they are generated by the local device;
for each accessed data item:
send the data item to the cloud server;
subject the data item to the local inference model to obtain local inference result;
store the local inference result in a circular buffer;
aggregate the inference results contained by the circular buffer; and

receive cloud inference results from the cloud server; and
substitute in the circular buffer each received cloud inference result for the local inference result for the same data item.