Patent ID: 11861467
Assignee: QUALCOMM INCORPORATED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 40:
41. A system for adaptively executing machine learning models on a computing device, comprising:
means for receiving weight information for a machine learning model to be executed on the computing device;
means for reducing the received weight information into quantized weight information having a reduced bit size relative to the received weight information, wherein the quantized weight information comprises a plurality of weight sets, each respective weight set quantizing the weight information for the machine learning model into a respective bit size;
means for performing first inferences using the machine learning model and the received weight information;
means for performing second inferences using the machine learning model and the quantized weight information;
means for comparing results of the first and second inferences;
means for determining that results of the second inferences are within a threshold performance level of results of the first inferences;
means for performing one or more subsequent inferences, based on determining that the results of the second inferences are within the threshold performance level of the results of the first inferences, using the machine learning model and the quantized weight information;
means for performing inferences for a subset of the one or more subsequent inferences using the machine learning model and the received weight information;
means for determining that results of the subset of the one or more subsequent inferences using the machine learning model and the quantized weight information are outside the threshold performance level relative to results of a subset of the one or more subsequent inferences performed using the machine learning model and the received weight information; and
based on means for determining that the results of the subset of the one or more subsequent inferences using the machine learning model and the quantized weight information are outside the threshold performance level relative to the results of the subset of the one or more subsequent inferences performed using the machine learning model and the quantized weight information, means for performing additional inferences using the machine learning model and the received weight information.