Patent ID: 11861467
Assignee: QUALCOMM INCORPORATED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 25:
26. The system of claim 25, further comprising:
generating second quantized weights having a smaller bit size than the quantized weight information;
performing a subset of the one or more subsequent inferences using the second quantized weights;
determining that results of the subset of the one or more subsequent inferences using the second quantized weights are within the threshold performance level of results of a subset of the one or more subsequent inferences performed using the machine learning model and the quantized weight information; and
based on determining that the results of the subset of the one or more subsequent inferences using the second quantized weights are within the threshold performance level of the results of the subset of the one or more subsequent inferences performed using the machine learning model and the quantized weight information, performing additional inferences beyond the one or more subsequent inferences using the machine learning model and the second quantized weights.