Patent ID: 11899518
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  Y | IPC G

Claim 16:
17. A system, comprising:
one or more memory devices that store a deep neural network (DNN) topology, weights, and dot product precision values, the dot product precision values determined during training of the DNN; and
a neural processing unit (NPU) comprising:
a multiply and accumulate (MAC) circuit comprising:
a plurality of MAC processing elements (PEs) configured to generate an analog output from multiply and accumulation operations on inputs and weights;
an analog to digital converter (ADC) configured to convert the analog output to a dot product;
a precision determiner configured to dynamically provide the dot product precision values based on at least one of the inputs or the weights; and
a controller configured to dynamically vary a precision of the dot product based on the provided dot product precision values.