Patent ID: 11961000
Assignee: QUALCOMM INCORPORATED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. An apparatus for operating a neural network, comprising:
means for generating, at a processor, a compression mapping table based at least in part on at least one of a sparsity estimate or a loss threshold for a selected bandwidth, power, or thermal profile, wherein the compression map table comprises at least one column indicating a specific compression ratio for both a weight and an activation associated with each different system event and a plurality of table rows, each row of the plurality of tables rows corresponding to a specific layer of the neural network;
means for determining a compression ratio for a first layer of the neural network based on a threshold associated with a system event using the compression mapping table and detection of a layer type of the first layer in the neural network;
means for compressing at least one of activations or weights in the first layer of the neural network based at least in part on the compression ratio and detection of the system event to produce at least one of compressed activations or compressed weights;
means for generating compression metadata indicating how data was compressed; and
means for operating the neural network to compute an inference based on the at least one of the compressed activations or the compressed weights.