Patent ID: 11941111
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 22:
23. A method for exploiting fine-grained structured weight sparsity in deep neural networks in a computing environment, by one or more processors, comprising:
storing non-zero weights indices in an index register file included within each of a plurality of processor elements;
storing a plurality of non-zero weights in a register file associated with the index register file, wherein only values of the non-zero weights are stored in all memory levels associated with the plurality of processor elements;
performing multiply-accumulate (“MAC”) operations on one or more nth-size block input value from a data structure sent to the plurality of processor elements using the non-zero weights indices as input operands; and
continuously executing the MAC operations on each of the plurality of non-zero weights corresponding to the non-zero weights indices by re-using the one or more nth-size block input value from the data structure.