Patent ID: 11941111
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 21:
22. A method for exploiting fine-grained structured weight sparsity in deep neural networks in a computing environment, by one or more processors, comprising:
storing indices of a plurality of non-zero weights in an index register file included within each of a plurality of processor elements;
storing the plurality of non-zero weights in a register file associated with the index register file, wherein only values of the non-zero weights are stored in all memory levels associated with the plurality of processor elements; and
selecting one or more input values of a data structure corresponding to the indices of the plurality of non-zero weights in the index register file as input operands for performing multiply-accumulate (“MAC”) operations on each of the plurality of non-zero weights, wherein the one or more input values of a data structure are reused for each of the MAC operations.