Patent ID: 11941111
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A system for exploiting fine-grained structured weight sparsity in deep neural networks in a computing environment, comprising:
one or more computers with executable instructions that when executed cause the system to:
store indices of a plurality of non-zero weights in an index register file included within each of a plurality of processor elements in a systolic array;
store the plurality of non-zero weights in a register file associated with the index register file, wherein only values of the non-zero weights are stored in all memory levels associated with the plurality of processor elements in the systolic array;
send, to one or more of the plurality of processor elements, a plurality of input values corresponding to a single block in a data structure; and
select one or more of the plurality of input values corresponding to the indices of the plurality of non-zero weights in the index register file for performing multiply-accumulate (“MAC”) operation based on sending, to the one or more of the plurality of processor elements, the plurality of input values.