Patent ID: 11886983
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system comprising:
a set of processing units; and
a non-transitory machine-readable medium storing instructions that when executed by at least one processing unit in the set of processing units cause the at least one processing unit to:
receive, at a layer included in a neural network, a first matrix;
compress the first matrix to produce a second matrix to reduce an amount of hardware resources utilized to process the second matrix, the second matrix having a reduced dimensionality relative to a dimensionality of the first matrix;
process the second matrix through a network block in the layer included in the neural network;
expand the processed second matrix to produce a third matrix, the third matrix having a dimensionality that is equal to a dimensionality of the first matrix; and
add the third matrix to the first matrix to produce a fourth matrix.