Patent ID: 11915126
Assignee: RECOGNI INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system, comprising:
a first computing unit configured to:
receive a first plurality of quantized activation values represented by a first plurality of activation mantissa values and a first activation exponent shared by the first plurality of activation mantissa values, wherein the first plurality of quantized activation values is a quantized representation of a first matrix with values;
receive a first quantized convolutional kernel represented by a first plurality of kernel mantissa values and a first kernel exponent shared by the first plurality of kernel mantissa values;
compute a first dot product of the first plurality of activation mantissa values and the first plurality of kernel mantissa values; and
compute a first sum of the first shared activation exponent and the first shared kernel exponent;

a second computing unit configured to:
receive the first plurality of quantized activation values;
receive a second quantized convolutional kernel represented by a second plurality of kernel mantissa values and a second kernel exponent shared by the second plurality of kernel mantissa values;
compute a second dot product of the first plurality of activation mantissa values and the second plurality of kernel mantissa values; and
compute a second sum of the first shared activation exponent and the second shared kernel exponent;

a third computing unit configured to:
receive a second plurality of quantized activation values represented by a second plurality of activation mantissa values and a second activation exponent shared by the second plurality of activation mantissa values, wherein the second plurality of quantized activation values is a quantized representation of a second matrix with values wherein six of the values of the first matrix are identical to six of the values of the second matrix;
receive the first quantized convolutional kernel;
compute a third dot product of the second plurality of activation mantissa values and the first plurality of kernel mantissa values; and
compute a third sum of the second shared activation exponent and the first shared kernel exponent; and

a fourth computing unit configured to:
receive the second plurality of quantized activation values;
receive the second quantized convolutional kernel;
compute a fourth dot product of the second plurality of activation mantissa values and the second plurality of kernel mantissa values; and
compute a fourth sum of the second shared activation exponent and the second shared kernel exponent,
wherein the first plurality of quantized activation values are received by the first and second computing units, but not by the third and fourth computing units,
wherein the second plurality of quantized activation values are received by the third and fourth computing units, but not by the first and second computing units,
wherein the first quantized convolutional kernel is received by the first and third computing units, but not by the second and fourth computing units, and
wherein the second quantized convolutional kernel is received by the second and fourth computing units, but not by the first and third computing units.