Patent ID: 11861452
Assignee: CADENCE DESIGN SYSTEMS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A method of generating a lookup table for quantized softmax evaluation in a neural network, the method comprising:
generating a lookup table entry index for a data type having a first number of bits;
for each entry value of the lookup table entry index:
determining a range mapping from an intermediate neural network layer output to a corresponding softmax input; and
inputting a fixed point value from the range mapping to the lookup table entry index;

determining entry values of the lookup table entry index having a zero value;
removing the entry values of the lookup table entry index having the zero value from the lookup table entry index to generate the lookup table, wherein an index value for each entry value of the lookup table is determined according to index=xj+size(LUT)−max−1, wherein index is the index value, wherein xj is a value of the fixed point value for a corresponding index value, wherein size (LUT) is a number of entry values in the lookup table following removal of the entry values having the zero value, and wherein max is a maximum value of all index values of the lookup table; and
storing the lookup table in a memory.