Patent ID: 11935179
Assignee: NVIDIA CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A system, comprising:
a global memory storing weights;
a processor that is connected to the global memory and executes a neural network model by:
partitioning inputs to the neural network model into portions that are each sized for execution in a processing core included in a set of processing cores by a single thread block;
loading the weights for the neural network model into a register file within the processor once to process the inputs;
subdividing a matrix of the weights into weight blocks of elements corresponding to a size of a hardware-accelerated matrix multiplier;
independently processing the portions in parallel by the set of processing cores within the processor executing thread blocks, by performing, at a layer of the neural network model, weight-matrix multiplication using the weight blocks and element-wise application of an activation function
to produce intermediate results; and

processing the intermediate results for each portion by a subsequent layer of the neural network model to produce subsequent intermediate results until a last layer of the neural network model generates outputs.