Patent ID: 11954573
Assignee: BLACK SESAME TECHNOLOGIES INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method of training a hybrid computational system to configure a three-dimensional (3D) multiplier array comprising a predetermined number of multipliers in a convolutional neural network, the hybrid computational system comprises a field programmable gate array, a graphical processor unit, a central processing unit, a memory interface, and a controller all connected to each other via a central interconnect, and is configured to perform the method steps comprising:
determining a set of model data with a deterministic inference model using the graphical processor unit of the hybrid computational system;
programming the field programmable gate array to perform the steps further comprising:
determining activation data dimensions comprising an activation data map width, an activation data map height, a channel depth, and a batch number:
determining dimensions of filter weights comprising Kernel width, Kernel height, Kernel depth, and filter number, wherein the Kernel depth matches the channel depth; and
configuring the 3D multiplier array to increase a rate of utilization of multipliers when performing a multiply accumulate operation, wherein configuring the 3D multiplier array comprises:
in response to determining that the activation data map width is not a multiple of a first dimension of the 3D multiplier array, configuring the first dimension of the 3D multiplier array to concurrently compute for the activation data map width and the activation data map height:
configuring a second dimension of the 3D multiplier array to concurrently compute for the channel depth, the Kernel width, and the Kernel height; and
configuring a third dimension of the 3D multiplier array to compute for the filter number.