Patent ID: 11972341
Assignee: DEEPMIND TECHNOLOGIES LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A system comprising:
one or more computers; and
one or more storage devices communicatively coupled to the one or more computers, wherein the one or more storage devices store instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
receiving weight matrices of a layer of a plurality of layers of a signal generation neural network, wherein each layer of one or more layers in the neural network has a residual connection to a subsequent layer, and wherein each layer of the plurality of layers has a skip connection, wherein for each layer:
a respective first weight matrix comprises values for a first matrix operation of the layer, and
one or more other weight matrices comprise values for one or more other matrix operations of the layer, wherein the one or more other matrix operations depend on a result of the first matrix operation;

interleaving rows of the first weight matrix for the layer by assigning groups of rows of the first weight matrix to respective thread blocks of a plurality of thread blocks, each thread block being a computation unit for execution by an independent processing unit of a plurality of independent processing units of a parallel processing device, each independent processing unit being a streaming multiprocessor;
receiving, by the layer, an input vector;
performing, by the plurality of thread blocks, the first matrix operation corresponding to the first weight matrix substantially in parallel;
after performing the first matrix operation corresponding to the first weight matrix:
performing, by the plurality of thread blocks, the one or more other matrix operations corresponding to the one or more other weight matrices; and
outputting respective results of the one or more other matrix operations to the residual connection in the network and to the skip connection in the network;
wherein the signal generation neural network is configured to generate, as an output, audio data comprising a plurality of audio data samples.