Patent ID: 11113601

Abstract:
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for balanced-weight sparse convolution processing. An exemplary method comprises: obtaining an input tensor and a plurality of filters; segmenting the input tensor into a plurality of sub-tensors according to a number of available processors; segmenting each of the plurality of filters into one or more sub-filters to obtain a plurality of the sub-filters; respectively assigning the plurality of sub-tensors and sub-filters to the available processors; for each of the available processors, iterating each of the index-value pairs and identifying, based on the index-value pair, a corresponding input value in the assigned sub-tensor to perform a multiply-and-accumulate (MAC) operation to generate a partial sum; reassigning the plurality of sub-filters to the available processors by rotating the plurality of sub-filters among the plurality of processors; and accumulating a plurality of the partial sums to obtain an output tensor.