Patent ID: 11954580
Assignee: META PLATFORMS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
receive, at a cluster-level controller of each of a plurality of tensor processor clusters that includes a plurality of tensor processors, a first multi-cycle instruction, wherein each of the plurality of tensor processor clusters receives a respective multi-cycle instruction, and wherein the respective multi-cycle instructions are distributed across the plurality of tensor processor clusters in accordance with single-program-multiple-data (SPMD) parallelism such that at least two of the plurality of tensor processor clusters receive and execute different multi-cycle instructions while operating on an input feature map;
determine, based on the first multi-cycle instruction, (1) a first sequence of vector operations to be executed by the tensor processors and (2) address information usable to determine a respective spatial partition of an input tensor on which each tensor processor is to operate when performing each vector operation in the first sequence; and
for each vector operation in the first sequence:
generate, based on the address information, a common address offset, relative to a respective base address associated with each tensor processor, at which each tensor processor is to retrieve the respective spatial partition on which the tensor processor is to operate;
multicast the common address offset to the tensor processors; and
control the tensor processors to execute the vector operation in lock step.