Patent ID: 11907827
Assignee: INTEL CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A deep neural network system, comprising:
one or more neural network accelerators comprising:
a plurality of processing engines coupled together and configured to perform arithmetic operations in support of an inference performed using the deep neural network system, wherein the plurality of processing engines are implemented using a plurality of processing elements;
a schedule-aware tensor data distribution circuitry, comprising:
a load finite state machine configured to load tensor data into the plurality of processing engines in a load phase;
a drain finite state machine that is configured to:
extract output data from the plurality of processing engines in an extraction phase;
adjust the extracted output data based at least in part on a schedule for a next layer after a current layer to output the extracted output data by reshaping the extracted output data for storage in memory to reduce a number of accesses to the memory for the next layer by changing a shape of how the extracted output data is stored in the memory based at least in part on a type of the next layer; and
store the adjusted extracted output data to a plurality of memory banks.