Patent ID: 11868871
Assignee: PERCEIVE CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A neural network inference circuit for executing a neural network that comprises a plurality of nodes that use state data from previous executions of the neural network, the neural network inference circuit comprising:
a set of computation circuits that executes the nodes of the neural network; and
a set of memories that implements a set of one or more registers to store, while executing the neural network for a particular input, state data generated during at least two executions of the network for previous inputs, the state data for use by the set of computation circuits when executing a set of the nodes of the neural network for the particular input,
wherein:
the neural network inference circuit comprises a plurality of cores, each core comprising a subset of the computation circuits and a subset of the memories;
the nodes of the neural network are divided into a plurality of layers;
each layer of a subset of the layers uses a subset of the state data;
each layer of the subset of layers is executed by the computation circuits of a subset of the cores; and
the state data generated during a particular execution for use by a particular layer in subsequent executions is stored in the memories of each core in a particular subset of the cores the computation circuits of which execute the particular layer.