Patent ID: 11880715
Assignee: ADVANCED MICRO DEVICES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A system for load balancing in a neural network system that improves computational efficiency of the neural network system, comprising:
one or more kernels, one or more neurons, and one or more layers, wherein any one or a combination of the one or more kernels, neurons, and layers of the neural network system are tagged with metadata; and
a scheduler connected to the neural network system, where the scheduler is configured to:
detect that there are resources available for execution of a neuron in a subsequent layer of the neural network system; and
in response to detecting that there are resources available for execution:
perform the load balancing of the neural network system using the metadata, and
execute computations of the neuron in the subsequent layer of the neural network system according to the load balancing.