Patent ID: 11922324
Assignee: TENYX, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
comparing each neuron's weight vector in a layer of neurons of a neural network model to each other neuron's weight vector in the layer of neurons to determine a similarity of each neuron to each other neuron in the layer;
determining a redundant set of neurons and a non-redundant set of neurons based on the similarity of each neuron in the layer;
fine tuning the non-redundant set of neurons using a gradient of a neuron of the non-redundant set of neurons determined using a first set of training data, wherein the gradient is backpropagated to the neuron of the non-redundant set of neurons;
applying a perturbation to the redundant set of neurons during the fine tuning of the non-redundant set of neurons, wherein the perturbation is a random perturbation; and
training the redundant set of neurons using a gradient of a neuron of the redundant set of neurons determined using a second set of training data, wherein the gradient is backpropagated to the neuron of the redundant set of neurons.