Patent ID: 11934956
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A system for training a neural network, the system comprising:
one or more data processing apparatus; and
one or more memory devices storing instructions that when executed by the one or more data processing apparatus cause the one or more data processing apparatus to perform operations for training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the operations including:
obtaining a plurality of training items, wherein each training item is associated with an initial target label distribution that assigns a respective target score to each label in the predetermined set of multiple labels;
for each training item, modifying the initial target label distribution using a smoothing label distribution to obtain a modified initial target label distribution, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of multiple labels; and
training the neural network to minimize a loss function based on (1) a respective network output generated by the neural network for each training item in the plurality of training items, and (2) the respective modified initial target label distribution for each training item in the plurality of training items.