Patent ID: 11948074
Assignee: SAMSUNG ELECTRONICS CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B | IPC B  G

Claim 10:
11. A processor-implemented method comprising:
initializing a weight of a current layer of an interim neural network, a first representation bit number related to the weight, a weight quantization parameter, a second representation bit number related to an output activation map output from the current layer, and an activation quantization parameter; and
generating a trained neural network by iteratively training plural layers of the interim neural network, including:
training the interim neural network by updating the first representation bit number as an updated first representation bit number, and the second representation bit number as an updated second representation bit number, based on an accuracy calculated in a previous iteration of the iterative training;
calculating a loss as a calculated loss based on the weight, the updated first representation bit number, the weight quantization parameter, the updated second representation bit number, and the activation quantization parameter, based on training data;
training the interim neural network by updating the weight as an updated weight, the weight quantization parameter as an updated weight quantization parameter, and the activation quantization parameter as an updated activation quantization parameter based on the calculated loss; and
calculating an accuracy to be implemented in a subsequent iteration, of the iterative training, with validity data based on the updated weight, the updated weight quantization parameter, and the updated activation quantization parameter,

wherein a first parameter is dependent on first and second thresholds derived from the output activation map, and a second parameter that is dependent on the first and second thresholds, and
wherein the subsequent iteration in performing quantization based on the updated activation quantization parameter that is dependent on the first parameter and the second parameter.