Patent ID: 11972344
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 20:
21. A system for improving a simple model using a confidence profile, said system comprising:
a processor; and
a memory, the memory storing instructions to cause the processor to perform:
transferring information from a pre-trained complex model including a neural network to the simple model by:
generating, using a linear probe, confidence scores through flattened intermediate representations of the neural network and learning a regularized neural network that inputs same confidence scores;
setting weights of samples, by defining a regularization term in the regularized neural network to keep the weights from all going to zero, during a training of the simple model using the confidence scores of the intermediate representations that justify the weights and minimize a loss of the simple model;
retraining the simple model using the weights that are justified, wherein the simple model includes a lasso model, and wherein the linear probe is added at certain layers of the neural network, the certain layers representing logical units; and
computing an area under the curve (AUC) traced by the confidence scores at each linear probe for a given input-output pair, wherein the confidence scores are for a true label of a given example instead of a predicted label.