Patent ID: 11928560
Assignee: CANON KABUSHIKI KAISHA
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system monitoring a plurality of machine-learned models generated through machine learning, the plurality of machine-learned models including (i) a first machine-learned model configured to output a first prediction result based on consideration of a plurality of first inputs input to the first machine-learned model and (ii) a second machine-learned model, different from the first machine-learned model, configured to output a second prediction result based on consideration of a plurality of second inputs input to the second machine-learned model, the system comprising:
one or more memories storing instructions; and
one or more processors that execute the instructions causing the system to:
monitor the first machine-learned model and warn of a first specific input, among the plurality of first inputs input to the first machine-learned model, in a case where prediction results by the first machine-learned model using the first specific input, which includes a plurality of values, satisfy a predetermined condition;
provide, in the case where the prediction results by the first machine-learned model using the first specific input satisfy the predetermined condition, a message that prompts monitoring of a second specific input, which corresponds to the first specific input, among the plurality of second inputs input to the second machine-learned model different from the first machine-learned model;
determine whether the plurality of second inputs input to the second machine-learned model, different from the first machine-learned model, include an input corresponding to the first specific input that is input to the first machine-learned model; and
provide, in a case where it is determined that the plurality of second inputs input to the second machine-learned model, different from the first machine-learned model, do not include the input corresponding to the first specific input that is input to the first machine-learned model, a message prompting relearning of the second machine-learned model, different from the first machine-learned model, with learning data including the first specific input that is input to the first machine-learned model,
wherein the input corresponding to the first specific input is used for determining a bias of fairness in any one of the machine learned models in the plurality of the machine learned models.