Patent ID: 11875706
Assignee: PEARSON EDUCATION, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system for controlling training quality of a machine learning model, the system comprising:
a memory comprising: a content library database containing a plurality of prompts and evaluation data associated with each of the plurality of prompts; and a model database comprising a plurality of evaluation models for automated evaluation of received user responses, wherein the evaluation data of each of the plurality of prompts includes a pointer linking to the associated evaluation model; and
a processing unit, including at least one processor, the processing unit configured to:
receive a plurality of responses received from a plurality of users in response to providing of a prompt from the plurality of prompts;
identify, based at least on an associated pointer for the provided prompt, an evaluation model from the plurality of evaluation models relevant to the provided prompt, wherein the evaluation model comprises a machine learning model trained to output a score relevant to at least portions of a response;
generate a training indicator, wherein the training indicator provides a graphical depiction of a degree to which the evaluation model is trained;
determine a training status of the evaluation model;
control the training indicator to identify the training status of the evaluation model;
automatically evaluate the plurality of responses with the evaluation model when the evaluation model is identified as sufficiently trained;
after the plurality of responses have been auto-evaluated, generate output data characterizing results of the auto-evaluation of the plurality of responses;
generate, based on the output data, a graphical indicator for the evaluation model, wherein the graphical indicator characterizes performance of the auto-evaluation by the evaluation model; and
control a user interface to display the graphical indicator.