Patent ID: 11972217
Assignee: RELX INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for displaying a user interface of an evaluation system configured to evaluate predicted answers generated by a machine learning system, the method comprising:
receiving textual data and a first predicted answer to a question associated with a text object, the first predicted answer including a first confidence level determined by a machine learning system;
in response to determining the first confidence level being smaller than the first predetermined confidence threshold:
displaying, at the user interface, the question and the text object associated with the question; and
in response to determining the first confidence level being larger than or equal to a second predetermined confidence threshold, displaying, at the user interface, the first predicted answer; and

in response to receiving a true answer through the user interface:
determining a first accuracy score associated with the true answer based at least in part on the machine learning system;
changing the first predetermined confidence threshold based at least in part on the first accuracy score;
changing the second predetermined confidence threshold based at least in part on the first accuracy score in response to receiving the true answer through the user interface;
storing the first accuracy score and the true answer in the storage for retrieval and display;

wherein the first predetermined confidence threshold is larger than or equal to the second predetermined confidence threshold.