Patent ID: 11880746
Assignee: HRB INNOVATIONS, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. One or more non-transitory computer-storage media storing computer executable instructions that, when executed by a processor:
present an artificial intelligence system training user interface comprising:
a first pane displaying a current training data item of a set of training data items for an artificial intelligence system;
a second pane displaying a first set of indicia corresponding to a plurality of labels relevant to the set of training data items,
wherein automatic preliminary classification of the set of training data items occurs in real time based on a current state of training of the artificial intelligence system,
wherein the artificial intelligence system filters out one or more labels of the plurality of labels that are not applicable to the current training data item based on the automatic preliminary classification and prior classification data, and
wherein the second pane further displays a not-applicable indicium to indicate that at least one of the set of training data items is not relevant to any of the one or more labels, and
wherein the second pane further displays a function for showing a second set of indicia corresponding to all available labels, when a subject-matter expert determines an applicable label has been incorrectly filtered out based on the automatic preliminary classification;
wherein the second pane further displays the not-applicable indicium corresponding to the function for showing the second set of indicia, when an appropriate label has been incorrectly filtered out based on the automatic preliminary classification; and
a toggle,
wherein the artificial intelligence system sorts the one or more labels based on an estimated likelihood of the one or more labels being applicable to the current training data item and preselects one or more preselected labels as applicable to the current training data item based on the automatic preliminary classification;

receive, from the subject-matter expert, a selection or unselection of one or more received labels of the plurality of labels that the artificial intelligence system should apply to the current training data item,
wherein automatic preliminary classifications of subsequent data items is updated based on the subject-matter expert selecting labels and unselecting preselected labels corresponding to the current training data item;
store the current training data item together with the selection of the one or more received labels in a training data store;
a forward button to allow the subject-matter expert to move from the current training data item to a next one of the set of training data items; and
a back button to allow the subject-matter expert to move from the current training data item to a previous one of the set of training data items.