Patent ID: 11966453
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A system comprising:
one or more computer processing circuits; and
one or more computer-readable storage media storing program instructions which, when executed by the one or more computer processing circuits, are configured to cause the one or more computer processing circuits to perform a method comprising:
receiving an unlabeled dataset for a machine learning model, wherein the unlabeled dataset comprises a plurality of data points relevant to a task for the machine learning model;
determining a plurality of weighted losses corresponding to the plurality of data points based on a loss algorithm for a plurality of coreset selection scores corresponding to the plurality of data points, wherein the plurality of weighted losses are determined based on a plurality of ordering constraints indicating:
a plurality of data classes; and
a corresponding plurality of weights, wherein the corresponding plurality of weights represent a relative priority of the data classes with respect to each other; and

generating an ordered annotation set from the unlabeled dataset by constraining an active learning tool to select and sequence the plurality of data points based on a loss algorithm for the plurality of ordering constraints.