Patent ID: 11966453
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising instructions configured to cause one or more processors to perform a method comprising:
receiving an unlabeled dataset for a machine learning model, wherein the unlabeled dataset comprises a plurality of data points relevant to a task for the machine learning model;
determining a plurality of weighted losses corresponding to the plurality of data points based on a loss algorithm for a plurality of coreset selection scores corresponding to the plurality of data points, wherein the weighted losses are determined based on a plurality of ordering constraints indicating:
a plurality of data classes; and
a corresponding plurality of weights, wherein the corresponding plurality of weights represent a relative priority of the data classes with respect to each other; and

generating an ordered annotation set from the unlabeled dataset by constraining an active learning tool to select and sequence the plurality of data points based on a loss algorithm for the plurality of ordering constraints.