Patent ID: 11915823
Assignee: PATHAI, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. The storage medium of claim 19, wherein:
determining the degree of association between the reference annotations and the model predicted annotations for the set of frames comprises:
for each of the plurality of users:
determining a respective concordance of the user with a respective user cluster comprising all other user(s) of the plurality of users by comparing the reference annotations of the user with the reference annotations of all other user(s) in the respective user cluster; and
determining a respective concordance of the model predictions with the respective user cluster by comparing the model predicted annotations with the reference annotations of all other user(s) in the respective user cluster; and

aggregating the concordances of the plurality of users and the concordances of the model predictions to determine the degree of association.