Patent ID: 11924379
Assignee: CALABRIO, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC H  G | IPC G  H

Claim 0:
1. A system comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations comprising:
receive a piece of content;
identify one or more triggering phrases in the piece of content using a compliance model, wherein the compliance model is a large language machine learning model trained on labeled content based on a relevant phrase list;
determine if one or more compliance statements associated with the identified one or more triggering phrases are present or absent in the piece of content;
receive a subject for an evaluation; and
evaluate subject performance based on the presence or absence of an associated compliance statement in the piece of content, wherein evaluating the subject performance comprises:
accessing one or more compliance model outputs relevant to the subject of the evaluation;
analyzing the one or more compliance model outputs based on one or more performance standards, wherein a performance standard is a threshold value which defines an acceptable performance level for the subject in providing the required compliance statement;
determining if an agent satisfies the one or more performance standards; and
sending a notification that agent did or did not satisfy the performance standard.