Patent ID: 11972489
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 16:
17. One or more non-transitory computer-readable media storing computer executable instructions that, when executed, cause one or more processors to perform operations comprising:
receiving a trained machine learning (ML) model trained to extract text information from image input data and classify the image input data with image input data classifications and based on severity level, determine image quality data for the image input data, and determine confidence scores for the image input data classifications, wherein the trained ML model is trained using training data comprising samples of images in claims data and respective labeled metadata indicating severity levels corresponding to the claims data;
generating a user portal to receive insurance claims documents;
receiving image data associated with insurance claims documents for an insurance claim;
executing the trained ML model using the image data as first input to generate first structured information comprising text data, a first insurance category, an image quality of the image data, and a first confidence score for the first insurance category as first output;
determining that the first confidence score meets or exceeds a first threshold;
based on the image quality, and on determining that the first confidence score meets or exceeds the first threshold:
generating metadata indicating the first structured information and the first insurance category; and
determining, based on the first insurance category, a first workflow for the metadata, the first workflow including performing advanced data analysis on the image data;

determining, based on performing advanced data analysis on the image data, a type of structured information to indicate in the metadata;
generating a user interface;
in response to receiving unstructured data via the user interface, executing the trained ML model using the unstructured data as second input to generate second structured information of the type of structured information and a second insurance category of the insurance categories corresponding to the unstructured data as second output;
determining, based on the second insurance category, a second confidence score for the second structured information;
determining that the second confidence score is less than a second threshold; and
generating, based on the determining that the second confidence score is less than the second threshold, a second workflow for the metadata, the second workflow including generating a request for additional information associated with the second structured information.