Patent ID: 11972489
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system comprising:
one or more processors; and
computer-readable media storing first computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a plurality of electronic files containing information associated with previously settled claims;
determining, for individual electronic files of the plurality of electronic files and based on the information contained in the individual electronic files, insurance categories;
generating training data comprising samples of images in the plurality of electronic files, wherein generating the training data includes adding labeled metadata to individual samples of images, the labeled metadata identifying the insurance categories;
training a machine learning (ML) model with the training data to:
extract text information from image input data,
classify the image input data with image input data classifications and based on the labeled metadata,
determine image quality data for the image input data, and
determine confidence scores for the image input data classifications, wherein the image input data may be in one or more file formats;

receiving image data associated with insurance claims documents for an insurance claim;
executing the ML model using the image data as first input to generate first structured information comprising text data, a first insurance category, an image quality of the image data, and a first confidence score for the first insurance category as first output;
determining that the first confidence score meets or exceeds a first threshold;
based on the image quality, and on determining that the first confidence score meets or exceeds the first threshold:
generating metadata indicating the first structured information and the first insurance category; and
generating, based on the first insurance category, a first workflow for the metadata, the first workflow including performing advanced data analysis associated with the first insurance category on the image data;

determining, based on performing the advanced data analysis on the image data, a type of structured information to indicate in the metadata;
generating a user interface;
in response to receiving unstructured data via the user interface, executing the trained ML model using the unstructured data as second input to generate second structured information of the type of structured information and a second insurance category of the insurance categories corresponding to the unstructured data as second output;
determining, based on the second insurance category, a second confidence score for the second structured information;
determining that the second confidence score is less than a second threshold; and
generating, based on determining that the second confidence score is less than the second threshold, a second workflow for the metadata, the second workflow including generating a notification to request additional documentation for the insurance claim.