Patent ID: 11972489
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 9:
10. A method, comprising:
receiving a trained model trained to extract text information from image input data classify the image input data with image input data classifications and based on payout amount, determine image quality data for the image input data, and determine confidence scores for the image input data classifications, wherein the trained model is trained using training data comprising samples of images in claims data and respective labeled metadata indicating payout amounts corresponding to the claims data;
generating a user portal to receive insurance claims documents;
receiving, from a computing device via the user portal, image data associated with an insurance claim from a user account;
executing the trained model using the image data as first input to generate first structured information comprising text data, a first insurance category, an image quality of the image data, and a first confidence score for the first insurance category as first output;
determining that the first confidence score meets or exceeds a first threshold;
based on the image quality, and on determining that the first confidence score meets or exceeds the first threshold:
generating metadata indicating the first structured information and the first insurance category; and
determining, based on the first insurance category, a first workflow for the metadata, the first workflow including performing advanced data analysis on the image data;

determining, based on performing advanced data analysis on the image data, a type of structured information to indicate in the metadata;
generating a user interface;
in response to receiving unstructured data via the user interface, executing the trained model using the unstructured data as second input to generate second structured information of the type of structured information and a second insurance category of the insurance categories corresponding to the unstructured data as second output;
determining, based on the second insurance category, a second confidence score for the second structured information;
determining that the second confidence score is less than a second threshold;
generating, based on determining that the second confidence score is less than the second threshold, a second workflow for the metadata, the second workflow including generating a notification for the unstructured data; and
causing to present, via the user portal, the notification for the user account.