Patent ID: 11923054
Assignee: UTECH PRODUCTS, INC.
Field: Medical technology (Instruments)
Classification: CPC G | IPC G

Claim 18:
19. A system, comprising:
a camera for collecting image data during a medical procedure;
a microphone for collecting speech during the medical procedure;
an image processing system that processes image data using an image classifier to identify image-based quality-of-care indicators (QIs);
a natural language (NL) processing system that processes unstructured NL captured from speech uttered during the procedure and is configured to:
create sentences from the unstructured NL;
perform a search and replace to locate informal medical expressions in the sentences and to replace informal medical expressions with standardized expressions from a medical dictionary, wherein the informal medical expressions are located using predefined text patterns determined with an automated learning process;
identify text-based QIs in the sentences;
classify sentences into sentence types based on a trained model; and
update sentences by integrating the image-based QIs with text-based QIs;

an editor for displaying and editing sentences, wherein the editor includes a next word prediction system that utilizes a predictive model, wherein training of the predictive model includes:
inputting a training set including word groups,
analyzing each word group to identify a next possible word and probability of the next possible word's appearance, and
building a word hierarchy based on frequency of word usage in the training set, and

an output module configured to output structured data that includes sentences organized by sentence type and images organized by image-based QIs.