Patent ID: 11861884
Assignee: INTUIT INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A processing system, comprising: a memory comprising computer-executable instructions; and a processor configured to execute the computer-executable instructions and cause the processing system to:
pre-train, via a pre-training component, a first multimodal transformer model on an unlabeled dataset comprising documents including first text features and first layout features;
train, via a training component, a second multimodal transformer model on a first labeled dataset comprising documents including second text features and second layout features to perform a key information extraction task;
process, via a processing component, the unlabeled dataset with the second multimodal transformer model to generate pseudo-labels for the unlabeled dataset;
train, via the training component, the first multimodal transformer model to perform the key information extraction task based on (i) a second labeled dataset comprising one or more labels, (ii) the pseudo-labels generated by the second multimodal transformer model, or (iii) combinations thereof, in order to generate a third multimodal transformer model;
process, via a generating component, the unlabeled dataset with the third multimodal transformer model to generate updated pseudo-labels for the unlabeled dataset; and
train, via the training component, the third multimodal transformer model using a noise-aware loss function and the updated pseudo-labels to generate an updated third multimodal transformer model.