Patent ID: 11861884
Assignee: INTUIT INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by a processor of a processing system, cause the processing system to perform operations, the operations comprising:
pre-training a first multimodal transformer model on an unlabeled dataset comprising documents including first text features and first layout features;
training a second multimodal transformer model on a first labeled dataset comprising documents including second text features and second layout features to perform a key information extraction task;
processing the unlabeled dataset with the second multimodal transformer model to generate pseudo-labels for the unlabeled dataset;
training the first multimodal transformer model to perform the key information extraction task based on (i) a second labeled dataset comprising one or more labels, (ii) the pseudo-labels generated by the second multimodal transformer model, or (iii) combinations thereof, in order to generate a third multimodal transformer model;
processing the unlabeled dataset with the third multimodal transformer model to generate updated pseudo-labels for the unlabeled dataset; and
training the third multimodal transformer model using a noise-aware loss function and the updated pseudo-labels to generate an updated third multimodal transformer model.