Patent ID: 11915471
Assignee: SALESFORCE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. An apparatus comprising:
a processor; and
a non-transitory machine-readable storage medium that provides instructions that, if executed by a processor, are configurable to cause the processor to perform operations comprising:
identifying a multi-modal multi-task unified ontology classification dataset comprising a plurality of data examples, at least one data example associated with a product and comprising textual data describing the associated product and a plurality of images of the associated product;
creating a multi-task learning (MTL)-based single-stream transformer machine learning model to predict a plurality of categorical attributes of a product, the MTL-based single-stream transformer machine learning model comprising:
a preprocessing layer forming a single input sequence;
a transformer layer; and
an output layer comprising a plurality of task-specific classification heads, a task representing a prediction of a categorical attribute; and

training the visual-linguistic MTL-based single-stream transformer machine learning model, simultaneously across all tasks, based on the multi-modal multi-task unified ontology classification dataset using an alpha decay schedule and dynamically allocating task-specific parameters for at least one of the plurality of task-specific classification heads based on task complexity, leveraging positive inductive transfer, from related tasks, for low-resource tasks.