Patent ID: 11941517
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors of a neural network training system, cause the one or more processors to:
select a plurality of machine learning tasks to predict a plurality of attributes of entities to train an entity representation generator for performing a downstream machine task;
train a multitask neural network (MNN) to perform the plurality of machine learning tasks, wherein the MNN comprises an encoder layer connected to a decoder layer including a plurality of decoders corresponding to the attributes, wherein the training causes the MNN to:
receive, via the encoder layer, a time-ordered sequence of events associated with an entity, wherein the entity includes multiple members associated with a user account;
generate, via the encoder layer, a member composition of the user account that indicates classes of the multiple members based at least in part on the time-ordered sequence of events;
generate, via the encoder layer, a fixed-size representation of the entity based at least in part on a time-ordered sequence of events and the member composition of the user account; and
perform, via the decoders, the machine learning tasks based at least in part on the fixed-size representation of the entity to output the different attributes of the entity;
wherein the training trains the encoder layer to encode signals of the plurality of attributes in fixed-size representations of entities;

after the MNN is trained, store the trained encoder as part of an entity representation generator; and
train a second machine learning model to perform the downstream machine learning task, wherein second machine learning model is trained using entity representations generated by the entity representation generator that includes the signals of the plurality of attributes associated with the plurality of machine learning tasks selected for the downstream machine learning task.