Patent ID: 11928429
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system comprising:
a set of processing units; and
a non-transitory machine-readable medium storing instructions that when executed by at least one processing unit in the set of processing units cause the at least one processing unit to:
receive a plurality of datasets for training a sequence model, each dataset in the plurality of datasets comprising a sequence of correlated tokens;
generate a set of training data comprising a subset of a sequence of tokens from a first dataset in the plurality of datasets and a subset of a sequence of tokens from a second different dataset in the plurality of datasets, wherein the set of training data comprises a data structure having a defined length, wherein generating the set of training data comprises:
determining, for the sequence of tokens of each dataset in the plurality of datasets, a set of groups of tokens in the sequence of tokens,
determining, for each group of tokens in the set of groups of tokens of each sequence of tokens, a length of the group of tokens, wherein generating the set of training data is based on the lengths of the groups of tokens,
identifying a group of tokens in the sets of groups of tokens having a longest length equal to or less than the defined length of the data structure,
packing the data structure with the identified group of tokens, and
iteratively packing the data structure with a remaining group of tokens in the sets of groups of tokens having a longest length that is equal to or less than a remaining length in the data structure; and

train the sequence model using the set of training data.