Patent ID: 11954448
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. The non-transitory machine-readable medium of claim 16, wherein the set of training data is a first set of training data, wherein the offset value is a first offset value, wherein the plurality of successive position values is a first plurality of successive position values, wherein the set of training data is a first set of training data, wherein the program further comprises sets of instructions for:
based on a second offset value, determining a second plurality of successive position values for the plurality of tokens, wherein each position value in the second plurality of successive position values represents a position of a token in the plurality of tokens relative to other tokens in the plurality of token;
generating a second set of training data to comprise the plurality of tokens and the second plurality of successive position values; and
training the transformer model using the second set of training data.