Patent ID: 11972232
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A device, comprising:
at least one processor and a memory; wherein the at least one processor is configured to perform actions to:
train a neural transformer model with attention to learn to construct a method body from a plurality of unsupervised training data, the plurality of unsupervised training data including method bodies and method signatures derived from source code programs, wherein the neural transformer model with attention includes an attention component and a neural network component, wherein the attention component differs from the neural network component, wherein the attention component relates different positions of an input sequence given to the neural transformer model with attention in terms of queries Q, keys K, and values V;
train the neural transformer model with attention to learn to generate a method body given a method signature by fine-tuning the neural transformer model with attention on a plurality of translation tasks, wherein each translation task uses an input sequence comprising one or more of an input docstring, an input method body, or an input method signature for the neural transformer model with attention to learn to generate an associated method body, an associated method signature, an associated target docstring, or a combination of the associated method body, the associated method signature, and the associated target docstring; and
utilize the neural transformer model with attention to predict a target method body, given a specific method signature.