Patent ID: 11972232
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A computer-implemented method, comprising:
pre-training a neural transformer model with attention with an unsupervised training dataset of source code to learn relationships between a method signature and a corresponding method body, wherein the neural transformer model with attention includes an attention component and a neural network component, wherein the attention component precedes the neural network component, wherein the attention component relates different positions of an input sequence given to the neural transformer model with attention in terms of queries Q, keys K, and values V;
fine-tuning the neural transformer model with attention with a supervised multi-modal training dataset of source code features to learn to generate a method body for a given method signature, wherein the fine-tuning performs a plurality of translation tasks, wherein each translation task uses an input sequence comprising one or more of an input docstring, an input method body, or input method signature for the neural transformer model with attention to learn to generate an associated method body, an associated method signature, an associated target docstring, or combination of the associated method body, the associated method signature, and the associated target docstring; and
applying the neural transformer model with attention to generate a first method body when provided a first method signature.