Patent ID: 11900261
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A computer-implemented method, comprising:
accessing a plurality of pre-trained source code domain neural transformer models with attention, the plurality of pre-trained source code domain neural transformer models with attention including configurations of an encoder-only neural transformer with attention, a decoder-only neural transformer with attention and/or an encoder-decoder neural transformer with attention, each of the plurality of pre-trained source code domain neural transformer models with attention associated with a software engineering task;
obtaining a supervised training dataset for a specific software engineering task;
selecting one of the plurality of pre-trained source code domain neural transformer models with attention associated with the specific software engineering task; and
fine-tuning the selected one of the plurality of pre-trained source code domain neural transformer models with attention with the supervised training dataset to perform the specific software engineering task.