Patent ID: 11900261
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A web service, comprising:
a storage server including a custom training dataset;
a first computing device having a first processor and a first memory device, wherein the first memory device includes a plurality of source code domain neural transformer models with attention, the plurality of source code domain neural transformer models with attention including configurations of an encoder-only neural transformer with attention, a decoder-only neural transformer with attention and/or an encoder-decoder neural transformer with attention, wherein each of the plurality of source code domain neural transformer models with attention associated with a select software engineering task;
wherein the first memory device includes a program including instructions that perform actions to:
receive a request for a custom neural transformer model with attention to perform a requested software engineering task;
obtain the custom training dataset;
select one of the plurality of source code domain neural transformer models with attention associated with the requested software engineering task; and
fine-tune the select one of the plurality of source code domain neural transformer models with attention with the custom training dataset to generate the custom neural transformer model with attention.