Patent ID: 11900261
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A computer-implemented method, comprising:
providing a plurality of source code domain neural transformer models with attention, wherein each of the plurality of source code domain neural transformer models includes a memory size and a model size, wherein the model size indicates a number of transformer blocks;
receiving, through a network, a request for a custom neural transformer model with attention, wherein the request includes a configuration of transformer blocks of the custom neural transformer model with attention; and
when none of the plurality of source code domain neural transformer models with attention meets the requested configuration of transformer blocks:
selecting one of the plurality of source code domain neural transformer models with attention associated with a larger model size closest to the requested configuration of transformer blocks;
eliminating select ones of the transformer blocks of the selected one of the plurality of source code domain neural transformer models with attention; and
fine-tuning the select one of the plurality of source code domain neural transformer models with attention with a custom training dataset to generate the custom neural transformer model with attention.