Patent ID: 11934801
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. A method for multi-modal program inference, the method performed by a computing system, the method comprising:
receiving a solution program description;
obtaining a set of initial candidate programs from a language model, the initial candidate programs based on at least a portion of the solution program description, wherein obtaining the set of program components from the language model comprises preparing a prompt, submitting the prompt to the language model, and extracting a program component from a prompt completion provided by the language model responsive to the prompt;
inferring program components by extraction from at least a portion of the initial candidate programs;
iteratively constructing a set of synthesized candidate programs from at least a portion of the inferred program components, the synthesized candidate programs constructed using at least program synthesis;
ranking at least two of the synthesized candidate programs or initial candidate programs or both relative to one another;
designating a top-ranked candidate program as a solution program, the solution program being consistent with the solution program description;
leveraging the solution program, wherein leveraging includes at least one of: executing the solution program, recommending execution of the solution program by configuring a user interface of the computing system, or listing a source code of the solution program by configuring the user interface; and
wherein the method is further characterized by at least one of: (a) the prompt includes a domain description, a sample question-answer pair, and a question that is not paired in the prompt with any answer, or (b) the prompt includes a sample question-answer pair, and the method further comprises choosing the sample question-answer pair for inclusion in the prompt at least in part by using a relevance metric, the relevance metric being based at least in part on a token rareness score.