Patent ID: 11907674
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method implemented by one or more processors, the method comprising:
receiving natural language (NL) based input associated with a client device of a user;
generating a multi-modal response that is responsive to the NL based input, wherein generating the multi-modal response that is responsive to the NL based input comprises:
processing, using a large language model (LLM), LLM input to generate LLM output, the LLM input including at least the NL based input;
determining, based on the LLM output, textual content for inclusion in the multi-modal response and a multimedia content tag that is indicative of multimedia content that is to be included in the multi-modal response; and
obtaining, based on the multimedia content tag, the multimedia content for inclusion in the multi-modal response; and

causing the multi-modal response to be rendered at the client device of the user.