Patent ID: 11907674
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 23:
24. A system comprising:
one or more processors; and
memory storing instructions that, when executed, the one or more processors are operable to:
receive natural language (NL) based input associated with a client device of a user;
generate a multi-modal response that is responsive to the NL based input, wherein, in generating the multi-modal response that is responsive to the NL based input, the one or more processors are operable to:
process, using a large language model (LLM), LLM input to generate LLM output, the LLM input including at least the NL based input; and
determine, based on the LLM output, textual content for inclusion in the multi-modal response and multimedia content for inclusion in the multi-modal response, wherein the textual content includes a plurality of textual segments, and wherein the multimedia content includes a multimedia content item; and

cause the multi-modal response to be rendered at the client device of the user, wherein, in causing the multi-modal response to be rendered at the client device of the user, the one or more processors are operable to:
cause the plurality of textual segments to be visually rendered via a display of the client device; and
cause the multimedia content item to be visually rendered via the display of the client device and/or via one or more speakers of the client device, wherein the multimedia content item is interleaved between a first textual segment, of the plurality of textual segments, and a second textual segment, of the plurality of textual segments.