Patent ID: 11935530
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G

Claim 8:
9. A multimodal client device, comprising:
microphones;
sensors that are in addition to the microphones;
one or more speakers;
one or more displays;
memory storing instructions;
one or more processors executing the instructions to:
determine a client device action based on one or more instances of user interface input provided by a user via the microphones;
determine, based at least in part on sensor data from one or more of the sensors, a current client device modality,
wherein the current client device modality is one of a plurality of discrete client device modalities available for the multimodal client device, and

generate client device output for the client device action using a multimodal response,
wherein the multimodal response includes:
first output characteristics for the current client device modality and for the client device action, and
second output characteristics for a second client device modality and for the client device action, and

wherein in generating the client device output one or more of the processors are to select the first output characteristics in response to determining the current client device modality; and

cause the client device output to be rendered by the multimodal client device;
while at least part of the client device output is being rendered by the one or more user interface output devices of the multimodal client device:
detect, based at least in part on updated sensor data from the one or more sensors, a switch of the multimodal client device from the current client device modality to the second client device modality;
in response to detecting the switch, generate alternate client device output using the multimodal response, wherein in generating the alternate client device output one or more of the processors are to select the second output characteristics in response to detecting the switch to the second client device modality; and
cause the alternate client device output to be rendered by the multimodal client device.