Patent ID: 11966663
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method comprising:
receiving, from a device, first audio data corresponding to a first spoken input;
determining, using the first audio data, automatic speech recognition (ASR) data corresponding to the first spoken input;
receiving, from the device, first widget context data corresponding to a first multi-modal widget being presented at the device, the first widget context data including a first widget identifier, a first skill identifier and first content being displayed at the device via the first multi-modal widget;
receiving, from the device, second widget context data corresponding to a second multi-modal widget being presented at the device, the second widget context data including a second widget identifier, a second skill identifier and second content being displayed at the device via the second multi-modal widget;
determining, using the ASR data, the first widget context data and the second widget context data, natural language understanding (NLU) data corresponding to the first spoken input, the NLU data including a first intent and a first entity corresponding to the first content;
based on the first entity corresponding to the first content and the first skill identifier included in the first widget context data, selecting, from among a plurality of skill components, a first skill component associated with the first skill identifier for processing the NLU data;
sending, to the first skill component, the NLU data and the first widget identifier;
receiving, from the first skill component, output data responsive to the first spoken input and corresponding to the first multi-modal widget;
sending, to the device, the output data; and
sending, to the device, a command to present the output data via the first multi-modal widget, the command causing the first multi-modal widget to display third content different from the first content.