Patent ID: 11966663
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 4:
5. A computer-implemented method comprising:
receiving, from a device, first audio data corresponding to a first spoken input;
receiving, from the device, first data including a first widget identifier associated with a first multi-modal widget being presented at the device, the first data including a first skill identifier corresponding to the first multi-modal widget;
receiving, from the device, second data including a second widget identifier associated with a second multi-modal widget being presented at the device, the second data includes the first skill identifier corresponding to the second multi-modal widget;
determining, using the first audio data, the first data and the second data, natural language understanding (NLU) data corresponding to the first spoken input;
determining, using the first data and the second data, that the first spoken input corresponds to the first multi-modal widget; and
sending, to a first skill component associated with the first skill identifier, the NLU data and the first widget identifier.