Patent ID: 11887589
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system, comprising:
a set of servers; and
a device communicatively coupled with the set of servers and configured with computer-readable instructions to:
present a menu on a display;
receive, at a microphone of the device, first audio data indicating a wakeword and a first natural language utterance for interaction with the menu;
upon detecting the wakeword, send, to the set of servers, second audio data indicating the first natural language utterance;
receive, from the set of servers, instruction data about starting a first operational mode of the device, the first operational mode restricting, for a time period, first voice-based interactions via the microphone and not using the wakeword to a subset of a plurality of menu commands associated with content in view on the display, the menu commands defined in a language model that is stored on the device, wherein the device is configured to operate in a second operational mode that permits, for the time period, second voice-based interactions associated with the plurality of menu commands and using the wakeword;
receive, at the microphone and during the time period, third audio data indicating a second natural language utterance;
generate, from the third audio data, text data that corresponds to the second natural language utterance;
determine, by the language model, that semantics of the text data correspond to a menu command from the subset of the plurality of menu commands;
perform, the menu command; and
present, on the display, an outcome of performing the menu command.