Patent ID: 9570070
Date: 2017-02-14
CPC Classifications: G06Q,G10L

Claim:
1. A method for processing one or more multi-modal device interactions, received from a user, in a natural language voice services environment that includes a plurality of components that handle requests relating to the multi-modal device interact, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions that, when executed by the one or more physical processors, program the computer system to perform the method, the method comprising: detecting, by the computer system, at least one multi-modal device interaction, wherein the multi-modal device interaction includes a non-voice interaction, from the user, with at least one of the plurality of components or an application associated with at least one of the plurality of components, and wherein the multi-modal device interaction further includes at least one natural language utterance, from the user, relating to the non-voice interaction; determining, by the computer system, a context relating to the non-voice interaction and a context relating to the natural language utterance; determining, by the computer system, an intent of the multi-modal device interaction based on the context relating to the non-voice interaction and the context of the natural language utterance; generating, by the computer system, a request based on the determined intent; obtaining, by the computer system, information indicating a capability of a component, from among the plurality of components, based on a constellation model that specifies the capabilities of each of the plurality of components; determining, by the computer system, that the component should handle the request based on the capability of the component; and routing, by the computer system, the request to the component.