Patent ID: 9223776
Filing Date: 2015-12-29
Classification: G06F,G10L,Y10S

Abstract:
1. A query system, comprising: a computing device communicatively coupled to a network and configured to receive a plurality of inputs; wherein at least one of said inputs is an audio query and another of said inputs is a visual input; a speech server communicatively coupled to the computing device via the network, wherein the speech server is configured to receive the audio query from the computing device, convert the audio query into a text query and return the text query to said computing device; a mediated reality server communicatively coupled to the computing device via the network, wherein the mediated reality server is configured to receive and process the visual input to determine data relevant to said visual input and return said data relevant to said visual input to said computing device; and a remote server communicatively coupled to the computing device via the network, wherein the remote server is configured to receive said text query and at least a portion of said data relevant to said visual input and based on the received text query and the at least a portion of said data relevant to said visual input determine a response to the query.