A method for providing contextual search results to ambiguous queries, the method comprising: receiving a search query during a presentation of a video ; in response to identifying that the search query comprises an auxiliary verb and no other verbs: accessing an audio sample received concurrently with the search query ; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text ; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred ; extracting, based on the time location, frames of a remote copy of the matched video ; accessing the extracted frames ; analyzing the plurality of frames to identify a performed action ; and retrieving a keyword associated with the identified action ; augmenting the search query by replacing the auxiliary verb with the retrieved keyword ; and performing a search based on the augmented search query ; and outputting results of the search . receiving a search query during a presentation of a video ; in response to identifying that the search query comprises an auxiliary verb and no other verbs: accessing an audio sample received concurrently with the search query ; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text ; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred ; extracting, based on the time location, frames of a remote copy of the matched video ; accessing the extracted frames ; analyzing the plurality of frames to identify a performed action ; and retrieving a keyword associated with the identified action ; augmenting the search query by replacing the auxiliary verb with the retrieved keyword ; and performing a search based on the augmented search query ; and outputting results of the search . accessing an audio sample received concurrently with the search query ; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text ; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred ; extracting, based on the time location, frames of a remote copy of the matched video ; performing speech to text analysis of the audio sample to generate sample text ; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred ; extracting, based on the time location, frames of a remote copy of the matched video ; accessing the extracted frames ; analyzing the plurality of frames to identify a performed action ; and retrieving a keyword associated with the identified action ; augmenting the search query by replacing the auxiliary verb with the retrieved keyword ; and performing a search based on the augmented search query ; and outputting results of the search . <EOS>