A method for providing contextual search results to ambiguous queries, the method comprising: receiving a search query during a presentation of a video; in response to identifying that the search query comprises an auxiliary verb and no other verbs: accessing an audio sample received concurrently with the search query; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred; extracting, based on the time location, frames of a remote copy of the matched video (814, 816, 820); accessing the extracted frames; analyzing the plurality of frames to identify a performed action; and retrieving a keyword associated with the identified action; augmenting the search query by replacing the auxiliary verb with the retrieved keyword; and performing a search based on the augmented search query; and outputting results of the search. receiving a search query during a presentation of a video; in response to identifying that the search query comprises an auxiliary verb and no other verbs: accessing an audio sample received concurrently with the search query; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred; extracting, based on the time location, frames of a remote copy of the matched video (814, 816, 820); accessing the extracted frames; analyzing the plurality of frames to identify a performed action; and retrieving a keyword associated with the identified action; augmenting the search query by replacing the auxiliary verb with the retrieved keyword; and performing a search based on the augmented search query; and outputting results of the search. accessing an audio sample received concurrently with the search query; determining, by calculating a frequency signature of the audio sample, if the received audio sample matches a video from a database of video programming and, in response to determining that the received audio sample matches a video from the database: performing speech to text analysis of the audio sample to generate sample text; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred; extracting, based on the time location, frames of a remote copy of the matched video (814, 816, 820); performing speech to text analysis of the audio sample to generate sample text; searching, with the sample text, metadata of the matched video to identify a time location in the video where the audio sample occurred; extracting, based on the time location, frames of a remote copy of the matched video (814, 816, 820); accessing the extracted frames; analyzing the plurality of frames to identify a performed action; and retrieving a keyword associated with the identified action; augmenting the search query by replacing the auxiliary verb with the retrieved keyword; and performing a search based on the augmented search query; and outputting results of the search.