A method for operating a virtual assistant on an electronic device, the method comprising: receiving, at the electronic device, an audio input; monitoring the audio input to identify a first spoken user input; identifying the first spoken user input in the audio input; determining whether to respond to the first spoken user input based on contextual information associated with the first spoken user input, wherein the contextual information comprises a direction of the user's eyes when the first spoken user input was received, wherein the determining comprises: calculating a likelihood score that the virtual assistant should respond to the first spoken user input based on the contextual information associated with the first spoken user input, wherein the calculating comprises: increasing the likelihood score in response to the direction of the user's eyes being pointed at the electronic device when the first spoken user input was received, and decreasing the likelihood score in response to the direction of the user's eyes being pointed away from the electronic device, when the first spoken user input was received; comparing the likelihood score to a threshold value; in accordance with a determination that the likelihood score is greater than the threshold value, determining to respond to the first spoken user input; and in accordance with a determination that the likelihood score is less than the threshold value, determining not to respond to the first spoken user input; in response to determining to respond to the first spoken user input: generating a response to the first spoken user input; and monitoring the audio input to identify a second spoken user input; and in response to determining not to respond to the first spoken user input: monitoring the audio input to identify the second spoken user input without generating the response to the first spoken user input. receiving, at the electronic device, an audio input; monitoring the audio input to identify a first spoken user input; identifying the first spoken user input in the audio input; determining whether to respond to the first spoken user input based on contextual information associated with the first spoken user input, wherein the contextual information comprises a direction of the user's eyes when the first spoken user input was received, wherein the determining comprises: calculating a likelihood score that the virtual assistant should respond to the first spoken user input based on the contextual information associated with the first spoken user input, wherein the calculating comprises: increasing the likelihood score in response to the direction of the user's eyes being pointed at the electronic device when the first spoken user input was received, and decreasing the likelihood score in response to the direction of the user's eyes being pointed away from the electronic device, when the first spoken user input was received; comparing the likelihood score to a threshold value; in accordance with a determination that the likelihood score is greater than the threshold value, determining to respond to the first spoken user input; and in accordance with a determination that the likelihood score is less than the threshold value, determining not to respond to the first spoken user input; calculating a likelihood score that the virtual assistant should respond to the first spoken user input based on the contextual information associated with the first spoken user input, wherein the calculating comprises: increasing the likelihood score in response to the direction of the user's eyes being pointed at the electronic device when the first spoken user input was received, and decreasing the likelihood score in response to the direction of the user's eyes being pointed away from the electronic device, when the first spoken user input was received; increasing the likelihood score in response to the direction of the user's eyes being pointed at the electronic device when the first spoken user input was received, and decreasing the likelihood score in response to the direction of the user's eyes being pointed away from the electronic device, when the first spoken user input was received; comparing the likelihood score to a threshold value; in accordance with a determination that the likelihood score is greater than the threshold value, determining to respond to the first spoken user input; and in accordance with a determination that the likelihood score is less than the threshold value, determining not to respond to the first spoken user input; in response to determining to respond to the first spoken user input: generating a response to the first spoken user input; and monitoring the audio input to identify a second spoken user input; and in response to determining not to respond to the first spoken user input: monitoring the audio input to identify the second spoken user input without generating the response to the first spoken user input. generating a response to the first spoken user input; and monitoring the audio input to identify a second spoken user input; and in response to determining not to respond to the first spoken user input: monitoring the audio input to identify the second spoken user input without generating the response to the first spoken user input.