A method implemented by one or more processors, the method comprising: receiving audio data corresponding to a spoken utterance of a user, the audio data being based on detection of the spoken utterance at a client device that includes an automated assistant interface for interacting with an automated assistant; processing the audio data using a first speech recognition model corresponding to a first language; determining , based on processing the audio data using the first speech recognition model, content that is responsive to the spoken utterance of the user; causing the client device to render the content to the user, wherein the content includes a prompt that solicits further input from the user; in response to determining the content includes the prompt, monitoring for additional spoken input; receiving , during the monitoring, additional audio data corresponding to an additional spoken utterance, the additional audio data being based on detection of the additional spoken utterance by the automated assistant interface of the client device; determining whether to utilize the first speech recognition model for the first language, or an alternative speech recognition model for a second language, in determining further responsive content to provide in response to the additional spoken utterance, wherein determining whether to utilize the first speech recognition model or the alternative speech recognition model in determining the further responsive content is based on a monitoring duration corresponding to a time period for the monitoring for the additional spoken input from the user, wherein as the monitoring duration increases, a probability of utilizing the alternative speech recognition model increases; and causing the client device to render the further responsive content. receiving audio data corresponding to a spoken utterance of a user, the audio data being based on detection of the spoken utterance at a client device that includes an automated assistant interface for interacting with an automated assistant; processing the audio data using a first speech recognition model corresponding to a first language; determining , based on processing the audio data using the first speech recognition model, content that is responsive to the spoken utterance of the user; causing the client device to render the content to the user, wherein the content includes a prompt that solicits further input from the user; in response to determining the content includes the prompt, monitoring for additional spoken input; receiving , during the monitoring, additional audio data corresponding to an additional spoken utterance, the additional audio data being based on detection of the additional spoken utterance by the automated assistant interface of the client device; determining whether to utilize the first speech recognition model for the first language, or an alternative speech recognition model for a second language, in determining further responsive content to provide in response to the additional spoken utterance, wherein determining whether to utilize the first speech recognition model or the alternative speech recognition model in determining the further responsive content is based on a monitoring duration corresponding to a time period for the monitoring for the additional spoken input from the user, wherein as the monitoring duration increases, a probability of utilizing the alternative speech recognition model increases; and causing the client device to render the further responsive content. <EOS>