A method implemented by one or more processors, the method comprising: processing audio data, wherein the audio data is based on detection of spoken input of a user at a client device, the client device including an automated assistant interface for interacting with the automated assistant; determining, based on processing of the audio data, that at least a portion of the audio data matches a user profile accessible to the automated assistant; identifying current contextual data associated with the audio data; identifying at least one probabilistic metric assigned to the user profile and corresponding to a particular speech recognition model, for a particular language, wherein identifying the at least one probabilistic metric is based on a correspondence between the current contextual data and the at least one probabilistic metric; and based on the at least one probabilistic metric satisfying a threshold: selecting the particular speech recognition model, for the particular language, for processing the audio data, and processing the audio data, using the particular speech recognition model for to the particular language, to generate text, in the particular language, that corresponds to the spoken input; and causing the automated assistant to provide responsive content that is determined based on the generated text, wherein the user profile further includes an additional probabilistic metric corresponding to at least one different speech recognition model, for a different language, and further comprising: based on the additional probabilistic metric failing to satisfy the threshold: refraining from processing the audio data using the different speech recognition model. processing audio data, wherein the audio data is based on detection of spoken input of a user at a client device, the client device including an automated assistant interface for interacting with the automated assistant; determining, based on processing of the audio data, that at least a portion of the audio data matches a user profile accessible to the automated assistant; identifying current contextual data associated with the audio data; identifying at least one probabilistic metric assigned to the user profile and corresponding to a particular speech recognition model, for a particular language, wherein identifying the at least one probabilistic metric is based on a correspondence between the current contextual data and the at least one probabilistic metric; and based on the at least one probabilistic metric satisfying a threshold: selecting the particular speech recognition model, for the particular language, for processing the audio data, and processing the audio data, using the particular speech recognition model for to the particular language, to generate text, in the particular language, that corresponds to the spoken input; and selecting the particular speech recognition model, for the particular language, for processing the audio data, and processing the audio data, using the particular speech recognition model for to the particular language, to generate text, in the particular language, that corresponds to the spoken input; and causing the automated assistant to provide responsive content that is determined based on the generated text, wherein the user profile further includes an additional probabilistic metric corresponding to at least one different speech recognition model, for a different language, and further comprising: based on the additional probabilistic metric failing to satisfy the threshold: refraining from processing the audio data using the different speech recognition model.