A method comprising: receiving audio data generated by one or more microphones of a computing device, the audio data representing a spoken utterance; identifying, based on the audio data, a user that provided the spoken utterance; identifying, by one or more processors and based on the audio data, an automation action associated with one or more automation devices, the automation action corresponding to the spoken utterance, wherein identifying the automation action comprises: determining, based on the audio data, a plurality of automation action candidates, determining, for each of the automation action candidates, a score that indicates a likelihood that the automation action candidate corresponds to the spoken utterance, adjusting the score for one or more of the automation action candidates based on: the identified user being authorized to cause performance of one or more of the automation action candidates, or the automation action candidates corresponding to automation actions which are configured for use by users of the computing device, and selecting, based on the score for each of the automation action candidates, a given automation action candidate as the identified automation action; determining, by the one or more processors, whether the identified user is authorized to cause performance of the identified automation action; and responsive to determining that the identified user is authorized to cause performance of the identified automation action, causing, by the one or more processors, the one or more automation devices to perform the identified automation action. receiving audio data generated by one or more microphones of a computing device, the audio data representing a spoken utterance; identifying, based on the audio data, a user that provided the spoken utterance; identifying, by one or more processors and based on the audio data, an automation action associated with one or more automation devices, the automation action corresponding to the spoken utterance, wherein identifying the automation action comprises: determining, based on the audio data, a plurality of automation action candidates, determining, for each of the automation action candidates, a score that indicates a likelihood that the automation action candidate corresponds to the spoken utterance, adjusting the score for one or more of the automation action candidates based on: the identified user being authorized to cause performance of one or more of the automation action candidates, or the automation action candidates corresponding to automation actions which are configured for use by users of the computing device, and selecting, based on the score for each of the automation action candidates, a given automation action candidate as the identified automation action; determining, based on the audio data, a plurality of automation action candidates, determining, for each of the automation action candidates, a score that indicates a likelihood that the automation action candidate corresponds to the spoken utterance, adjusting the score for one or more of the automation action candidates based on: the identified user being authorized to cause performance of one or more of the automation action candidates, or the automation action candidates corresponding to automation actions which are configured for use by users of the computing device, and the identified user being authorized to cause performance of one or more of the automation action candidates, or the automation action candidates corresponding to automation actions which are configured for use by users of the computing device, and selecting, based on the score for each of the automation action candidates, a given automation action candidate as the identified automation action; determining, by the one or more processors, whether the identified user is authorized to cause performance of the identified automation action; and responsive to determining that the identified user is authorized to cause performance of the identified automation action, causing, by the one or more processors, the one or more automation devices to perform the identified automation action.