A method implemented by one or more processors, the method comprising: determining that a spoken utterance, detected via an automated assistant interface, includes a request to modify a state of a connected device that is linked with a client device, wherein the spoken utterance is provided by a user; identifying, in response to receiving the request, a first function that corresponds to the request and first slot values being control parameters for controlling the first function; causing, based on identifying the first function, the connected device to perform the first function that corresponds to the request; determining a current state of the connected device, wherein the current state of the connected device is affected by performance of the first function; identifying one or more other functions, capable of being performed by the connected device, and other slot values for the one or more other functions, wherein the current state of the connected device is further affected by performance of the one or more other functions; determining, based on identifying the first function and the one or more other functions, a first graphical control element based on the number and/or type of the first slot values for enabling a user to select one of the first slot values to control the first function performed by the connected device and a second graphical control element based on the number and/or type of the other slot values for enabling a user to select one or more of the other slot values to control the one or more other functions; determining, based on the current state of the connected device, a configuration for each graphical control element of the first graphical control element and the second graphical control element; and causing, in response to receiving the request, a display panel, which is associated with the client device and separate from the connected device, to provide a composite graphical assistant interface for controlling the connected device, wherein the composite graphical assistant interface includes the first graphical control element and the second graphical control element, which are arranged according to the determined configuration for each graphical control element. determining that a spoken utterance, detected via an automated assistant interface, includes a request to modify a state of a connected device that is linked with a client device, wherein the spoken utterance is provided by a user; identifying, in response to receiving the request, a first function that corresponds to the request and first slot values being control parameters for controlling the first function; causing, based on identifying the first function, the connected device to perform the first function that corresponds to the request; determining a current state of the connected device, wherein the current state of the connected device is affected by performance of the first function; identifying one or more other functions, capable of being performed by the connected device, and other slot values for the one or more other functions, wherein the current state of the connected device is further affected by performance of the one or more other functions; determining, based on identifying the first function and the one or more other functions, a first graphical control element based on the number and/or type of the first slot values for enabling a user to select one of the first slot values to control the first function performed by the connected device and a second graphical control element based on the number and/or type of the other slot values for enabling a user to select one or more of the other slot values to control the one or more other functions; determining, based on the current state of the connected device, a configuration for each graphical control element of the first graphical control element and the second graphical control element; and causing, in response to receiving the request, a display panel, which is associated with the client device and separate from the connected device, to provide a composite graphical assistant interface for controlling the connected device, wherein the composite graphical assistant interface includes the first graphical control element and the second graphical control element, which are arranged according to the determined configuration for each graphical control element.