A method implemented by one or more processors, the method comprising: determining, by an automated assistant of a client device (110, 218, 320, 410) of a user (104, 316, 404) and based on a received input, that a smart device (108, 216, 314, 402) is to be configured by the user, the automated assistant having an interface; based on determining that the smart device is to be configured by the user: providing, via the automated assistant interface of the client device of the user, one or more initial instructions for configuring the smart device, the client device being separate from the smart device, wherein the one or more initial instructions include one or more steps to be performed by the user to configure the smart device; subsequent to providing the initial instructions, receiving, by the automated assistant, a hardware feedback communication generated by the smart device, wherein the hardware feedback communication is generated by the smart device in response to a physical interaction with the smart device by the user and wherein the hardware feedback communication indicates a configuration issue with the smart device; in response to receiving the hardware feedback communication, determining one or more further instructions for configuring the smart device, wherein the further instructions are tailored to address the configuration issue indicated by the hardware feedback communication and are determined based on the hardware feedback communication; and providing, via the automated assistant interface of the client device, the further instructions for configuring the smart device. determining, by an automated assistant of a client device (110, 218, 320, 410) of a user (104, 316, 404) and based on a received input, that a smart device (108, 216, 314, 402) is to be configured by the user, the automated assistant having an interface; based on determining that the smart device is to be configured by the user: providing, via the automated assistant interface of the client device of the user, one or more initial instructions for configuring the smart device, the client device being separate from the smart device, wherein the one or more initial instructions include one or more steps to be performed by the user to configure the smart device; providing, via the automated assistant interface of the client device of the user, one or more initial instructions for configuring the smart device, the client device being separate from the smart device, wherein the one or more initial instructions include one or more steps to be performed by the user to configure the smart device; subsequent to providing the initial instructions, receiving, by the automated assistant, a hardware feedback communication generated by the smart device, wherein the hardware feedback communication is generated by the smart device in response to a physical interaction with the smart device by the user and wherein the hardware feedback communication indicates a configuration issue with the smart device; in response to receiving the hardware feedback communication, determining one or more further instructions for configuring the smart device, wherein the further instructions are tailored to address the configuration issue indicated by the hardware feedback communication and are determined based on the hardware feedback communication; and providing, via the automated assistant interface of the client device, the further instructions for configuring the smart device.