A method for controlling a cooking appliance using a user's speech in a speech-based appliance control system including the cooking appliance and an audio input device configured to receive input of the user's speech, the cooking appliance including a first cooking unit and a second cooking unit the method comprising: Transmitting, to the cooking appliance via a first network, first cooking program information indicating a first cooking program, the first cooking program corresponding to a first cooking recipe, and second cooking program information indicating a second cooking program, the second cooking program corresponding to a second cooking recipe; in a case of receiving, from the audio input device, instruction information including first audio information indicating operation instructions for the cooking appliance when the first cooking unit is operated based on the first cooking program and the second cooking unit is operated based on the second cooking program, recognizing the operation instructions from the first audio information, The method being characterized in that it further comprises the steps of: determining, using a database configured to manage first cooking menu information indicating the name of a cooking menu item corresponding to the first cooking recipe and second cooking menu information indicating the name of a cooking menu item corresponding to the second cooking recipe, whether or not the received instruction information includes the first audio information and second audio information related to the first cooking menu information or the second cooking menu information; and in a case where it is determined that the received instruction information includes the second audio information, transmitting to the cooking appliance via the first network a control command for causing the cooking appliance to execute a process corresponding to the operation instructions, without executing a process that is based on the first cooking program or the second cooking program corresponding to one of the first cooking menu information or the second cooking menu information to which the second audio information is related. Transmitting, to the cooking appliance via a first network, first cooking program information indicating a first cooking program, the first cooking program corresponding to a first cooking recipe, and second cooking program information indicating a second cooking program, the second cooking program corresponding to a second cooking recipe; in a case of receiving, from the audio input device, instruction information including first audio information indicating operation instructions for the cooking appliance when the first cooking unit is operated based on the first cooking program and the second cooking unit is operated based on the second cooking program, recognizing the operation instructions from the first audio information, The method being characterized in that it further comprises the steps of: determining, using a database configured to manage first cooking menu information indicating the name of a cooking menu item corresponding to the first cooking recipe and second cooking menu information indicating the name of a cooking menu item corresponding to the second cooking recipe, whether or not the received instruction information includes the first audio information and second audio information related to the first cooking menu information or the second cooking menu information; and in a case where it is determined that the received instruction information includes the second audio information, transmitting to the cooking appliance via the first network a control command for causing the cooking appliance to execute a process corresponding to the operation instructions, without executing a process that is based on the first cooking program or the second cooking program corresponding to one of the first cooking menu information or the second cooking menu information to which the second audio information is related.