Patent Description:
AI apparatuses such as mobile terminals and smart speakers that understand and operate the language spoken by humans are becoming widespread in our daily lives. By using the AI apparatus, the user can operate a home electrical apparatus such as a television by voice without operating a remote controller or the like. For example, PTL <NUM> discloses a mobile terminal device that outputs a voice message asking whether or not to turn on the power of the air conditioner together with a voice such as "hot" or "cold", based on the temperature detected by a temperature sensor, and transmits a control command for turning on the air conditioner to the air conditioner when the sound of "turn on" is said by the user.

PTL <NUM> and PTL <NUM> are also known and disclose control methods for air conditioning systems. PTL <NUM> presents a method by which an electronic device provides information corresponding to a voice request uttered by a user. PTL <NUM> and PTL <NUM> describe electronic devices able to record a voice request uttered by a user and to forward it to a voice server.

The technique described in PTL <NUM> is a method in which a person operates a home electrical apparatus such as an air conditioner by using a dedicated mobile terminal device. PTL <NUM> does not disclose a technique for home electrical apparatuses to utilize AI apparatuses. For example, it is not disclosed that an air conditioner requests information necessary for air conditioning control such as room temperature from a mobile terminal device (AI apparatus) and obtains room temperature information from the mobile terminal device. Further, in order to enable such control, it is necessary to establish dedicated communication between the AI apparatus and the air conditioner, so it is necessary to request the AI apparatus manufacturer to develop the communication such that the communication can be performed.

The present invention provides a control device according to claim <NUM>, a control method according to claim <NUM>, and a program according to claim <NUM> capable of solving the above-described problems.

A control device according to the present invention is defined in claims <NUM> and <NUM>.

The present invention also relates to a control method as defined in claim <NUM>.

The present invention also relates to a program as defined in claim <NUM>.

According to the control device, the apparatus control system, the control method and the program described above, the control device of the home electrical apparatus can autonomously control the home electrical apparatus by utilizing the AI apparatus.

Hereinafter, an apparatus control system according to an embodiment of the present invention will be described with reference to <FIG>.

<FIG> is a block diagram illustrating an example of the apparatus control system according to the embodiment of the present invention.

An apparatus control system <NUM> includes a home electrical apparatus <NUM> and an artificial intelligence (AI) apparatus <NUM>. The apparatus control system <NUM> may also include a remote controller (not illustrated) for operating the home electrical apparatus <NUM>. In the apparatus control system <NUM>, the home electrical apparatus <NUM> is controlled by the home electrical apparatus <NUM> and the AI apparatus <NUM> communicating with each other using the natural language spoken by humans. Here, the home electrical apparatus <NUM> is, for example, an air conditioning apparatus such as an air conditioner, a humidifier, a dehumidifier, a stove, and an air purifier. Alternatively, the home electrical apparatus <NUM> may be a television, an audio device, a washing machine, a refrigerator, a rice cooker, or the like. Further, the AI apparatus <NUM> is, for example, a smart speaker, a mobile terminal device equipped with a voice assist system that enables voice recognition, language understanding, and dialogue. Further, the AI apparatus <NUM> is provided with a communication means, and has a function of connecting to the Internet and acquiring various types of information. In addition, the AI apparatus <NUM> is equipped with various sensors and can measure information such as temperature, humidity, and acceleration.

The home electrical apparatus <NUM> includes a control device <NUM>, a speaker <NUM>, a microphone <NUM>, a sensor <NUM>, and various units such as hardware, actuators, and electric/electronic circuits (not illustrated). The control device <NUM> includes an inquiry unit <NUM>, an information acquisition unit <NUM>, a control unit <NUM>, a communication unit <NUM>, and a setting reception unit <NUM>.

The inquiry unit <NUM> requests the AI apparatus <NUM> for information necessary for controlling the home electrical apparatus <NUM>. The inquiry unit <NUM> includes an inquiry information generation unit <NUM>, and a voice output control unit <NUM>.

The inquiry information generation unit <NUM> generates "inquiry information" for inquiring to the AI apparatus <NUM>. The inquiry information includes content requesting information necessary for controlling the home electrical apparatus <NUM>. Further, the inquiry information generation unit <NUM> generates various types of command information (for example, keywords necessary at the start of dialogue) based on the protocol necessary for communicating with the AI apparatus <NUM>. Alternatively, the inquiry information generation unit <NUM> may generate inquiry information by preparing a plurality of pieces of inquiry information in advance for acquiring information expected to be necessary for control and selecting necessary information from the plurality of pieces of prepared information.

The voice output control unit <NUM> performs a control to output the inquiry information generated by the inquiry information generation unit <NUM> from the speaker <NUM>. For example, the voice output control unit <NUM> sets the frequency of the voice output from the speaker <NUM> to a predetermined frequency band in the audible range or the non-audible range (for example, <NUM> or more or less than <NUM>). For example, the voice output control unit <NUM> sets the language output from the speaker <NUM> to a predetermined language (English, Japanese, or the like). For example, the voice output control unit <NUM> sets the utterance speed of the natural language output from the speaker <NUM> to a predetermined speed. The voice output control unit <NUM> outputs voice information based on these settings from the speaker <NUM>.

It is assumed that the AI apparatus <NUM> is configured to be able to recognize voice information in the non-audible range and output the voice information in the non-audible range. For example, the inquiry information generated by the inquiry information generation unit <NUM> includes the identification information on the home electrical apparatus <NUM>, or the like, and when the AI apparatus <NUM> recognizes the voice information including the identification information, the AI apparatus <NUM> may be configured to respond by outputting the voice information in the non-audible range. Alternatively, when voice information in a non-audible range such as ultrasonic waves is output from the home electrical apparatus <NUM>, the AI apparatus <NUM> may be configured to respond by outputting voice information in the non-audible range, and when the home electrical apparatus <NUM> makes an inquiry by outputting voice information in the audible range, the AI apparatus <NUM> may be configured to respond by outputting voice information in the audible range.

The information acquisition unit <NUM> acquires information necessary for controlling the home electrical apparatus <NUM> from the AI apparatus <NUM> and the sensor <NUM>. The information acquisition unit <NUM> includes a voice information recognition unit <NUM> and a sensor information acquisition unit <NUM>.

The voice information recognition unit <NUM> has a voice recognition function and a language understanding function of a plurality of languages such as Japanese and English. The voice information recognition unit <NUM> acquires the voice information output by the AI apparatus <NUM> via the microphone <NUM>, and recognizes the content thereof. The voice information recognition unit <NUM> extracts the answer information to the inquiry from the recognized contents, and outputs the answer information to the control unit <NUM>.

The sensor information acquisition unit <NUM> acquires the sensor information measured by the sensor <NUM> included in the home electrical apparatus <NUM>. The sensor information acquisition unit <NUM> outputs, to the control unit <NUM>, the sensor information acquired from the sensor <NUM>. The sensor <NUM> is a general term for sensors included in the home electrical apparatus <NUM>, and may include a plurality of sensors. The type of sensor included in the sensor <NUM> varies depending on the type of the home electrical apparatus <NUM>.

The control unit <NUM> operates the hardware unit, the actuator, the electronic circuit, and the like of the home electrical apparatus <NUM> based on the information acquired from the information acquisition unit <NUM>, and performs control such that the functions of the home electrical apparatus <NUM> are exhibited. Further, when the control unit <NUM> determines that it is necessary to acquire the information necessary for control from the AI apparatus <NUM>, the control unit <NUM> instructs the inquiry unit <NUM> to execute an inquiry to the AI apparatus <NUM>.

The communication unit <NUM> communicates with the remote controller of the home electrical apparatus <NUM> and the AI apparatus <NUM> by infrared communication, Bluetooth (registered trademark), or the like. As will be described later, communication between the home electrical apparatus <NUM> and the AI apparatus <NUM> is performed by outputting voice information in natural language from the home electrical apparatus <NUM> to the AI apparatus <NUM>. On the other hand, from the AI apparatus <NUM> to the home electrical apparatus <NUM>, it is also possible to transmit a control signal including answer information to the inquiry, in addition to the output of the voice information in natural language.

The setting reception unit <NUM> receives settings of a language to be output by the inquiry unit <NUM> and a language to be understood, a setting for an utterance speed of voice information on the inquiry, and a setting for a frequency band of the voice information, and the like. The inquiry unit <NUM> and the voice information recognition unit <NUM> generate inquiry information, output and recognize voice information, based on the settings received by the setting reception unit <NUM>.

For example, by setting the frequency band of voice information to a non-audible range (high frequency or low frequency), the home electrical apparatus <NUM> and the AI apparatus <NUM> can communicate without being perceived by the user. Further, by setting the utterance speed to be high, the communication time can be shortened. It should be noted that the user may communicate using voice information in the audible range, according to his/her needs. Further, since these items can be set, it is possible to set such that communication can be performed according to the specifications of the AI apparatus <NUM>.

Next, the operation of the apparatus control system <NUM> will be described.

<FIG> is a diagram illustrating an example of the operation of the apparatus control system according to the embodiment of the present invention.

First, the user says a predetermined start keyword to the AI apparatus <NUM>, and then says a voice instructing the start of the home electrical apparatus <NUM>. Then, the AI apparatus <NUM> transmits a start instruction to the home electrical apparatus <NUM> (step S11). The AI apparatus <NUM> may instruct the home electrical apparatus <NUM> to start, by outputting predetermined voice information such as "Start the home electrical apparatus <NUM>" in a predetermined language. Alternatively, the AI apparatus <NUM> may transmit a start instruction signal to the home electrical apparatus <NUM> via infrared communication or the like. When instructing the start by voice, the AI apparatus <NUM> may output voice information by ultrasonic waves in a non-audible region (for example, <NUM> or more).

The home electrical apparatus <NUM> acquires the start instruction output by the AI apparatus <NUM>. When the AI apparatus <NUM> outputs a start instruction by voice information, the microphone <NUM> acquires the voice information and outputs the voice information to the voice information recognition unit <NUM>. The voice information recognition unit <NUM> recognizes the content of the voice information, extracts the start instruction information, and outputs the start instruction information to the control unit <NUM>. On the other hand, when the AI apparatus <NUM> transmits a non-verbal start instruction signal, the communication unit <NUM> receives the start instruction signal. The communication unit <NUM> outputs a start instruction signal to the control unit <NUM>. The control unit <NUM> starts the home electrical apparatus <NUM> (step S12).

Next, the control unit <NUM> requests the inquiry unit <NUM> for information (initial information) necessary for control. For example, when the home electrical apparatus <NUM> is an air conditioning apparatus, the control unit <NUM> requests the inquiry unit <NUM> for the room temperature and the weather information. In the inquiry unit <NUM>, the inquiry information generation unit <NUM> first creates a sentence including keywords ("Alexa", "OK Google", or the like) necessary for starting the dialogue. Further, the inquiry information generation unit <NUM> generates, following the sentence, for example, a sentence requesting information necessary for control such as "Please tell me the room temperature and weather information" in the set language (step S13). Alternatively, a plurality of text files in which sentences requesting information necessary for control are stored and voice files for outputting sentences requesting necessary information are prepared in advance, and the inquiry information generation unit <NUM> may select the text file or voice file corresponding to the contents of the inquiry this time. For example, the inquiry information generation unit <NUM> selects a voice file that outputs "Please tell me the room temperature" and a voice file that outputs "Please tell me the weather" in the language for which the setting reception unit <NUM> receives the setting.

The inquiry information generation unit <NUM> outputs the created sentence to the voice output control unit <NUM>. Alternatively, the inquiry information generation unit <NUM> outputs the selected voice file to the voice output control unit <NUM>. The voice output control unit <NUM> outputs the voice information from the speaker <NUM>, by reading out the sentence acquired from the inquiry information generation unit <NUM> and playing back the voice file. The voice output control unit <NUM> outputs voice information in the frequency band and utterance speed for which the setting reception unit <NUM> has received the setting, and makes an inquiry by using voice (step S14).

The AI apparatus <NUM> acquires the inquiry information by voice. The AI apparatus <NUM> accesses the Internet and acquires weather information and temperature information. Alternatively, the AI apparatus <NUM> acquires the temperature detected by the temperature sensor included in the AI apparatus <NUM>. The AI apparatus <NUM> responds to an inquiry from the home electrical apparatus <NUM>, by outputting voice information or transmitting a control signal (step S15).

The home electrical apparatus <NUM> acquires the information returned from the AI apparatus <NUM>. When the AI apparatus <NUM> responds by using voice, the voice information recognition unit <NUM> acquires the voice information returned via the microphone <NUM> and recognizes the content of the response. The voice information recognition unit <NUM> outputs the recognized temperature and weather information to the control unit <NUM>. On the other hand, when the AI apparatus <NUM> responds with a non-verbal control signal, the communication unit <NUM> receives the control signal. The communication unit <NUM> outputs a control signal to the control unit <NUM>. The control unit <NUM> starts the operation of the home electrical apparatus <NUM> based on the returned information (step S16).

The control unit <NUM> determines whether or not to make an inquiry to the AI apparatus <NUM> while continuing the operation of the home electrical apparatus <NUM> (step S17). For example, the control unit <NUM> determines that inquiries with the same content are made at predetermined time intervals. Alternatively, the control unit <NUM> determines to make an inquiry, for example, when other type of information is required, based on the information detected by the sensor <NUM> or the response from the AI apparatus <NUM>. When an inquiry is required (step S17; Yes), the control unit <NUM> designates the contents to be inquired to the inquiry unit <NUM> and instructs the AI apparatus <NUM> to make an inquiry.

The inquiry information generation unit <NUM> generates a sentence requesting the information designated by the control unit <NUM>, and selects a voice file for acquiring the designated information. The voice output control unit <NUM> makes a voice inquiry by, for example, outputting voice information in a non-audible range from the speaker <NUM> by playing back a selected voice file (step S18).

The AI apparatus <NUM> acquires the inquiry information by voice. The AI apparatus <NUM> acquires the inquired information from the Internet or the like. Alternatively, the AI apparatus <NUM> may communicate with another device to acquire the inquired information. The AI apparatus <NUM> responds to an inquiry of the home electrical apparatus <NUM> by outputting voice information or transmitting a control signal (step S19).

The control unit <NUM> determines whether or not to stop the operation of the home electrical apparatus <NUM>, and repeats the processes after step S17 when the operation is not to be stopped (step S1A; No).

On the other hand, when the stop instruction by voice information is output from the AI apparatus <NUM>, the voice information recognition unit <NUM> acquires the voice information via the microphone <NUM> and recognizes the stop instruction. The voice information recognition unit <NUM> outputs stop instruction information to the control unit <NUM>. The control unit <NUM> stops the operation of the home electrical apparatus <NUM>. Further, when the non-verbal stop instruction signal is transmitted from the AI apparatus <NUM>, the communication unit <NUM> receives the stop instruction signal and outputs it to the control unit <NUM>. The control unit <NUM> stops the operation of the home electrical apparatus <NUM> (step S1B).

According to the present embodiment, the control device <NUM> can acquire information necessary for controlling the home electrical apparatus <NUM> by communicating with the AI apparatus <NUM>. Thus, the control device <NUM> can autonomously control the home electrical apparatus <NUM> by utilizing the AI apparatus <NUM>. Further, since the function of the AI apparatus <NUM> (smart speaker or the like) having the function of dialogue in natural language is used, it is possible to use the home electrical apparatus <NUM> as if it has an artificial intelligence, without requesting the smart speaker maker for development. Further, by outputting the voice information exchanged between the control device <NUM> and the AI apparatus <NUM> in a non-audible range, the voice information can be used in a scene where the voice is not desired to be heard, such as at night or in a place where many people gather.

Further, since it is considered that the AI apparatus <NUM> is likely to be disposed near the user, it is possible to sense information necessary for control at a position close to the user and feed it back for the control of the home electrical apparatus <NUM>. For example, when the AI apparatus <NUM> is provided with a humidity sensor and the home electrical apparatus <NUM> is a humidifier or a dehumidifier, control based on the humidity at the position where the user is present can be performed. For example, when the AI apparatus <NUM> is provided with a temperature sensor and the home electrical apparatus <NUM> is an air conditioner, control based on the temperature at the position where the user is present can be performed. Further, when an audio device is applied to the home electrical apparatus <NUM>, the audio device can analyze the sound received by the AI apparatus <NUM> and can perform control such that a better sound reaches the position (user's position) where the AI apparatus <NUM> is disposed.

Further, since the AI apparatus <NUM> can connect to the Internet and acquire various types of information, various types of information can be acquired via the AI apparatus <NUM> without mounting the function of acquiring the information from the Internet on the home electrical apparatus <NUM>.

Next, the control when the apparatus control system <NUM> is applied to the control of the air conditioner will be described with reference to <FIG>.

<FIG> is a diagram illustrating an example of an air conditioning control system.

As illustrated in <FIG>, an air conditioner 10a is provided on the wall on the back side of the room A. The AI apparatus <NUM> is installed on the front side of the room A. The user M has a remote controller <NUM> of the air conditioner 10a. The air conditioner 10a includes a control device 100a. As illustrated in <FIG>, the control device 100a includes functional units (the inquiry unit <NUM>, the information acquisition unit <NUM>, the control unit <NUM>, the communication unit <NUM>, and the setting reception unit <NUM>) similar to the control device <NUM>. Further, the control device 100a is connected to the speaker <NUM>, the microphone <NUM>, the temperature sensor 220a, the humidity sensor 220b, and the motion sensor 220c. The temperature sensor 220a and the humidity sensor 220b are provided, for example, near the suction port of the indoor unit of the air conditioner 10a. The motion sensor 220c is provided on the ceiling of the room A, for example.

<FIG> is a first flowchart illustrating an example of the operation of the air conditioning control system.

First, the user M instructs the AI apparatus <NUM> to start the air conditioner 10a by operating the remote controller <NUM> or by giving a voice instruction to the AI apparatus <NUM>. In the air conditioner 10a, the control device 100a acquires the air conditioning start instruction information (step S21). More specifically, the voice information recognition unit <NUM> of the control device 100a recognizes the voice information output by the AI apparatus <NUM> and extracts the start instruction information. Alternatively, the communication unit <NUM> receives the start instruction signal transmitted by the remote controller <NUM>. The control unit <NUM> starts the air conditioner 10a based on the start instruction information.

Next, the control unit <NUM> acquires the room temperature from the sensor 220a, the humidity from the sensor 220b, the number of people present in the room A from the sensor 220c, and the like (step S22). In a general air conditioner, air conditioning is controlled based on these types of sensor information. For example, control is performed such that the room temperature measured by the sensor 220a becomes the set temperature. However, in the present embodiment, the air conditioning control is performed using not only the sensor information measured by the sensors 220a to 220c but also the information acquired from the AI apparatus <NUM>.

Therefore, the control unit <NUM> determines whether or not to inquire the AI apparatus <NUM> for information necessary for control (step S23). (A) For example, the control unit <NUM> determines that the information from the AI apparatus <NUM> is necessary as the initial information at the time of start, and determines to make an inquiry to the AI apparatus <NUM>. (B) For example, when the difference between the set temperature and the room temperature acquired from the AI apparatus <NUM> or the room temperature measured by the sensor 220a is larger than a predetermined threshold value, the control unit <NUM> may determine to make an inquiry to the AI apparatus <NUM> every predetermined first time, and when the difference between the two temperatures is equal to or less than the predetermined threshold value, the control unit <NUM> may determine to make an inquiry to the AI apparatus <NUM> every predetermined second time set longer than the first time. (C) For example, the control unit <NUM> may determine to make an inquiry to the AI apparatus <NUM> every predetermined third time until the predetermined time elapses from when there is a change in the number of people in the room A measured by the motion sensor 220c, and after the elapse of the predetermined time, the control unit <NUM> may determine to make an inquiry to the AI apparatus <NUM> every predetermined fourth time set longer than the third time.

When it is determined to make an inquiry to the AI apparatus <NUM> (step S23; Yes), the control unit <NUM> instructs the inquiry unit <NUM> to inquire the AI apparatus <NUM> for weather information or the like. Then, the inquiry information generation unit <NUM> generates a sentence including a keyword necessary for starting a dialogue with the AI apparatus <NUM> and a sentence requesting the room temperature and weather information necessary for air conditioning control in a predetermined language. The voice output control unit <NUM> outputs the generated sentence from the speaker <NUM> as, for example, voice information of ultrasonic waves of <NUM> or more. Alternatively, the inquiry information generation unit <NUM> selects a voice file containing voice data requesting room temperature and weather information, and the voice output control unit <NUM> plays back and outputs the voice file from the speaker <NUM> as voice information of ultrasonic waves.

The AI apparatus <NUM> acquires inquiry information, accesses the Internet, and acquires, for example, hourly weather and temperature prediction information. Further, the AI apparatus <NUM> acquires the room temperature information measured by the temperature sensor included in the AI apparatus <NUM>. The AI apparatus <NUM> notifies the air conditioner 10a of the requested information by outputting voice information or transmitting a control signal including weather information and the like.

The control device 100a acquires the weather information, the temperature (outside temperature), and the room temperature returned from the AI apparatus <NUM> (step S24). When the AI apparatus <NUM> outputs voice information, the voice information recognition unit <NUM> recognizes the voice information output by the AI apparatus <NUM>, extracts each piece of information on weather, temperature, and room temperature, and outputs the information to the control unit <NUM>. When the AI apparatus <NUM> transmits a non-verbal control signal, the communication unit <NUM> receives the control signal including each piece of information on the weather, the temperature, and the room temperature, and outputs the control signal to the control unit <NUM>.

The control unit <NUM> executes air conditioning control (step S25).

For example, when it is determined to make an inquiry to the AI apparatus <NUM> in step S23, the control unit <NUM> controls the air conditioner 10a by using the acquired weather, temperature, and room temperature information. For example, the control unit <NUM> performs a defrost operation by using the weather and temperature information. The control of the defrost operation will be described next with reference to <FIG>. Further, the control unit <NUM> controls the room temperature of the room A, by using the room temperature acquired from the AI apparatus <NUM>. The AI apparatus <NUM> is installed near the user M, and it is highly likely that the temperature sensor included in the AI apparatus <NUM> detects a room temperature closer to the temperature experienced by the user M than the sensor 200a provided in the air conditioner 10a. Therefore, the control unit <NUM> performs air conditioning control such that, for example, the room temperature acquired from the AI apparatus <NUM> becomes the set temperature. Alternatively, the control unit <NUM> may perform air conditioning control such that, for example, the weighted average of the room temperature acquired from the AI apparatus <NUM> and the room temperature measured by the sensor 200a becomes the set temperature. Further, for example, when the difference between the room temperature acquired from the AI apparatus <NUM> and the room temperature measured by the sensor 200a is equal to or greater than a predetermined threshold value, the control unit <NUM> may assume that the AI apparatus <NUM> is present at a position away from the air conditioner 10a, and perform control so as to change the wind direction and the air volume at a position farther than the present. Alternatively, the distance from the air conditioner 10a to the AI apparatus <NUM> may be estimated based on the voice information received from the AI apparatus <NUM> and the strength of the control signal, and the wind direction and the air volume may be controlled according to the estimated distance.

When it is not determined to make an inquiry to the AI apparatus <NUM> in step S23, the control unit <NUM> controls the air conditioner 10a based on the sensor information measured by the sensors 220a to 220c.

Next, the control device 100a determines whether or not to end the operation of the air conditioner 10a (step S26). When receiving the end instruction from the user, the control device 100a ends the operation of the air conditioner 10a. When the operation is continued (step S26; No), the process from step S22 is repeated. For example, the control device 100a acquires the sensor information measured by the sensors 220a to 220c at predetermined time intervals. Further, when a predetermined condition is satisfied (step S23), the control device 100a acquires the room temperature information from the AI apparatus <NUM>. The control unit <NUM> continues the air conditioning control such that the temperature calculated based on the room temperature acquired from the AI apparatus <NUM> and the room temperature measured by the sensor 220a becomes the set temperature.

According to this embodiment, the room temperature (temperature measured at a place close to the user's position) for improving comfort can be acquired from the AI apparatus <NUM> and used for air conditioning control. Further, by simply installing the AI apparatus <NUM>, the air conditioner 10a autonomously communicates with the AI apparatus <NUM>, so that information that cannot be acquired by the air conditioner 10a can be acquired. This makes it possible to achieve more comfortable air conditioning control than before.

Next, the process of controlling the execution of the defrost operation by using the weather and temperature information acquired from the AI apparatus <NUM> will be described with reference to <FIG> and <FIG>.

<FIG> is a second flowchart illustrating an example of the operation of the air conditioning control system.

<FIG> illustrates a processing example for controlling the start timing of the defrost operation during operation. As a premise, it is assumed that the air conditioner 10a is in the heating operation. Further, it is assumed that the defrost operation is set to be executed at predetermined time intervals.

The control device 100a acquires weather and temperature information from the AI apparatus <NUM> during the heating operation by the process described with reference to <FIG> (step S31).

The control unit <NUM> determines whether or not the acquired weather information includes snow (step S32). For example, when the hourly weather prediction information of the day is acquired at the beginning of the day, the control unit <NUM> determines whether or not the prediction at the current timing is snow. Alternatively, when the current weather information of the area is acquired at predetermined time intervals, the control unit <NUM> determines whether or not the latest weather information is snow. When the weather is snow (step S32; Yes), the control unit <NUM> determines to advance the defrost start timing. For example, when the defrost operation is set to be executed every <NUM> hours, the control unit <NUM> changes the setting such that the defrost operation is executed every <NUM> hours, for example.

When the weather is not snow (step S32; No), the control unit <NUM> determines whether or not the temperature acquired from the AI apparatus <NUM> is lower than a predetermined threshold value (step S33). For example, when the hourly temperature prediction information of the day is acquired at the beginning of the day, the control unit <NUM> determines whether the predicted temperature at the current timing is lower than the threshold value. Alternatively, when the current temperature of the area is acquired at predetermined time intervals, the control unit <NUM> determines whether the latest temperature is lower than the threshold value. When the temperature is lower than the threshold value (step S33; Yes), the control unit <NUM> determines to advance the start timing of the defrost operation. The degree to which the start timing of the defrost operation is advanced may be the same as or may be different from in the case of snow.

When the temperature is equal to or higher than the threshold value (step S33; No), the control unit <NUM> does not change the execution timing of the defrost operation.

Next, an example of defrost control during scheduled heating operation will be described.

<FIG> is a third flowchart illustrating an example of the operation of the air conditioning control system.

As a premise, it is assumed that room A is scheduled to reach a predetermined temperature at a timing T1. Normally, the control unit <NUM> is set to start the heating operation at a time earlier than the timing T1 by a time T2 (T2 is, for example, <NUM> hour).

The control unit <NUM> of the control device 100a determines whether or not to perform the defrost operation before the start of the heating operation, to prevent the room temperature of the room A from being unable to be controlled to reach the set temperature at the timing T1 due to a decrease in the efficiency of the heating operation, based on the schedule of the heating operation. The control unit <NUM> executes this determination at a time earlier than the timing T1 by a time T2+α (α is, for example, <NUM> minutes). Therefore, the control unit <NUM> first determines whether or not the current timing has reached a time earlier than the set timing T1 by a predetermined time (time T2+α) (step S41). When the time earlier by the predetermined time has been reached (step S41; Yes), the control unit <NUM> instructs the inquiry unit <NUM> to acquire the weather and temperature information from the present to the set timing T1. Based on this instruction, the inquiry unit <NUM> outputs inquiry information to the AI apparatus <NUM>. The AI apparatus <NUM> responds to this inquiry. The control unit <NUM> acquires the weather and temperature information returned by the AI apparatus <NUM> via the voice information recognition unit <NUM> or the communication unit <NUM> (step S42).

The control unit <NUM> determines whether or not the acquired weather information includes snow (step S43). When the weather information from the present to the timing T1 includes snow (step S43; Yes), the control unit <NUM> determines that the defrost operation is executed before the start of the heating operation. The control unit <NUM> executes the defrost operation until the heating start timing (step S46). That is, the control unit <NUM> executes the defrost operation for the time α from the present to a time earlier than the set timing T1 by a time T2. Thus, the room A can be controlled to a desired temperature until the set timing T1, without lowering the efficiency of the heating operation to be started thereafter.

When the weather is not snow (step S43; No), the control unit <NUM> determines whether or not the temperature from the present to the timing T1 acquired from the AI apparatus <NUM> is lower than a predetermined threshold value (step S44). When the temperature in this time zone is lower than the threshold value (step S44; Yes), the control unit <NUM> starts the defrost operation and executes the defrost operation until the start timing of the heating operation (step S46).

When the temperature is equal to or higher than the threshold value (step S44; No), the control unit <NUM> does not execute the defrost operation (step S45). In this case, the control unit <NUM> waits until the heating start timing (a time earlier than the timing T1 by the time T2).

When the heating start timing is reached, the control unit <NUM> starts the heating operation (step S47).

According to the controls illustrated in <FIG> and <FIG>, weather and temperature information can be acquired from the AI apparatus <NUM> and the defrost operation can be executed before snow or low temperature adversely affects the heating operation.

In the process of <FIG>, α may be set longer, so that the start timing of the heating operation may be earlier in the case of snow or low temperature.

<FIG> is a diagram illustrating an example of a hardware configuration of the apparatus control system.

A computer <NUM> includes a CPU <NUM>, a main storage device <NUM>, an auxiliary storage device <NUM>, an input/output interface <NUM>, and a communication interface <NUM>. The computer <NUM> may include a processor such as a micro processing unit (MPU) instead of the CPU <NUM>.

The control devices <NUM> and 100a described above are mounted on the computer <NUM>. Each of the above-described functions is stored in the auxiliary storage device <NUM> in the form of a program. The CPU <NUM> reads the program from the auxiliary storage device <NUM>, develops the program into the main storage device <NUM>, and executes the above process according to the program. Further, the CPU <NUM> secures a storage area in the main storage device <NUM> according to the program. The CPU <NUM> secures a storage area for storing the data being processed in the auxiliary storage device <NUM> according to the program.

A program for achieving all or a part of the functions of the control devices <NUM> and 100a is recorded on a computer-readable recording medium, and the process by each functional unit may be performed by a computer system reading and executing the program recorded on the recording medium. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer system" includes a homepage providing environment (or a display environment) when a WWW system is used. Further, the "computer-readable recording medium" refers to a portable medium such as a CD, DVD, or USB, or a storage device such as a hard disk built in a computer system. Further, when this program is delivered to the computer <NUM> through a communication line, the computer <NUM> receiving the delivered program may develop the program in the main storage device <NUM> and execute the above process. Further, the above-described program may achieve a part of the above-described functions, or may further achieve the above-described functions in combination with the program already recorded in the computer system.

In addition, it is possible to appropriately replace the components in the above-described embodiments with known components without departing from the scope of the present invention as defined in the claims. It should be noted that the technical scope of the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention as defined in the claims.

Claim 1:
A control device for a home electrical apparatus (<NUM>), comprising:
a speaker (<NUM>)
an inquiry unit (<NUM>) configured to generate inquiry information, configured to make an inquiry to the AI apparatus by using voice information in a non-audible range, including content requesting information necessary for controlling the home electrical apparatus and to output corresponding voice information including a predetermined keyword for starting a dialogue with an AI apparatus (<NUM>), prior to the inquiry ;
an acquisition unit (<NUM>) configured to acquire, from the AI apparatus (<NUM>), response information about the inquiry necessary for controlling the home electrical apparatus;
a voice information recognition unit (<NUM>) included in the acquisition unit and configured to recognize voice information output by the AI apparatus (<NUM>) as the response information in response to the inquiry, and to extract answer information included in the response information;
a communication unit (<NUM>) configured to receive a non-verbal response signal output by the AI apparatus (<NUM>) in response to the inquiry and which is alternative to the voice information output by the AI apparatus; and
a control unit (<NUM>) configured to start the operation of the home electrical apparatus (<NUM>), based on the response signal or the answer information and, while continuing the operation of the home electrical apparatus, configured to determine necessity of acquiring further information necessary for the control of the home electrical apparatus (<NUM>), and to instruct the inquiry unit (<NUM>) to execute the inquiry to the AI apparatus (<NUM>) if the acquiring information is determined to be necessary;
a setting reception unit (<NUM>) configured to receive settings for an utterance speed of the voice information output by the inquiry unit (<NUM>);
wherein, prior to the inquiry, in response to a start instruction for the home electrical apparatus (<NUM>) from the AI apparatus (<NUM>), the control unit (<NUM>) starts the home electrical apparatus; and
wherein the inquiry to the AI apparatus is made by outputting voice information from the speaker (<NUM>) using a natural language spoken by humans.