METHOD AND APPARATUS FOR CONTROLLING HOME DEVICE BASED ON SERVICE LOGIC IN HOME NETWORK SYSTEM

A method of controlling at least one home device in a home network system through a home gateway is provided. The method includes transmitting information about at least one home device installed in a home to a server, receiving extracted scenario information configured with combinations of services that are providable through the at least one home device from the server, and transmitting the extracted scenario information to a user terminal, receiving a control signal corresponding to a scenario selected by the user terminal from the user terminal, and if an event signal is detected from the at least one home device corresponding to the selected scenario, controlling the at least one home device according to the selected scenario.

DETAILED DESCRIPTION

It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.

FIG. 1illustrates a method of controlling a home device, according to a first embodiment of the present disclosure.

Referring toFIG. 1, a home network system150includes a terminal120, a home gateway (HGW)100, and first and second devices110and130. InFIG. 1, the first device110is assumed to be a security camera newly installed in a home, and the second device130is assumed to be a Light-Emitting Diode (LED) installed in the home. However, the first and second devices110and130may be any other devices installable in the home. Also, the terminal120is assumed to be a smart phone, however, the terminal120may be any other device, such as a tablet Personal Computer (PC) or a notebook computer, which can communicate with the home gateway100.

The home gateway100registers information about devices installed in the home. If the home gateway100receives a control signal for controlling a device, from the terminal120, the home gateway100transmits the control signal to the corresponding device according to the control signal and the information about the registered devices.

If a device, for example, the first device110is newly installed in home, the home gateway100stores information about the first device110, for example, a device Identifier (ID) and service capability information of the first device110. The service capability information of the first device110is information about services that the first device110can provide. The service capability information of the first device110may be acquired through a service discovery procedure. The service capability information of the first device110may be a zoom-in/zoom-out function of the security camera110.

If the home gateway100receives a control signal for controlling a device from the terminal120in operation104, the home gateway100detects the device to which the control signal is to be applied, according to the control signal and the information about the registered devices, and transmits the control signal to the detected device. For example, if the home gateway100receives a control signal for controlling the LED130from the terminal120in operation104, the home gateway100detects the LED130to which the control signal is to be applied, and transmits the control signal to the LED130in operation106. Herein, the control signal for controlling the LED130may be a control signal for turning on/off the LED130, or a control signal for adjusting the brightness of the LED130.

If the home gateway100receives a control signal for controlling the security camera110from the terminal120in operation104, the home gateway100detects the security camera110to which the control signal is to be applied, and transmits a control signal to the security camera110in operation102. The control signal for controlling the security camera110may be a signal for controlling the security camera110to start or stop recording, or a signal for controlling the security camera110to change a photographing direction. However, it is noted that these signals are merely exemplary and the control signals may be used for other control purposes of the camera. The security camera110transmits photographed image information to the home gateway100, and also stores and retrieves the photographed image information. When there is a request from the terminal120, the security camera110may transmit the stored image information to the terminal120.

FIG. 2illustrates a method of controlling a home device, according to a second embodiment of the present disclosure.

Referring toFIG. 2, a home network system250includes a terminal230, a home gateway200, first and second devices210and240, and a server220. InFIG. 2, the first device210is assumed to be a security camera newly installed in a home, and the second device240is assumed to be an LED installed in the home. However, the first and second devices210and220may be any other devices installable in the home. The terminal230is assumed to be a smart phone, however, the terminal230may be any other device, such as a tablet PC or a notebook computer, which can communicate with the home gateway200.

The home gateway200may register device information including IDs of all the devices installed in the home, service capability information of the devices, user information, user terminal information, region information, etc. in operation202, and transmit the registered device information, user information, user terminal information, and region information to the server220in operation204. Herein, the device information may be device IDs, the user information may be family members' mobile phone numbers, gender, age, physical conditions, etc., the user terminal information may be information about applications stored in the user terminal, and the region information may be a home address.

If a device, for example, the first device210is newly installed in the home, the home gateway200may store a device ID and service capability information of the first device210, and transmit the device ID and service capability information of the first device210to the server220in operation204. The service capability information of the first device210may be information about services that the first device210can provide. The service capability information of the first device210may be acquired through a service discovery procedure in operation202but is not limited thereto. The service capability information of the first device210may be a zoom-in/zoom-out function of the security camera210.

The server220may receive device information about all of the devices installed in the home, user information, user terminal information, and region information, from the home gateway200, in operation204, store the received information in Database (DB) of the server220, and extract scenarios configured with combinations of all services that can be provided to a user, based on the stored information in Database.

Scenarios for all services that can be provided to the user will be described in more detail with reference to Table 1 below. In Table 1, it is assumed that the devices installed in the home are an intrusion detection sensor, a security camera, a LED, an air conditioner, and a gas valve, wherein the service capability information of the intrusion detection sensor includes a user notification function and a buzz function, the service capability information of the security camera includes a user notification function, a zoom-in/zoom-out function, and a photographing direction changing function, the service capability information of the LED includes an on/off function and a brightness adjustment function, the service capability information of the air conditioner includes an on/off function, an adjustment-of-setting temperature function, an adjustment-of-fan speed function, and an adjustment-of-fan movement function, and the service capability information of the gas valve includes a user notification function and a close/open function.

Since the service capability information of the intrusion detection sensor having a device ID A includes a user notification function and a buzz function, the intrusion detection sensor may provide a user with a service of sending a notification message to a user when an intruder has been detected and a service of making a buzz sound when an intruder has been detected.

Since the service capability information of the security camera having a device ID B includes a user notification function, a zoom-in/zoom-out function, and a direction changing function, the security camera may provide a user with a zoom-in/zoom-out service of zooming in/out when an intruder has been detected, a service of changing a photographing direction along a traveling path of the intruder, and a service of providing photographed image information to a user.

Since the service capability information of the LED having a device ID C includes an on/off function and a brightness adjusting function, the LED may provide a user with a service of turning on/off the LED and a service of adjusting the brightness of the LED.

Since the service capability information of the air conditioner having a device ID D includes an on/off function, an adjustment-of-set temperature function, an adjustment-of-fan speed function, and an adjustment-of-fan movement function, the air conditioner may provide a user with a service for turning on/off the air conditioner, a service of turning a set temperature up or down, a service of adjusting fan speed, and a service of adjusting the movement of the fan.

Since the service capability information of the gas valve having a device ID E includes a user notification function and a close/open function, the gas valve may provide a user with a service of sending a notification message to a user when gas leaks out or when the gas valve opens for a predetermined time period or more, and a service of closing/opening the gas valve.

Extracted scenario information includes scenarios that are extracted by the server220, and the scenarios are configured with combinations of all services that at least one home device can provide to the user.

The scenario 1 is a process set to send a notification message to a user and make a buzz sound when the intrusion detection sensor has detected an intruder.

The scenario 2 is a process set to send a notification message to a user and make a buzz sound when the intrusion detection sensor has detected an intruder, and set to cause the security camera to zoom-in on the intruder, to photograph a close-up of the intruder, and to send the photographed image information to the user.

The scenario 3 is a process set to send a notification message to a user and make a buzz sound when the intrusion detection sensor has detected an intruder, and set to cause the security camera to change a photographing direction along a traveling path of the intruder to photograph the intruder.

The scenario 4 is a process set to cause the security camera to change a photographing direction along a traveling path of an intruder, to photograph the intruder, and to send the photographed image information to a user, and set to turn on a LED installed in a region corresponding to the traveling path of the intruder.

The scenario 5 is a process set to send a notification message informing of a dangerous situation to a user when a gas valve remains open while the user is out, and set to automatically close the gas valve.

The scenario 6 is a process set to turn the brightness of the LED up, to turn the set temperature of the air conditioner up, and to adjust the fan speed of the air conditioner to the light level according to an environment, for example, when the sun sets the brightness of the LEDs are turned up since the inside of the house becomes dark and the temperature of the air conditioner is turned up since the outside temperature falls down.

For convenience of description, Table 1 shows some of scenarios for all services that can be provided to a user. However, the extracted scenario information includes all scenarios configured with combinations of services that can be provided by the respective home devices, as well as the scenarios 1 to 6 shown in Table 1.

As such, the server220may transmit extracted scenario information for all services that can be provided to the user, to the home gateway200, in operation206. At this time, the server220may determine whether the terminal230stores applications for executing the corresponding scenarios based on the stored terminal information, and if the terminal230does not store the applications, the server220may transmit the applications to the home gateway200together with the extracted scenario information. The home gateway200may transmit the extracted scenario information and the applications received from the server220to the terminal230in operation207.

Also, when the server220may transmit the extracted scenario information to the terminal230through the home gateway200, the server220may transmit a specialized scenario to the corresponding user based on the stored user information and region information. For example, the server220may provide a female user who lives alone in a region having a high crime rate, with scenarios (that is, the scenarios 1 to 3) specialized for devices corresponding to the device IDs A and B among the extracted scenario information, based on the stored user information and region information. As another example, the server220may provide an old man/woman who cannot move about freely, with a scenario (that is, the scenario 6) specialized for devices corresponding to the device IDs C and D.

As another example, the scenarios 1 to 3, which are provided to a female user who lives alone in a region having a high crime rate, may extend from the process shown in Table 1 to be set to dial 911 when the intrusion detection sensor has detected an intruder so as to inform that an intruder has entered the user's home.

The terminal230which has received the extracted scenario information from the server220through the home gateway200may select an optimal scenario from the extracted scenario information, and transmit a control signal corresponding to the selected scenario to the home gateway200, in operation208. The control signal may include a device ID of the device included in the selected scenario, and information about a service that is provided by the corresponding device. The home gateway200may detect a device to which the control signal is to be applied, according to the control signal and information about registered devices, and transmit the control signal to the detected device, in operations209and211.

For example, the terminal230selects the scenario 4 as an optimal scenario, and transmits a control signal corresponding to the scenario 4 to the home gateway200in operation208. The home gateway200which has received the control signal detects the first and second devices210and240to which the control signal is to be applied, according to a device ID and information about a service that is provided by the corresponding device, included in the control signal, and information about registered devices. Thereafter, if the first device240has detected an intruder and transmitted an event signal to the home gateway200, the home gateway200transmits a control signal corresponding to the scenario 4 selected by the terminal230to the first and second devices210and240so as for the first and second devices210and240to operate according to a process set in the scenario 4. That is, the home gateway200transmits the control signal to the first and second devices210and240such that the first device210changes a photographing direction along a traveling path of the intruder, photographs the intruder, and transmits the photographed image information to the user, and the second device240which is a LED is turned on, in operations209and211.

Although not illustrated inFIG. 2, the home gateway200may update device information when there is a change in the devices installed in home. For example, if a device has been newly installed in the home, as described above, the home gateway200transmits a device ID and service capability information of the newly installed device to the server220. If a device installed in home has been removed, the home gateway200transmits information informing that the device has been removed, to the server220. Then, the server220can extract scenarios configured with combinations of all services that can be provided to the user based on information of devices changed in the home network system, and transmit the extracted scenario information to the home gateway200. The home gateway200can transmit the extracted scenario information to the terminal230, and the terminal230transmits a control signal corresponding to a scenario selected from the extracted scenario information, to the home gateway200.

FIG. 3is a flowchart of a method in which a home gateway operates in the second embodiment of the present disclosure.

Referring toFIG. 3, the home gateway may store at least one piece of information among device information including IDs respectively indicating home devices included in a home network system, that is, service capability information of the individual home devices installed in a home, user information, user terminal information, and region information, in operation302. The home gateway may transmit the stored information to a server in operation304, and receive extracted scenario information from the server in operation306.

Then, the home gateway may transmit the extracted scenario information to a terminal in operation308, and receive a control signal corresponding to a scenario selected by the terminal from the terminal in operation310. Then, if the home gateway detects an event signal of the corresponding device, the home gateway controls the device according to a process of the selected scenario in operation312.

The extracted scenario information is information including scenarios configured with combinations of all services that can be provided to the user, and the extracted scenario information may be configured with services specialized for the corresponding user among all services that can be provided to the user, in consideration of at least one piece of information among the user information, the user terminal information, and information about a region in which the user lives. However, it is noted that the services and combinations of services provided to the user are not limited to the above and other types of services and combinations of services can be provided to the user. Further, also, the home gateway may transmit applications for executing the extracted scenarios, together with the extracted scenario information, according to whether the terminal stores the applications therein.

Thereafter, the home gateway can update device information if there is a change in devices installed in the home. For example, if a device has been newly installed in the home, the home gateway transmits a device ID and service capability information of the newly installed device to the server, and if a device installed in the home has been removed, the home gateway transmits information informing that the device has been removed, to the server, thereby updating device information.

FIG. 4is a flowchart of a method in which a server operates in the second embodiment of the present disclosure.

Referring toFIG. 4, the server may receive at least one piece of information among device information including an ID indicating a device, service capability information of the device, user information, user terminal information, and region information, from a home gateway, and store the received information, in operation402.

Then, the server may extract scenarios configured with combinations of all services that can be provided to a user, based on the stored information, in operation404. The server may transmit extracted scenario information including the extracted scenarios to the home gateway in operation406. The extracted scenario information may be configured with services specialized for the corresponding user among all the services that can be provided to the user, in consideration of at least one piece of information among the device information, the user information, the user terminal information, and information about a region where the user lives. Also, the server may transmit applications for executing the extracted scenarios, together with the extracted scenario information, according to whether the terminal stores the applications therein. If there is a change in devices installed in the home, the server updates the device information that is considered in operation404. For example, when a device has been newly installed in the home, the server receives a device ID and service capability information of the newly installed device, and when a device installed in the home has been removed, the server receives information informing that the device has been removed from the home gateway, thereby updating the device information.

FIG. 5is a flowchart of a method in which a terminal operates in the second embodiment of the present disclosure.

Referring toFIG. 5, the terminal may receive extracted scenario information from a home gateway in operation502. The extracted scenario information is information including scenarios configured with combinations of all services that can be provided to a user. Also, the terminal may receive applications for executing the extracted scenarios, together with the extracted scenario information, according to whether the terminal stores the applications therein.

Then, the terminal selects an optimal scenario from the extracted scenario information in operation504, and transmits a control signal corresponding to the selected scenario to the home gateway in operation506. The control signal includes a device ID included in the selected scenario, and information about a service that is provided by the corresponding device.

FIG. 6is a block diagram illustrating a configuration of the home gateway in the second embodiment of the present disclosure.

Referring toFIG. 6, the home gateway includes a controller600, a storage unit610, a receiver620, and a transmitter630. When an event signal generated in a home network is detected, the controller600may control a device corresponding to the event signal according to a selected scenario, and transmit information informing that a device has been newly installed in the home network or that an installed device has been removed from the home network, to a server, to update device information. Also, the controller600may determine whether a terminal stores an application for executing the selected scenario therein, and if the terminal does not store the application for executing the scenario, the controller600may control the transmitter630to transmit the application to the terminal. The storage unit610may store at least one piece of information among device information including IDs indicating devices, service capability information of the devices, user information, user terminal information, and information about a region where the user lives. The receiver620may receive at least one piece of information among information about home devices, service capability information of the individual home devices, user information, user terminal information, and region information, from the home devices. Also, the receiver620may receive extracted scenario information from the server, and receive a control signal corresponding to a scenario selected by the terminal from the terminal. The extracted scenario information may be configured with services specialized for the user among all services that can be provided to the user, according to at least one piece of information among the device information, the user information, the user terminal information, and the information about the region in which the user lives. The transmitter630may transmit at least one piece of information among the information about home devices, the user information, the user terminal information, and the information about the region in which the user lives. If a home device has been newly installed in the home, the transmitter630transmits information about the newly installed home device to the server, and if a specific home device among home devices installed in the home has been removed, the transmitter630transmits information informing that the specific home device has been removed, to the server. Also, the transmitter630may transmit the extracted scenario information to the terminal, and transmit an operation message to the corresponding device.

FIG. 7is a block diagram illustrating a configuration of the server in the second embodiment of the present disclosure.

Referring toFIG. 7, the server includes an extractor700, a storage unit710, a receiver720, and a transmitter730. The extractor700may create extracted scenario information representing operation processes of scenarios, using at least one piece of information among device information including IDs indicating devices, service capability information of the devices, user information, user terminal information, and region information. The storage unit710may store applications for enabling a terminal to use the extracted scenario information, and store the extracted scenario information. The receiver720may receive information about home devices, service capability information of the individual home devices, user information, user terminal information, and region information from a home gateway. Also, if a home device has been newly installed in the home, the receiver720receives information about the newly installed home device from the home gateway, and if a specific home device among home devices installed in the home has been removed, the home gateway receives information informing that the specific home device has been removed, from the home gateway. The transmitter730may transmit the extracted scenario information and the applications to the home gateway. The extracted scenario information may be configured with services specialized for the corresponding user, among all services that can be provided to the user, in consideration of at least one piece of information among the user information, the user terminal information, and information about a region in which the user lives.

FIG. 8is a block diagram illustrating a configuration of the terminal in the second embodiment of the present disclosure.

Referring toFIG. 8, the terminal includes a selector800, a receiver820, and a transmitter830. The selector800may control the terminal's capability to execute an application, select one scenario among scenarios included in extracted scenario information, and generate a control signal corresponding to the selected scenario. The receiver820may receive the extracted scenario information from the home gateway. Also, the receiver820may receive an application for executing the scenario from the home gateway. The extracted scenario information may be configured with services specialized for the corresponding user, among all services that can be provided to the user, according to at least one piece of information among user information, user terminal information, and information about a region in which the user lives.

FIG. 9illustrates a method of controlling a home device, according to a third embodiment of the present disclosure.

Referring toFIG. 9, a home network system950includes a terminal930, a home gateway900, a first device910, a power supply940, and a server920. In the following description, it is assumed that the first device910is an oven installed in a home, and the power supply940is a device for supplying power to the oven. However, the first device910may be any other device installable in the home. Also, it is assumed that the terminal930is a smart phone, however, the terminal930may be any other device, such as a tablet PC and a notebook computer, which can communicate with the home gateway900.

The home gateway900may register device information including IDs of all devices installed in the home, service capability information of the devices, information about a power supply for supplying power to the devices, user information, user terminal information, region information, etc., in operation902. Then, the home gateway900may transmit the registered device information, user information, user terminal information, and region information to the server920, in operation904. For example, the device information may be device IDs, the user information may be family members' mobile phone numbers, gender, age, physical conditions, etc., the user terminal information may be information about applications stored in the corresponding terminal, and the region information may be a home address.

The service capability information of the devices is information about services that the devices can provide. The service capability information of the devices may be acquired through a service discovery procedure.

The server920may receive information about all devices installed in the home, user information, user terminal information, and region information, from the home gateway900, stores the received information in a Data Base (DB) of the server920, and extract scenarios configured with combinations of all services that can be provided to a user, based on the stored information.

The server920may transmit extracted scenario information for all services that can be provided to a user, to the home gateway, in operation906. At this time, the server920may determine whether the terminal930stores applications for executing the corresponding scenarios based on the stored user terminal information, and if the terminal930does not store the applications, the server920may transmit the corresponding applications to the gateway900together with the extracted scenario information. The home gateway900may transmit the extracted scenario information and the applications be received from the server920to the terminal930in operation907.

Also, when the server920transmits the extracted scenario information to the terminal930through the home gateway900, the server920may transmit scenarios specialized for the corresponding user according to the stored user information and the region information.

The terminal930which has received the extracted scenario information provided from the server920through the home gateway900may select an optimal scenario, and transmit a control signal corresponding to the selected scenario to the home gateway900, in operation908. The control signal includes a device ID included in the selected scenario, and information about a service that is provided by the corresponding device. The home gateway900may detect a device to which the control signal is to be applied, according to the control signal and information about registered devices, and transmit the control signal to the detected device, in operation909.

Thereafter, if the home gateway900detects an event signal of the detected device, the home gateway900controls the device according to a process of the selected scenario. However, if abnormal operation of the corresponding device, that is, the first device910is detected in operation911, the home gateway900determines that the first device910has a problem, and controls the power supply940to stop supplying power to the first device910in operation913. Herein, abnormal operation of the first device910for example home gateway900detect when signal transmission/reception to/from the first device910is unstable while the home gateway900controls the first device910according to the process of the selected scenario.

As described above, by proposing a method of providing a service to which a user's various requirements have been reflected using a server in a home network system, the user can receive an optimal service most suitable to himself/herself, resulting in performance improvement of the home network system.

The method and apparatus for controlling the home device, according to various embodiments of the present disclosure, may be implemented in the form of hardware, software, or a combination of hardware and software. The software may be stored in a volatile or non-volatile memory device such as, for example, a Read-Only Memory (ROM), regardless of whether it is erasable or re-writable, in a memory such as, for example, a Random Access Memory (RAM), a memory chip, and an Integrated Circuit (IC), or in an optically/magnetically recordable and machine-readable storage medium such as, for example, a Compact Disk (CD), a Digital Versatile Disk (DVD), a magnetic disk, and a magnetic tape. A graphic screen updating method can be implemented by a computer or a mobile terminal including a controller and a memory, and the memory is an example of a machine-readable storage medium suitable to store one or more programs, including instructions implementing various embodiments of the present disclosure.

Therefore, various embodiments of the present disclosure include programs including codes for implementing the devices and methods as set forth in the appended claims of the specification, and a machine-readable storage medium storing these programs. These programs may be electronically transferred through any media and equivalents thereof, such as communication signals, which are transferred through wired or wireless connections.

Also, the method and apparatus for controlling the home device, according to various embodiments of the present disclosure, can receive the program from a program providing apparatus connected in a wired/wireless fashion and store the program. The program providing apparatus may include a memory for storing programs including instructions instructing a graphic processing apparatus to perform a predetermined content protection method, information needed to perform the content protection method, etc.; a communication unit for performing wired/wireless communication with the graphic processing apparatus; and a controller for transmitting the corresponding program to a transmission and reception apparatus according to a request from the graphic processing apparatus or automatically.