Method and system for controlling internet of things (IoT) device

Provided is a method and system for controlling an Internet of Things (IoT) device. An IoT control method configured as a computer may include registering an IoT device as a buddy through an open application programmer interface (API) of a messenger service platform; creating a group chat room by grouping a plurality of IoT devices among IoT devices registered as the buddy; and providing a messaging service participated in by the plurality of IoT devices through the group chat room.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the priority benefit of Korean Patent Application No. 10-2014-0137556, filed on Oct. 13, 2014, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.

BACKGROUND

1. Field of the Invention

Embodiments of the present invention relate to a method and system for controlling and monitoring a group of Internet of Things (IoT) devices or a mash-up service.

2. Description of the Related Art

The Internet of Things (IoT) indicates the concept that mutual communication is enabled by connecting all the communicable things over a network. All the systematically recognizable objects may be classified as things or objects. A thing, such as a sensor, including near field and far field communication functions and capable of creating and utilizing data or a person may be included therein.

For example, a technology for receiving menu information and seat information and processing a reservation and a payment using a mobile device through an IoT point of sales (POS) system in which an IoT service is applied to a POS is disclosed in Korean Patent Laid-Open Publication No. 10-2014-0008668 titled “method for providing IoT POS service and computer readable recording medium applying the same”, published on Jan. 22, 2014.

There is a need to execute an exclusive application or to access a web in order to activate or monitor each of IoT devices in an IoT environment.

In the case of controlling a grouping of IoT devices and a mash-up service using an exclusive application, learning of a new tool is required instead of using a method familiar to a user. Also, a separate manager or server capable of managing each of IoT devices and providing a messaging service between devices is required.

Similarly, in the case of controlling a grouping of IoT devices and a mash-up service through a web, the same issues as the method using the exclusive application may arise.

The number of IoT devices will greatly increase. Further, although such IoT devices are operating in a standalone style, a plurality of IoT devices may be evolved to cooperate to provide a further intelligent service. In this perspective, there is a need to provide a user friendly interface in a buddy type of a messenger rather than a method of controlling an application or a web of an interface, which can be regarded to be relatively unfriendly and difficult.

SUMMARY

An aspect of the present invention provides an Internet of Things (IoT) control method and system that may control an IoT device using a buddy concept friendly to users.

An aspect of the present invention also provides an IoT control method and system that may control and monitor a group of IoT devices or a mash-up service through a multilateral chat room of a messenger.

According to an aspect of the present invention, there is provided an IoT control method configured as a computer, the method including registering an IoT device as a buddy through an open application programmer interface (API) of a messenger service platform; creating a group chat room by grouping a plurality of IoT devices among IoT devices registered as the buddy; and providing a messaging service participated in by the plurality of IoT devices through the group chat room.

The registering may include registering a corresponding IoT device as a buddy having set a relationship with a user, in response to identification information of the IoT device input from the user.

The registering may include registering the IoT device based on device information input from a manager associated with a development or sales of the IoT device; and registering a corresponding IoT device as a buddy having set a relationship with a user, in response to identification information of the IoT device input from the user of which a user authentication is completed.

The creating may include creating the group chat room by grouping a plurality of IoT devices selected by a user from among IoT device registered as the buddy.

The creating may include creating the group chat room by grouping a plurality of IoT devices based on a service category of the IoT device registered as the buddy.

The IoT control method may further include registering, as the buddy, an external service server that provides data required for controlling the IoT device. The creating may include creating the group chat room by including at least one external service server.

The providing may include controlling, as a group, the plurality of IoT devices through the messaging service or configuring a mash-up service using the plurality of IoT devices.

Each of the IoT devices participating in the group chat room may transmit and receive a message through the open API of the messenger service platform.

According to another aspect of the present invention, there is provided an IoT control system including a memory to which at least one program is loaded; and at least one processor. According to a control of the at least one program, the at least one processor may be configured to process: a process of registering an IoT device as a buddy through an open API of a messenger service platform; a process of creating a group chat room by grouping a plurality of IoT devices among IoT devices registered as the buddy; and a process of providing a messaging service participated in by the plurality of IoT devices through the group chat room.

Effects

According to embodiments of the present invention, users may be provided with an intelligent service by grouping Internet of Things (IoT) devices through a user friendly interface instead of using a difficult tool.

Also, according to embodiments of the present invention, it is possible to easily perform grouping or construct a mash-up service by registering, using a buddy system such as a messenger, each IoT device as a virtual buddy, by creating a multilateral chat room, and by inviting a plurality of IoT buddies to the created multilateral chat room.

Also, according to embodiments of the present invention, since IoT buddies exchange messages through a messenger server, an exclusive application or an additional server construction is not required. Further, since operation details of an IoT device or communication details between IoT devices remain in a chat room, logging or monitoring may be easily performed.

DETAILED DESCRIPTION

The embodiments relate to a technology capable of controlling and monitoring a group of Internet of Things (IoT) devices or a mash-up service through an interaction between a platform of an instant messenger service and IoT devices, and may be applicable to a device control service in an IoT environment.

FIG. 1illustrates an example of an environment capable of grouping and thereby controlling an IoT device according to an embodiment of the present invention.FIG. 1illustrates an IoT device101, an IoT control system100, and a user terminal102. InFIG. 1, lines connecting between constituent elements indicate that data may be transmitted and received between the IoT device101and the IoT control system100and between the IoT control system100and the user terminal102over a wired/wireless network.

The IoT device101may indicate a smart grid system to manage energy including electricity/gas or water and sewage, a home network system to integrally manage home cooling and heating, and all the smart devices or sensors regarded as an IoT technology based service target such as a smart key capable of automatically unlocking a locking device of a vehicle door or automatically starting an engine without fixing a key to a vehicle.

The user terminal102, as a communication device such as a personal computer (PC), a smartphone, a tablet, and a wearable computer, may indicate any type of terminal devices that may install and execute a service exclusive application (hereinafter, referred to as a “messenger App”) associated with the IoT control system100. Here, the user terminal102may perform the overall service operation such as a service screen configuration, a data input, a data transmission and reception, and a data storage under a control of the messenger App.

An external service server103refers to a database system to manage data of a 3rdparty service provider or data of an outside public provider. For example, the external service server103may provide outside public data, such as weather information and traffic information, or data of a predetermined service provider as external data required to control the IoT device101.

In an instant messenger service generally used by users, the IoT control system100may recognize the IoT device101in a form of a buddy and may provide an environment of controlling the IoT device101using a conversation function familiar to users. As an example, the IoT control system100is constructed on a messenger platform that provides a messenger service, and may register each IoT device101as a virtual buddy based on a messenger and may provide a grouping of IoT devices101or a mesh-up service through a multilateral chat room. Also, the IoT control system100may transfer, to the IoT device101, data provided from the external service server103in response to a connection or a request of the IoT device101in the messenger environment.

The IoT control system100may be included in a platform of a messenger server (not shown) that provides the messenger service. However, the present invention is not limited thereto and thus, the IoT control system100may be configured as a system separate from the messenger server and to provide a grouping of IoT devices101or a mash-up service through an interaction with the messenger server.

FIG. 2is a block diagram illustrating a configuration of an IoT control system200according to an embodiment of the present invention.

Referring toFIG. 2, the IoT control system200may include a processor201, a bus202, a network interface203, a memory204, and a database205. The memory204may include an operating system (OS) and a service providing routine. The processor201may include a device register210and a device controller220. Depending on embodiments, the IoT control system200may include the number of constituent elements greater than the number of constituent elements ofFIG. 2.

The memory204, as non-transitory computer-readable media, may include a permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. Also, a program code for the OS and the service providing routine may be stored in the memory204. The software constituent elements may be loaded from non-transitory computer-readable media separate from the memory204using a drive mechanism (not shown). The non-transitory computer-readable media may include computer-readable media such as a floppy disk, a tape, a DVD/CD-ROM drive, and a memory card. According to another embodiment, the software constituent elements may be loaded to the memory204through the network interface203, instead of using the non-transitory computer readable media.

The bus202may enable communication and data transmission between the constituent elements of the IoT control system200. The bus202may be configured using a high-speed serial bus, a parallel bus, a storage area network (SAN), and/or other appropriate communication technologies.

The network interface203may be a computer hardware constituent element to connect the IoT control system200to a computer network. The network interface203may connect the IoT control system200to the computer network through a wireless or wired connection.

The database205may serve to store and maintain all the information required to control an IoT device based on a messenger service. In this instance, the database205may include a device message repository to store a device message associated with the IoT device, a device information repository to store basic information about the IoT device, an upper ontology for interface with the IoT device, a conversation vocabulary database to store vocabulary for a conversation function between a user and the IoT device, a service template repository to store a service template for a conversion function between the user and the IoT device, a user information repository to store user information using a service, and a buddy information repository to store buddy information between the user and the IoT device. AlthoughFIG. 2illustrates that the database205is included in the IoT control system200, the database205may be present as an external database constructed on a separate system.

The processor201may be configured to process an instruction of a computer program by performing a basic arithmetic and logic operation, and an input/output (I/O) operation of the IoT control system200. The instruction may be provided from the memory204or the network interface203to the processor201through the bus202. The processor201may be configured to execute a program code for the device register210and the device controller220. The program code may be stored in a storage device such as the memory204.

Hereinafter, an operation of the device register210and the device controller220will be described in detail.

Initially, the device register210serves to register an IoT device on a system in a form of a buddy. As an example, the device register210may register device information input from a manager, for example, a developer and a seller, of the IoT device to the IoT control system200. As another example, the device register210may perform a direct device registration function that enables a user corresponding to an owner of the IoT device to directly register the IoT device to a service of the IoT control system200. The manager or the user may input basic information, for example, a device name, spatial information, and tagging information, of the IoT device using a user portable on a system for registration of the IoT device, and may select or directly input individual interface information in the case of automatically providing the same. As described above, the IoT device may be registered to the messenger based IoT control system200to be suitable for each service category. At the event of registration, information such as a name, a type, a media access control (MAC) address, a service category, and an owner of the IoT device may also be stored.

The device register210aims to manage buddy information with respect to the registered IoT device, and serves to manage authentication and connection information associated with a messenger service. As an example, the device register210serves to perform a buddy creation and recognition function with respect to the IoT device, and may provide a virtual buddy service for authenticating the IoT device as a buddy on the messenger service through interaction with a general messenger service provider. As another example, the device register210may provide a connection function with respect to a service that adds a buddy using virtual telephone number or e-mail based information associated with the IoT device to be associated with a non-interacting provider.

Further, the device register210may register, as a single buddy, a third information provider that is an external service providing outside public data, such as weather information and traffic information, or predetermined service data.

Also, the device register210may perform a device application programmer interface (API) based registration function capable of registering API information associated with the IoT device. In this instance, the device register210may connect the IoT device through an API provided from an IoT device provider or another separate external service server, and here, may input API information of the IoT device using a user portal of a system and may set a relevant right. The device register210may perform a device interface registration function capable of setting individual interface information based on information provided for each IoT device. Here, interface information of the IoT device may be set based on predefined semantic interface information. Based thereon, message conversion and service operation inference may be performed on the device register210. The interface information for each IoT device may be verified from an upper ontology structure and a function suitable for the IoT device may be provided by inferring and selecting related control information.

The device controller220may provide a messaging service between a user and the IoT device and between the IoT device and another IoT device in a messenger environment. To this end, the device controller220may provide a conversation function capable of creating a chat room in which the user and the IoT device participate and controlling the IoT device using a conversation type instruction through the chat room.

Here, to overcome the user inconvenience when using an IoT device interactive service, the device controller220may provide a predefined service template capable of setting a message routing and relationship between buddies, and in this instance, may utilize a structure such as a mesh-up interface of instance hosting technology.

In particular, in the case of using a service provided in a mash-up form with respect to a plurality of IoT devices, the device controller220may provide a group chat environment in which the plurality of IoT devices is grouped. That is, the device controller220may create a group chat room capable of grouping the plurality of IoT devices or configuring a mash-up service by combining the plurality of IoT devices by the user or the system.

The device controller220may serve to receive a device message from an IoT device participating in a chat room with the user, and to process the received device message in a queue form.

In the conversation function, the device controller220may change a message transmitted or received between IoT devices to an instruction associated with an operation of an IoT device, or may change the message to an expression of a general example based on a natural language processing algorithm. In this instance, the device controller220may serve to add a meaning to a raw message received from the IoT device based on interface information of the IoT device. For example, when data saying “23” is received from a temperature sensor corresponding to an IoT device, the device controller220may represent the received data together with 23 Centigrade (° C.) information or 23 Fahrenheit (° F.) information based on interface information of the corresponding temperature sensor. When an individual operation condition is present, information of the operation, for example, ON or OFF of an air conditioner may be transferred.

Also, the device controller220may provide control information based on setting information for each IoT device, and may infer related information for a smart service operation on a user side by performing a semantic determination based on the IoT device and external environment/service information. In this instance, the device controller220may perform a situation inferring function, and may determine peripheral information associated with IoT device information based on interface information between a corresponding device and a message triggered by the corresponding device using ontology information. Accordingly, the device controller220may select optimal vocabulary based on a function of inferring peripheral information associated with IoT device information and may recommend the selected vocabulary.

FIG. 3is a flowchart illustrating an example of a process of registering an IoT device to a messenger server according to an embodiment of the present invention. Operations included in the IoT device registration process according to an embodiment may be performed by the device register210ofFIG. 2.

In operation310, the device register210may register an IoT device as a virtual buddy form by registering device information of the IoT device input from a device manager, for example, a developer or a seller of the IoT device, through an open API of a messenger server.

In operation320, when a user performs a user authentication, for example, a log-in, and requests a registration of the IoT device by inputting identification information, for example, a MAC address and an ID provided from the device manager, of the IoT device, the device register210may classify and thereby register the IoT device as a personal device of the user.

In operation330, the device register210may register the IoT device registered as the personal device of the user to a buddy list of the user by adding the IoT device as a buddy having set a relationship with the user on a messenger.

When the device manager or the user is directly connectable to the Internet over a wired/wireless network, the device manager or the user may register the IoT device as a buddy of the user on the messenger through the IoT device registration process ofFIG. 3.

In contrast, when the device manager or the user is not directly connectable to the Internet, the device manager or the user may utilize a device that serves as a receiver for each technology such as ZigBee and Bluetooth and is provided in a gateway form for an Internet access.

FIG. 4is a flowchart illustrating an example of a process of controlling an IoT device according to an embodiment of the present invention. Operations included in the IoT device control process according to an embodiment may be performed by the device controller220ofFIG. 2.

In operation410, the device controller220may create a group chat room with respect to a plurality of IoT devices. As an example, the device controller220may create a group chat room in which a plurality of IoT devices participates using a method of receiving a selection of the user as a conversation buddy on the plurality of IoT devices from a buddy list of a messenger. As another example, the device controller220may combine IoT devices registered to a buddy list of a user based on a service category of each IoT device, and may create a group chat room participated in by IoT devices for each combination. For example, when IoT devices, for example, an external service server such as a weather center, a TV, a lighting, a motion sensor, and a CCTV, are classified into a security service, a group chat room in which buddies of a service category corresponding to the security service are invited may be automatically created. As another example, when IoT devices such as a TV, a watch, a curtain, and a coffee port, are classified into an alarm service, a group chat room in which buddies of a service category corresponding to the alarm service are invited may be automatically created. In this instance, the device controller220may provide a correction function of adding or deleting a conversation buddy for each group chat room.

In operation420, the device controller220may provide a messaging service for controlling an IoT device through the group chat room. That is, the device controller220may control the IoT device through a conversation type instruction based on a message service using the group chat room. Accordingly, the IoT device may transmit and receive a device message to and from a user and/or another IoT device using a conversation type instruction through an open API of a messenger server.

FIGS. 5 and 6illustrate an example of a group chat screen for a temperature control service according to an embodiment of the present invention. Here, the group chat screen shows a scenario for controlling a boiler in a situation in which a boiler controller and a temperature sensor are grouped into a temperature control service group as a conversation buddy of a user.

Referring toFIG. 5, when a user501inputs a predetermined service control-oriented message, for example, “on my way home”, “leaving the office”, and “turn on the boiler”, on the group chat screen, a boiler controller502initially requests temperature information. When a temperature sensor503transmits a current room temperature in response thereto, the boiler controller502may run the boiler by setting a target temperature based on the current room temperature. In this instance, the user501may transfer a message associated with the target temperature and thereby manually change the target temperature set by the boiler controller502.

Referring toFIG. 6illustrating another scenario for controlling a boiler, when a user601inputs a predetermined service control-oriented message on the group chat screen, a messenger server may verify an action of the user601based on a message on a messenger service and may request a temperature sensor603for temperature information. A boiler controller602may run the boiler by setting a target temperature based on a current room temperature.

In the case of the scenario ofFIG. 5in which an entity, such as the boiler controller502, capable of initially requesting information and then controlling the boiler is present, it is possible to manage and control IoT devices present within service providing coverage through the boiler controller502. Meanwhile, in the case of the scenario ofFIG. 6, it is possible to verify, using the messenger server, an action or a conversation of the user601, for example, “on the way home”, “leaving the office”, and “turn on the boiler”, and to request temperature information, and accordingly, to manage and control IoT devices present within service providing coverage through the boiler controller602. In the case of the scenario ofFIG. 6, a messenger service provider associated with the messenger server may charge for a service scenario or a device management.

FIG. 7illustrates an example of a group chat screen for a security service according to an embodiment of the present invention. Here, the group chat screen shows a scenario for activating a security service in a situation in which a weather center, a TV, a lighting, a motion sensor, and a CCTV are grouped into a security service group as a conversation buddy of a user.

Referring toFIG. 7, when a user701inputs a predetermined service control-oriented message, for example, “security mode” and “ON”, on the group chat screen, a weather center702that is an external service provides information about an estimated sunset time. In this instance, a lighting703, a TV704, and a motion sensor705perform an operation corresponding to a predetermined condition based on the estimated sunset time, and a CCTV706provides a current indoor image when a motion is sensed at the motion sensor705.

FIG. 8illustrates an example of a group chat screen for a temperature/humidity control service according to an embodiment of the present invention. Here, the group chat screen shows a scenario for adjusting a room temperature/humidity in a situation in which a temperature sensor, a humidity sensor, an air conditioner, and a dehumidifier are grouped into a temperature/humidity control service group as a conversation buddy of a user.

Referring toFIG. 8, when a user801inputs a predetermined service control-oriented message, for example, “automatic operation” and “ON”, on the group chat screen, a temperature sensor802and a humidity sensor803measure a current temperature and a current humidity. Accordingly, an air conditioner804and a dehumidifier805set a target level based on the current temperature and the current humidity, and perform a predetermined operation.

FIG. 9illustrates an example of a group chat screen for an alarm service according to an embodiment of the present invention. Here, the group chat screen shows a scenario for providing an alarm in a situation in which a TV, an automatic curtain, and a coffee port are grouped into an alarm service group as a conversation buddy of a user.

Referring toFIG. 9, when a user901inputs a predetermined service control-oriented message, for example, “7:00 a.m.” and “wake me up at 7:00 a.m.”, an alarm time may be verified by verifying the message and an automatic curtain902, a TV903, and a coffee port904may perform a predetermined operation based on the alarm time. Here, the user901may manually control an alarming operation by transferring a message type instruction, for example, “TV: channel-MBC, volume-25”, to a predetermined IoT device.

FIGS. 5 through 9show examples of an environment capable of easily configuring a mash-up service and exchanging information between IoT devices through a group chat room. A user may perform group chatting with IoT devices associated with a desired service. When the user transfers an instruction in a conversation type, IoT devices within a corresponding group may analyze the instruction of the user and may operate to fit for a service desired by the user.

Further, an external service provider, for example, a weather center and a traffic center, may also be registered as a single IoT buddy, and may provide valid information to a user for payment or free of charge in a messenger environment. For example, the external service provider may be registered in advance on a messenger service to be selectively registered as a buddy by the user.

FIG. 10is a block diagram illustrating an example of a configuration of a computer system1000according to an embodiment of the present invention. The computer system1000may include at least one processor1010, a memory1020, a peripheral interface1030, an I/O subsystem1040, a power circuit1050, and a communication circuit1060. Here, the computer system1000may correspond to a user terminal.

The memory1020may include, for example, a high-speed random access memory (HSRAM), a magnetic disk, a static random access memory (SRAM), a dynamic RAM (DRAM), read only memory (ROM), a flash memory, and a non-volatile memory. The memory1020may include a software module, an instruction set, or a variety of data required for an operation of the computer system1000. Here, an access from another component such as the processor1010and the peripheral interface1030to the memory1020may be controlled by the processor1010.

The peripheral interface1030may couple an input device and/or output device of the computer system1000with the processor1010and the memory1020. The processor1010may perform a variety of functions for the computer system1000and process data by executing the software module or the instruction set stored in the memory1020.

The I/O subsystem1040may couple various I/O peripheral devices with the peripheral interface1030. For example, the I/O subsystem1040may include a controller for coupling the peripheral interface1030and a peripheral device such as a monitor, a keyboard, a mouse, a printer, and a touch screen or a sensor, as necessary. The I/O peripheral devices may be coupled with the peripheral interface1030without using the I/O subsystem1040.

The power circuit1050may supply a power to all of or a portion of components of a terminal. For example, the power circuit1050may include a power management system, at least one power source such as a battery and alternating circuit (AC), a charge system, a power failure detection circuit, a power converter or inverter, a power status indicator, or other components for creating, managing and distributing power.

The communication circuit1060enables communication with another computer system using at least one external port. Alternatively, as described above, the communication circuit1060may enable communication with another computer system by including a radio frequency (RF) circuit and thereby transmitting and receiving an RF signal known as an electromagnetic signal.

The embodiment ofFIG. 10is only an example of the computer system1000. The computer system1000may have a configuration or an arrangement for omitting a portion of the components illustrated inFIG. 10, further including components not illustrated inFIG. 10, or coupling two or more components. For example, a computer system for a communication terminal of a mobile environment may further include a touch screen, a sensor, and the like, in addition to the components ofFIG. 10. A circuit for RF communication using a variety of communication methods, for example, wireless fidelity (Wi-Fi), 3rd generation (3G), long term evolution (LTE), Bluetooth, near field communication (NFC), and ZigBee may be included in the communication circuit1060. Components includable in the computer system1000may be configured as hardware that includes an integrated circuit specified for at least one signal processing or application, software, or a combination of hardware and software.

The methods according to the embodiments of the present invention may be configured in a program instruction form executable through various computer systems and thereby recorded in non-transitory computer-readable media.

A program according to the embodiment may be configured as a PC-based program or an application exclusive for a mobile terminal. A messenger App according to the embodiment may be configured in a form of an independently operating program or in an in-app form of a predetermined application to be operable on the predetermined application.

As described above, according to embodiments of the present invention, users may be provided with an intelligent service by grouping IoT devices through a user friendly interface instead of using a difficult tool. Also, according to embodiments of the present invention, it is possible to easily perform grouping or construct a mash-up service by registering, using a buddy system such as a messenger, each IoT device as a virtual buddy, by creating a multilateral chat room, and by inviting a plurality of IoT buddies to the created multilateral chat room. Also, according to embodiments of the present invention, since IoT buddies exchange messages through a messenger server, an exclusive application or an additional server construction is not required. Further, since operation details of an IoT device or communication details between IoT devices remain in a chat room, logging or monitoring may be easily performed.

Although a few example embodiments of the present invention have been shown and described, the present invention is not limited to the described example embodiments. Instead, it would be appreciated by those skilled in the art that changes may be made to these example embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.