Patent Description:
Currently, along with the development of computer technology, communication technology, and home electronics technology, a network management service in which home and factory devices and systems are interconnected with network has emerged and is getting the spotlight as the future-oriented technology.

All devices in a home or factory connected by a network are capable of mutually transmitting data and can communicate with various electronic apparatus. For example, a user can control all home appliances in a home regardless of time and place by using a user interface (UI) provided in an electronic apparatus such as a smart phone.

In order to use this service, a device needs to be set up first and the set-up of a device requires a procedure to register a device to a server.

A device is registered using an application of a smart phone according to the related art. Therefore, a smartphone is essential for using the device, and all users have to install the application on their own smartphone. In addition, in order to register a plurality of devices, there has been a problem that a user has to manually register each device sequentially.

As such, a method of registering each device by utilizing an application of a smartphone requires a long time, and there is a difficulty for the elderly to use this method. Also, since anyone can use the device by using the smartphone in which the application is installed, there is a problem that the device could be used by others.

The following publications are related to configuring an external device to access a network:.

Accordingly, an aspect of the disclosure is to provide an electronic apparatus capable of registering a device to a server easily using a voice, a controlling method of the electronic apparatus, and a server.

A first object of the present disclosure is an electronic apparatus, comprising: a communication circuit; a microphone; a memory for storing instructions; and at least one processor configured to execute the instructions to: in response to receiving a voice through the microphone, obtain information on an external device as a result of performing an analysis of the voice, based on the information on the external device, perform communication with the external device through the communication circuit, and control the communication circuit to transmit information on an access point to the external device to enable the external device to communicate with a server and control the communication circuit to transmit a registration request with respect to the external device to the server.

Preferably, the at least one processor is further configured to: receive identification information of the external device while the communication between electronic device and the external device is established, wherein the registration request includes the identification information.

Preferably, the at least one processor is further configured to: control the communication circuit to transmit the voice received through the microphone to the server; and receive, from the server, the information on the external device through the communication circuit.

Preferably, the at least one processor is further configured to: based on information on a plurality of external devices being acquired from the voice received through the microphone, control the communication circuit to transmit information on the access point sequentially to the plurality of external devices to enable the plurality of external devices to communicate with the server.

A second object of the present disclosure is a method of controlling an electronic apparatus, the method comprising: in response to receiving a voice through a microphone of the electronic apparatus, obtaining information on an external device as a result of performing an analysis of the voice; based on the information on the external device, performing communication with the external device; and transmitting information on an access point to the external device to enable the external device to communicate with a server and transmitting a registration request with respect to the external device to the server.

Preferably, the method further comprises: receiving identification information of the external device while the communication between electronic device and the external device is established; wherein the registration request includes the identification information.

Preferably, the method further comprises transmitting the voice received through the microphone to a server; and receiving, from the server, the information on the external device.

Preferably, the method further comprises: based on information on a plurality of external devices being acquired from the voice received through the microphone, transmitting information on the access point sequentially to the plurality of external devices to enable the plurality of external devices to communicate with the server.

Preferably, the information on the access point is used by the electronic apparatus to access the access point.

A third object of the present disclosure is a non-transitory computer-readable recording medium having recorded thereon at least one program comprising commands, which, when executed by a computer, performs a method, the method comprising: in response to receiving a voice through a microphone of an electronic apparatus, obtaining information on an external device as a result of performing an analysis of the voice; based on the information on the external device, performing communication with the external device; and transmitting information on an access point to the external device to enable the external device to communicate with a server; and transmitting a registration request with respect to the external device to the server.

Preferably, the non-transitory computer-readable recording medium is such that the method further comprises: receiving identification information of the external device while the communication between electronic device and the external device is established; wherein the registration request includes the identification information.

Preferably, the non-transitory computer-readable recording medium is such that the method further comprises: transmitting the voice received through the microphone to a server; and receiving, from the server, the information on the external device.

Preferably, the non-transitory computer-readable recording medium is such that the method further comprises: based on information on a plurality of external devices being acquired from the voice received through the microphone, transmitting information on the access point sequentially to the plurality of external devices to enable the plurality of external devices to communicate with the server.

In accordance with another aspect of the disclosure, a controlling method of an electronic apparatus is provided. The controlling method of an electronic apparatus includes acquiring, from a voice received through the microphone, information on an external device which a user wishes to register, and based on an external device corresponding to the acquired information being searched, transmitting information on an AP to the external device to enable the external device to communicate with a server, and transmitting a registration request with respect to the external device to the server.

First, the terms used in the Specification and claims have chosen generic terms in view of their function in various embodiments of the disclosure. However, these terms may vary depending on the intentions, legal or technical interpretations of the artisan skilled in the art, and the emergence of new technologies. In addition, some terms may be terms arbitrarily selected by the applicant. These terms may be construed in the meaning defined herein and, unless otherwise specified, may be construed on the basis of the entire contents of this Specification and common technical knowledge in the art.

The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the embodiments. However, it is apparent that the embodiments may be practiced without those specifically defined matters.

The terms such as "first," "second," and so on may be used to describe a variety of elements, but the elements should not be limited by these terms. The terms are used only for the purpose of distinguishing one element from another.

A singular expression includes a plural expression, unless otherwise specified. It is to be understood that the terms such as "comprise" or "consist of" are used herein to designate a presence of characteristic, number, operation, element, component, or a combination thereof, and not to preclude a presence or a possibility of adding one or more of other characteristics, numbers, operations, elements, components or a combination thereof.

In the example embodiments of the disclosure, a 'module' or a 'unit' may perform at least one function or operation, and be implemented as hardware (e.g., circuitry) or software, or as a combination of hardware and software. Further, except for the 'module' or the 'unit' that has to be implemented as particular hardware (e.g., a dedicated processor), a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and implemented as at least one processor.

Further, in the embodiment of the disclosure, when a part is connected to another part, this includes not only a direct connection but also an indirect connection through another medium. Also, the meaning that a part includes an element does not exclude other elements, but may include other elements, unless specifically stated otherwise.

The disclosure will be described in greater detail below with reference to the accompanying drawings.

The electronic apparatus according to various embodiments may include at least one of a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an moving picture experts group phase <NUM> or phase <NUM> (MPEG-<NUM> or MPEG-<NUM>) audio layer-<NUM> (MP3) player, a mobile medical device, a camera, or a wearable device. According to various embodiments, the wearable device may be of the type of accessory (e.g., a watch, a ring, a bracelet, a bracelet, a necklace, glasses, a contact lens or a head-mounted-device (HMD)), a fabric or clothing (e.g., an electronic garment), a body attachment (e.g., a skin pad or tattoo), or a bio-implantable (e.g., implantable circuit).

In another embodiment, the electronic apparatus may be a home appliance. Home appliances may include at least one of, for example, televisions (TVs), digital video disc (DVD) players, audio, refrigerators, air-conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set-top box, home automation control panel, a security control panel, a TV box such as Samsung HomeSync ™, Apple TV ™ or Google TV ™), a game console (e.g., Xbox ™, PlayStation ™), an e-dictionary, an electronic key, a camcorder, or an electronic photo frame.

In another embodiment, the electronic apparatus <NUM> (e.g., first device <NUM>) may include at least one of a variety of medical devices such as various portable medical measurement devices (a blood glucose meter, a heart rate meter, a blood pressure meter or a temperature measuring device, a magnetic resonance angiography (MRA), a magnetic resonance imaging (MRI), computed tomography (CT), a photographing device, or an ultrasonic device, etc.), a navigator, global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), automotive infotainment devices, marine electronic equipment (e.g., marine navigation devices, gyro compasses, etc.), avionics, security devices, head units for the vehicle, industrial or home robots, automatic teller's machine (ATM), point of sales (POS) of a store, or internet of things (e.g., light bulbs, various sensors, electricity or gas meters, sprinkler devices, fire alarms, thermostats, street lights, a toaster, a fitness equipment, a hot water tank, a heater, a boiler, etc.).

In another embodiment, the electronic apparatus <NUM> may include at least one of a piece of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., water, electricity, gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic apparatus may be a combination of one or more of the various devices described above. The electronic apparatus according to some embodiments may be a flexible electronic apparatus. Further, the electronic apparatus according to the embodiment of the disclosure is not limited to the above-described devices, and may include a new electronic apparatus according to technological advancement.

<FIG> is a view to describe a system <NUM> according to an embodiment of the disclosure.

Referring to <FIG>, a system <NUM> includes a first device <NUM>, a second device <NUM>, a server <NUM>, and an access point (AP) <NUM>.

The first device <NUM> is an electronic apparatus and may be a home appliance such as a TV, an air-conditioner, a refrigerator, a washing machine, a robot cleaner, a humidifier, a door lock, a dish washer, a security camera, a closed circuit television (CCTV), a security sensor, light emitting diode (LED), a lamp, a heating device, a power measuring device, a power socket, an electricity socket, a multi-tap, personal computer (PC), internet protocol (IP) camera, internet telephone, wired / wireless telephone, electrically-controllable curtain, and blind.

The first device <NUM> may communicate with an external device such as the second device <NUM> and the server <NUM>. For example, the first device can communicate with an external device by communication methods such as Wi-Fi, ZigBee, and Z-Wave.

The second device <NUM> is a device that can register the first device <NUM> on the server <NUM> based on the user's voice. The second device <NUM> may be a device pre-registered in the server <NUM>. The registration of the second device <NUM> can be performed through a third device, for example, a user terminal device <NUM> shown in <FIG>.

The second device <NUM> may control the first device <NUM> based on a user's voice.

The second device <NUM> is an electronic apparatus which can be operating by a voice command and includes a microphone. The second device <NUM> may be an apparatus, for example, a smartphone, a tablet, and a digital TV, or an artificial intelligent speaker that can perform an action in response to a user command as if the speaker has a conversation with a user.

The second device <NUM> may interact with the first device <NUM> through the server <NUM> or by using device-to-device (D2D) or peer-to-peer (P2P) connection.

The second device <NUM> may execute a smart home application and provide various services to the user through its own display. The smart home application may be embedded in the second device <NUM> or downloaded from an app store such as Google Play™ or Samsung Apps™. The first device <NUM> can be registered or controlled in the server <NUM> by executing the smart home application in the second device <NUM>.

The server <NUM> may be implemented as a cloud server. According to one embodiment, the server <NUM> may include an account server and a service server. The account server can perform user authentication. In particular, the account server can perform user authentication based on voice recognition. The service server can perform functions such as web portal, status information management of devices, remote access, device update, message notification, and so on.

A service provided by the system <NUM> can be largely divided into device registration and device control.

Device registration is a procedure, for example, that the second device <NUM> supports a new first device <NUM> to access the access point (AP) <NUM>, and registers the first device <NUM> to the server <NUM>.

Device control is a procedure that a user controls the first device <NUM> registered in the server <NUM> through the server <NUM> using the second device <NUM> or a device different from the second device <NUM>.

When the first device <NUM> and the second device <NUM> are used at home, they can be called a home device. The first device <NUM>, the second device <NUM> and the server <NUM> can communicate directly or through the home gateway. The home gateway can manage and control the home devices, in overall, in the home network including the first device <NUM> and the second device <NUM> in cooperation with the server <NUM>.

<FIG> is a block diagram to describe a configuration of an electronic apparatus according to an embodiment of the disclosure.

Referring to <FIG>, the second device <NUM> includes a microphone <NUM>, a communicator <NUM> (e.g., a communication circuit or a transceiver), a memory <NUM>, and a processor <NUM> (e.g., at least one processor).

The microphone <NUM> is a structure for receiving sound. The microphone <NUM> may convert the received sound into an electrical signal. The microphone <NUM> may be implemented integrally with the second device <NUM>.

The communicator <NUM> may include various communication circuitry to perform communication with various types of external devices. The communicator <NUM> may communicate with an external device using at least one of Wi-Fi, Bluetooth, near field communication (NFC), infrared data association (IrDA), radio frequency identification (RFID), ultra-wide band (UWB), Wi-Fi direct, Z-wave, internet protocol version <NUM> (IPv4) over low-power wireless personal area networks (4LoWPAN) or 6LoWPAN, general packet radio services (GPRS), Weightless, digital living network alliance (DLNA), ANT+, digital enhanced cordless telecommunications (DECT), wireless local area network (WLAN), global system for mobile communications (GSM), universal mobile telecommunication system (UMTS), and wireless broadband (WiBRO). The communicator <NUM> may be implemented as a communication chip and a transceiver to perform communication as described above.

The memory <NUM> may, for example, include an embedded memory <NUM> or an external memory <NUM>. The embedded memory <NUM> may, for example, include at least one of a volatile memory (e.g. dynamic random access memory (DRAM)), a static RAM, a synchronous dynamic RAM (SDRAM), a non-volatile memory (e.g. one time programmable read only memory (OTPROM)), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g. NAND flash or NOR flash, etc.), a hard drive, and a solid state drive (SSD).

The external memory may further include a flash drive, such as a compact flash (CF), a secure digital (SD), a micro secure digital (Micro-SD), a mini secure digital (Mini-SD), an extreme digital (xD), a multi-media card (MMC), or a memory stick. The external memory may be connected to the electronic apparatus <NUM> functionally and/or physically through various interfaces.

The memory <NUM> may be implemented as not only a storage medium inside the second device <NUM> but also a web server through network, and so on.

The memory <NUM> is accessed by the processor <NUM>, and read / write / modify / delete / update of data by the processor <NUM> can be performed. The term memory in this document refers to the memory <NUM> (not shown), a ROM in the processor <NUM>, a RAM, or a memory card (for example, a micro SD card and a memory stick) provided on the second device <NUM>. The memory <NUM> may store computer executable instructions.

The processor <NUM> is a configuration for controlling the overall operation of the second device <NUM>. The processor <NUM> may be implemented, for example, as a central processing unit (CPU), an application specific integrated circuit (ASIC), a system on chip (SoC), a MICOM, or the like. The processor <NUM> may operate an operating system or an application program to control a plurality of hardware or software components connected to the processor <NUM>, and may perform various data processing and operations. According to one embodiment, the processor <NUM> may further include a graphics processing unit (GPU) and / or an image signal processor. The processor <NUM> may execute the computer executable instructions to perform the functions of the second device <NUM> according to various embodiments of the disclosure.

According to the invention, the processor <NUM> acquires information on an external device that the user desires to register from the voice received through the microphone <NUM>, and when an external device corresponding to the acquired information is searched through the communicator <NUM> from among the external devices, the processor controls the communicator <NUM> to transmit, to the external device, information on the access point <NUM> so that the external device can communicate with the server <NUM>, and controls the communicator <NUM> to transmit a request for registration with respect to the external device to the server <NUM>.

Here, the processor <NUM> may search for an external device whose service set identifier (SSID) includes the acquired information on the external device.

Information on an access point <NUM> which the second device <NUM> transmits to an external device may be information used by the second device <NUM> to contact the access point <NUM>.

According to one embodiment, the processor <NUM> uses the learned speech recognition model using the artificial intelligence (AI) algorithm stored in the memory <NUM> and may acquire information on an external device which the user wishes to register from voice received through the microphone <NUM>.

According to still another embodiment, the server <NUM> may have a learned speech recognition model using an artificial intelligence algorithm, and the processor <NUM> may control the communicator <NUM> to transmit the voice received through the microphone <NUM> to the server <NUM>, and receive information on an external device from the server <NUM> through the communicator <NUM>.

The processor <NUM>, when information on a plurality of external devices which a user desires to register is acquired from the voice received through the microphone <NUM>, may control the communicator <NUM> to transmit information on the access point sequentially to the plurality of external devices and control the communicator <NUM> to transmit a registration request for the plurality of external devices to the server <NUM>.

According to an embodiment, the second device <NUM> further includes a speaker, and when the information about the external device to which the user wants to register is acquired from the voice, the processor <NUM> controls the communicator <NUM> to transmit control information for causing the external device to output information indicating that the external device is to be registered, outputs an inquiry voice to register the external device through a speaker, and when voice to agree the inquiry voice is received through the microphone <NUM>, controls the communicator <NUM> to transmit the information on the access point to the external device, and controls the communicator <NUM> to transmit a registration request with respect to the external device to the server <NUM>.

According to an embodiment, the processor <NUM>, when audio data including a voice indicating that registration of the external device is completed is received from the server <NUM>, may control a speaker of the second device <NUM> to output the audio data.

<FIG> is a view to describe a procedure to register the first device according to an embodiment to the server <NUM>. Here, the second device <NUM> may be a device previously registered in the server <NUM>.

Referring to <FIG>, the user speaks to register the first device <NUM>, and the user's voice is received through a microphone <NUM> of the second device <NUM> in operation S310. For example, if the first device <NUM> is a refrigerator, the user can say "register refrigerator. " Alternatively, the user may include a trigger word to activate a voice command function of the first device <NUM>. For example, a user can say "Bixby, register a refrigerator.

The second device <NUM> acquires information about a device to be registered by the user from the received voice in operation S320. For this, an analysis process for voice is performed. For example, the second device <NUM> may transmit the received voice to the server <NUM>, and the server <NUM> may include a speech recognition model and may obtain context information from the voice received using the speech recognition model. The speech recognition model may be an artificial intelligence model learned by artificial intelligence algorithms. For example, the speech recognition model may include a Speech to Text (SPP) module for converting speech to text, and a Natural Language Understanding (NLU) module for processing natural language understanding of the converted text. The server <NUM> may transmit the context information of the voice to the second device <NUM>. The context information may include information on the first device and information indicating that the first device is to be registered. Here, the information about the first device may include the name of the first device. The server <NUM> may use a word which a user speaks as it is or use a modified word as a name of the first device. For example, even if the user says "register a TV," the server <NUM> can use "TV" rather than "television" as a name of the device. The name of the first device may be provided in a language corresponding to the user's voice. According to one embodiment, if the language corresponding to the user's voice is not English, the server <NUM> may provide a translation of the first device name into English.

As described above, the second device <NUM> can acquire information of a device to be registered through the server <NUM>. According to still another embodiment, the second device <NUM> includes a speech recognition model, and the second device <NUM> can acquire information on the device that the user intends to register from the voice.

The second device <NUM> communicates with the first device <NUM> based on the information about a device which the user wishes to register that is acquired by the user from the voice in operation S330. The connection between the second device <NUM> and the first device <NUM> will be described below.

According to an embodiment, the first device <NUM> may execute a soft AP function, allow access of the second device <NUM> as if the AP to connect communication with the second device <NUM>.

Specifically, the first device <NUM> may transmit a beacon periodically by executing a soft AP function. The beacon is a signal for allowing the first device <NUM> to inform its surroundings of its existence so that a peripheral device can detect the first device and participate in the mutual communication. The beacon may include a Service Set Identifier (SSID), a beacon interval, capability information, and the like of the first device <NUM> and may be variously expressed using a vendor specific field.

The soft AP function can be executed manually or automatically. According to the embodiment that is manually performed, for example, the soft AP function can be executed by pressing a button or the like provided on the first device <NUM> by the user. According to the embodiment that is automatically performed, when the first device <NUM> is not registered in the server <NUM>, the first device <NUM> can automatically execute the soft AP function. For example, when the user purchases the first device <NUM> and connects the power source, the first device <NUM> can automatically execute the soft AP function. According to still another embodiment, it is also possible for the second device <NUM> to execute the AP function of the first device <NUM>. For example, when the user utters a voice to register a specific device, the second device <NUM> can transmit a signal (IR signal, ultrasonic signal, etc.) for executing the AP function. The first device <NUM> includes a configuration capable of receiving a signal transmitted from the second device, and execute the AP function by receiving the signal.

According to one embodiment of the disclosure, the SSID contained in the beacon transmitted by the first device <NUM> may include a character string that allows the first device to recognize what the first device is, and can be uniquely assigned to each device or by devices of the same model. If necessary, the SSIDs can be dynamically allocated, and allocated using a specific rule through the application. When the first device <NUM> is, for example, a smart home device (a device supporting the IoT function), the SSID can be generated based on a smart home protocol (SHP), which is an indicator indicating that the smart home device, types of a device, a production date, a version and so on. For example, if the first device <NUM> is a refrigerator that supports smart home functionality and is produced in <NUM>, the SSID <NUM> of the first device <NUM> may be configured as "SHP.

When the beacon is received, the second device <NUM> may analyze information included in the beacon and determine whether the first device <NUM> transmitting the beacon corresponds to the device that the second device <NUM> desires to register. For example, the second device <NUM> may acquire information about a device to be registered by the user from the voice, check whether the beacon includes the information corresponding to the acquired information, and determine whether the first device <NUM> corresponds to the device which the first device <NUM> would like to register. For example, if the information about the device obtained from the voice includes the word "Fridge", it can be determined that the first device <NUM> whose SSID "SHP. <NUM>" includes "Fridge" is a device which a user wishes to register.

If it is determined that the first device <NUM> transmitting the beacon is a device which the user wishes to register, the second device <NUM> may communicate with the first device <NUM> using information included in the beacon.

According to still another embodiment of the disclosure, when the second device <NUM> acquires information on a device to be registered by a user from a voice, the second device may broadcast a probe request, and the first device <NUM> which detects the probe request can transmit the probe response to the second device <NUM>. The probe response may include information such as an SSID as the beacon described above. In the same manner as the embodiment in which the beacon is used, the second device <NUM> may analyze the information included in the probe response and determine whether or not the first device <NUM> that has transmitted the probe response corresponds to the device that the user intends to register. If it is determined that the first device <NUM> transmitting the probe response corresponds to the device to be registered, the second device <NUM> may communicate with the first device <NUM> using the information included in the probe response.

According to still another embodiment, the first device <NUM> and the second device <NUM> can be communicated via Wi-Fi P2P.

Specifically, when the first device <NUM> and the second device <NUM> enter the P2P terminal discovery mode, they can perform the P2P terminal search. For example, the first device <NUM> and the second device <NUM> may be configured such that an application using Wi-Fi P2P is automatically activated according to a user's input or need, or enter a P2P terminal search mode by a request of Wi-Fi simple configuration (WSC), and so on. For example, the second device <NUM> may enter the P2P terminal search mode when context information including information indicating that the device <NUM> is to be registered is received from the server <NUM>. Then, the second device <NUM> can transmit a signal (IR signal, ultrasonic signal, etc.) for entering the P2P terminal search mode, and the first device <NUM> can receive the signal and enter the P2P terminal search mode.

The second device <NUM> performs a Wi-Fi P2P search to detect a device that the user intends to register. Here, the Wi-Fi P2P search includes a device discovery process for recognizing each other and a service discovery process for a device discovered through the device search process. Through such device search and service search processes, a user can determine a device to be registered.

Specifically, in the service discovery process, it is possible to know what services a counterpart device supports through a service discovery query and a service discovery response. For example, the service protocol type field of the service discovery response includes a value corresponding to a service protocol type indicating which service is supported. For example, if the value <NUM> is Bonjour, the value <NUM> is UpnP, the value <NUM> is WS-Discovery, the value <NUM> is an identifier indicating that the device type is a refrigerator, and the value <NUM> is an identifier indicating that the device type is an air-conditioner, when a device has a value of "<NUM>," the device can be determined as a refrigerator. The service protocol type corresponding to the device type may be assigned to a value that is not used by another service protocol or a vendor specific value.

The second device <NUM> may receive a value corresponding to a service protocol type from the first device <NUM> and if the received value corresponds to the device information acquired from the voice, the second device may determine that the first device <NUM> is a device the user wishes to register.

The second device <NUM> performs a Wi-Fi P2P connection with the first device <NUM> that is determined to be a device a user wishes to register. Specifically, the first device <NUM> and the second device <NUM> may perform a Provision Discovery Exchange and perform provisioning to form a Wi-Fi P2P connection.

In the above description, it has been described that the first device <NUM> and the second device <NUM> are connected by the Soft Ap and the Wi-Fi P2P communication method. However, the first device <NUM> and the second device <NUM> can be connected using various communication methods such as bluetooth low energy (BLE) , Bluetooth, ZigBee, radio frequency (RF) communication, Z-wave, and so on.

When connection between the first device <NUM> and the second device <NUM> is established, the second device <NUM> transmits information about the pre-stored access point (AP) <NUM> to the first device <NUM> in operation S340. The information about the AP <NUM> may be information about the AP <NUM> to which the second device <NUM> has previously been connected. The information on the AP <NUM> may include an SSID and a security type of the AP <NUM>, an encryption type, a security key, and the like. In addition, the second device <NUM> may transmit the server authentication information to the first device <NUM>. The server authentication information is information used by the first device <NUM> to make a registration request to the server <NUM>. The second device <NUM> may request to the server <NUM> the server authentication information to be used by the first device <NUM> and receive the same.

Though not illustrated in <FIG>, communication is established between the first device <NUM> and the second device <NUM>, and the first device <NUM> may transmit identification information of the first device <NUM> to the second device <NUM>. The identification information of the first device <NUM> is information for allowing another device to identify the first device <NUM> and may include information such as a type, a name, a description, a manufacturer, a model ID, serial number, a sales location, versions, and so on.

The identification information of the first device <NUM> is temporarily stored in the second device <NUM> before the information of the first device <NUM> is registered in the server <NUM>, and after the information is registered in the server <NUM>, the information can be removed from the first device <NUM>. The identification information of the first device <NUM> received by the second device <NUM> can be used in the registration request of the first device in operation S380.

Thereafter, through it is not illustrated, the first device <NUM> and the second device <NUM> can be disconnected. The second device <NUM> can be connected to the AP <NUM>.

The first device <NUM> may access the AP <NUM> using the information about the AP <NUM> transmitted from the second device <NUM> in operation S350. The first device <NUM> may be connected to the network by receiving an IP address from the AP <NUM> in operation S360. The first device <NUM> can communicate with an external device such as the server <NUM> through the AP <NUM>. The first device <NUM> may send an advertisement message that includes information that the first device is connected to the network to the second device <NUM>.

The second device <NUM> can log in to a user account of the server <NUM> based on the user's voice received in operation S310 (S370). Since the voice includes information that allows the user to be identified, such as a fingerprint, the voice can play a role such as an ID and a password. Specifically, the second device <NUM> may transmit the voice of the user to the server <NUM>, and when the voice feature information of the user pre-registered the server <NUM> and the feature information of the voice transmitted to the server <NUM> correspond to each other, a login can be made. It is possible that the login may also be performed in operation S310.

The second device <NUM> then transmits, to the server <NUM>, a registration request requesting registration of the first device <NUM> in operation S380. At this time, the transmitted registration request may include the identification information of the first device <NUM> and may include information on the installation location of the second device <NUM>.

The first device <NUM> may transmit to the server <NUM> a registration request using the server authentication information in operation S390. The transmitted registration request may include identification information of the first device <NUM>.

When the registration request received from the second device <NUM> and the registration request received from the first device <NUM> correspond to each other, the server <NUM> may register the first device <NUM> to a user account logged in by voice in operation S395. Here, the server <NUM>, if identification information of the first device included in the registration request received from the second device <NUM> and the first identification information of the first device included in the registration request from the first device <NUM> are the same from each other, may register the first device <NUM> to a user account. In this case, the identification information of the first device <NUM> and the information on the installation location of the second device <NUM> may be registered as information on the first device.

The server <NUM> can transmit control information to the first device <NUM> so that information indicating the completion of the registration of the first device <NUM> is output from the first device <NUM>. If the first device <NUM> includes a display, a message such as "registration is completed" may be output via the display. When the first device <NUM> includes a speaker, a voice such as "registration is completed" may be output through the speaker.

The server <NUM> may transmit control information to the second device <NUM> so that information indicating completion of registration of the first device <NUM> is output from the second device <NUM>. If the registered first device is a refrigerator and the second device <NUM> includes a speaker, a voice "registration of the refrigerator is completed" may be outputted through the speaker, and if the second device <NUM> includes a display, the message "registration of the refrigerator is completed" can be output through the display.

According to still another embodiment of the disclosure, when information about a plurality of devices to be registered by the user is obtained from the voice received through the microphone <NUM> of the second device <NUM>, the plurality of devices can be registered in the server <NUM>. This will be described with reference to <FIG>.

<FIG> is a flowchart to describe a procedure to register a plurality of devices at a time according to an embodiment of the disclosure.

In the embodiment referring to <FIG>, it has been described an example that only one first device <NUM> is registered, in <FIG>, an example of registering the first device <NUM> and a third device <NUM> at the same time will be described.

Referring to <FIG>, the user speaks to register the first device <NUM>, and the voice of the user is received through the microphone <NUM> of the second device <NUM> in operation S510. For example, if the first device <NUM> is a refrigerator and the third device is a TV, the user can speak "register a refrigerator and TV" as shown in <FIG>. Alternatively, the user may speak including a trigger word for activating the voice command function of the first device <NUM>. For example, a user may say "Bixby, register a refrigerator and TV.

<FIG> is a view to describe a method for registering a device with a voice according to an embodiment of the disclosure.

The second device <NUM> acquires information about a device that the user wishes to register from the received voice in operation S515. Information can be obtained from the voice as described in operation S320 of <FIG>. For example, the second device <NUM> may transmit the received voice to the server <NUM>, and the server <NUM> may obtain the context information from the received voice using the speech recognition model. The server <NUM> may transmit the context information acquired from the voice to the second device <NUM>. The context information may include information on the first device <NUM> and the third device <NUM> and information indicating that the first device <NUM> and the third device <NUM> are to be registered.

As described above, the second device <NUM> can acquire information of a device to be registered through the server <NUM>. According to still another embodiment, the second device <NUM> includes a speech recognition model, so that the second device <NUM> can acquire information on the device that the user wishes to register from the voice.

If the second device <NUM> determines that the user wants to register a plurality of devices based on the information about the device that the user wishes to register, the second device <NUM> can sequentially establish communication with the plurality of devices. First, the second device <NUM> can establish a communication connection with the first device <NUM> in operation S520. In this case, communication can be established as described in operation S330 of <FIG>.

When communication is established between the first device <NUM> and the second device <NUM>, the second device <NUM> may transmit information about the pre-stored access point (AP) <NUM> to the first device <NUM> in operation S525. In addition, the second device <NUM> may transmit the server authentication information to the first device <NUM>. The first device <NUM> may transmit the identification information of the first device <NUM> to the second device <NUM>. The identification information of the first device <NUM> received by the second device <NUM> may be used in the registration request in operation S570.

The second device <NUM> may disconnect connection with the first device <NUM> to be connected to the third device <NUM> in operation S530.

After the disconnection, the second device <NUM> may establish connection with the third device in operation S535. Here, as described in S330 of <FIG>, communication connection can be established.

When communication is established between the first device <NUM> and the third device <NUM>, the second device <NUM> may transmit information about the pre-stored access point (AP) <NUM> to the third device <NUM> in operation S540. Also, the second device <NUM> may transmit the server authentication information to the third device <NUM>. The third device <NUM> may transmit the identification information of the third device <NUM> to the second device <NUM>. The identification information of the third device <NUM> received by the second device <NUM> may be used for the registration request in operation S570.

Then, the second device <NUM> may disconnect connection with the third device <NUM> and access the AP <NUM>.

The first device <NUM> may access the AP <NUM> using the information about the AP <NUM> transmitted from the second device <NUM> in operation S545. The first device <NUM> may be connected to the network by receiving an IP address from the AP <NUM> in operation S550. The first device <NUM> can communicate with an external device such as the server <NUM> through the AP <NUM>. The first device <NUM> may transmit, to the second device <NUM>, an advertisement message that includes information that the first device is connected to the network.

Likewise, the third device <NUM> can access the AP <NUM> using the information about the AP <NUM> transmitted from the second device <NUM> in operation S555. Then, the third device <NUM> is allocated with an IP address from the AP <NUM> and can be connected to the network in operation S560. The third device <NUM> can communicate with an external device such as the server <NUM> through the AP <NUM>. The third device <NUM> may transmit, to the second device <NUM>, an advertisement message which includes information that the third device <NUM> is connected to the network.

Thereafter, the second device <NUM> may log in to the user account of the server <NUM> based on the user's voice received in the operation S510 in operation S565. As described in S370 of <FIG>, log-in can be performed.

Thereafter, the second device <NUM> may transmit, to the server <NUM>, a registration request requesting registration of the first device <NUM> and the third device <NUM> in operation S570. At this time, the transmitted registration request may include the identification information of the first device <NUM> and the identification information of the third device <NUM>, and may further include information on the installation location of the second device <NUM>.

The first device <NUM> may transmit the registration request to the server <NUM> using the server authentication information in operation S575. At this time, the transmitted registration request may include the identification information of the first device <NUM>. The third device <NUM> may similarly transmit the registration request to the server <NUM> using the server authentication information in operation S580. Here, the transmitted registration request may include identification information of the third device <NUM>.

When the registration request received from the second device <NUM> and the registration request received from the first device <NUM> correspond to each other, the server <NUM> may register the first device <NUM> and the third device <NUM> to a user account which is logged in with voice in operation S590. At this time, the server <NUM>, only in a case where the identification information of the first device included in the registration request received from the second device <NUM> and the identification information of the first device included in the registration request received from the first device <NUM> are the same from each other, may register the first device <NUM> to a user account, and only in a case where the identification of the third device included in the registration request received from the second device <NUM> and the identification information of the third device included in the registration request received from the third device <NUM> are the same from each other, may register the third device <NUM> to a user account. In this case, the identification information of the first device <NUM> and the information of the installation location of the second device <NUM> can be registered as the information of the first device, and the identification information of the third device <NUM> and the information on installation position of the second device <NUM> can be registered as the information on the third device.

After that, the server <NUM> can transmit control information to the first device <NUM> so that information indicating the completion of registration of the first device <NUM> is output from the first device <NUM>, and transmit, to the third device <NUM>, control information for causing the third device <NUM> to output information informing completion of registration of the first device <NUM>.

According to still another embodiment of the disclosure, the server <NUM> may transmit control information for causing the second device <NUM> to output information indicating completion of registration of the first device <NUM> and the third device <NUM> to the second device <NUM>. In the case where the second device <NUM> includes a speaker, a voice of "the registration of the refrigerator and the TV is completed" can be outputted through the speaker, and when the second device <NUM> includes the display, "the registration of the refrigerator and TV is completed" may be output on the display.

According to an embodiment with reference to <FIG>, there is an advantage that a user does not need to have an irritating process that a user needs to register each of a plurality of devices when registering a plural of devices.

<FIG> is a block diagram to describe a configuration of a server <NUM> according to an example not forming part of the invention.

The server <NUM> may be implemented as a cloud server, and can be divided into a plurality of servers according to functions. For example, the server <NUM> may include an account server and a service server. The account server can perform user authentication. In particular, the account server can perform user authentication based on voice recognition. The service server can perform functions such as web portal, information management for smart home devices, service interface for 3rd party application, remote access, device update, message notification, and so on.

Referring to <FIG>, the server includes a communicator <NUM> (e.g., a communication circuit or a transceiver), the memory <NUM>, and a processor <NUM> (e.g., at least one processor).

The communicator <NUM> (e.g., a communication circuit or transceiver) may include various communication circuitry for performing communication with various types of external devices. The communicator <NUM> may communicate with an external device using at least one of Wi-Fi, Bluetooth, near field communication (NFC), infrared data association (IrDA), radio frequency identification (RFID), ultra-wideband (UWB), Wi-Fi Direct, Z-wave, 4LoWPAN, GPRS , Weightless, Digital Living Network Alliance (DLNA), ANT +, Digital Enhanced Cordless Telecommunications (DECT), Wireless Local Area Network (WLAN), Global System for Mobile communications (GSM), Universal Mobile Telecommunication System (UMTS) wireless broadband (WiBRO), and the like. The communicator <NUM> may be implemented as a communication chip and a transceiver for performing the communication method described above.

A memory <NUM> may include, for example, internal memory or external memory. The internal memory may include at least one of a volatile memory such as a dynamic RAM (DRAM), a static RAM (SRAM), or a synchronous dynamic RAM (SDRAM); and a non-volatile memory such as an one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

The external memory may be a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), or a memory stick. The external memory may be functionally and / or physically connected to the server <NUM> via various interfaces.

The memory <NUM> is accessed by the processor <NUM>, and data read / write / modify / delete / update by the processor <NUM> can be performed. The term memory in the disclosure may include the memory <NUM>, a ROM in processor <NUM>, a RAM, or a memory card (e.g., micro SD card, memory stick) mounted in the server <NUM>. The memory <NUM> may store computer executable instructions.

The processor <NUM> is a configuration for controlling the overall operation of the server <NUM>. The processor <NUM> may be implemented as, for example, a CPU, ASIC, SoC, MICOM, or the like. The processor <NUM> may operate an operating system or an application program to control a plurality of hardware or software components connected to the processor <NUM>, and may perform various data processing and operations. According to one example, the processor <NUM> may further include a graphics processing unit (GPU) and / or an image signal processor. The processor <NUM> may execute the computer-executable instructions to perform the functions of the server <NUM>.

The user can generate an own account in the server <NUM> using a PC, a smart phone, or the like. For example, a user terminal device <NUM> shown in <FIG> can be used. The user can access the web page for account generation through the user terminal device <NUM> or execute the application for generating a user account. A web page or an application provides a UI screen for a new subscription, and a user can create an account through inputting an ID, a password, and the like to be used on the UI screen. The user can input the ID and password at a later time and log in to his or her account of the server <NUM> or log in using another way.

In particular, according to one example not forming part of the invention, a user may log in to his or her account of the server <NUM> by voice. In order to use the voice log-in function, for example, the user enters an ID and a password into the user terminal device <NUM> to log into his or her account of the server <NUM> and speaks to a microphone provided in the user terminal device <NUM>, and then the user's voice can be transmitted to the server <NUM>. In this case, the user's smartphone may be required to make a specific statement to obtain the feature information of the user's voice to be used for log-in. For example, the message "This is a voice registration procedure for using the voice log-in method. Please say the following words in order" may be displayed on the user terminal device <NUM>. Then, when the user speaks, the user terminal device <NUM> may transmit the user's voice to the server <NUM>, the server <NUM> may acquire the voice feature information from the received voice, and may store the voice feature information in the memory <NUM> as the voice log-in information. The user can log in to the own account in the server <NUM> only by speaking through the microphone provided in the user terminal device <NUM> or the second device <NUM>. Specifically, when the server <NUM> receives voice from the user terminal device <NUM> or the second device <NUM>, the server <NUM> may acquire the voice feature information from the received voice, and when the acquired voice feature information corresponds to the voice feature information of a user pre-registered in the memory <NUM>, log-in to the corresponding user account can be performed.

The server <NUM> may perform a voice recognition function using artificial intelligence (AI) technology. For example, the speech recognition model which is learned using the AI algorithm may be stored in the server <NUM>.

When voice (audio data) is received from the second device <NUM> through the communicator <NUM>, the processor <NUM> may determine whether the voice is of a registered user, and acquire context information from the voice using the speech recognition model. For example, if the received voice is "register the refrigerator", it can be determined that the context of the voice means registration of the refrigerator.

If the voice received from the second device <NUM> through the communicator <NUM> is related to the registration of the first device <NUM>, the processor <NUM> may control the communicator <NUM> to transmit information regarding the first device <NUM> to the second device <NUM>. The information about the first device <NUM> may include a name of the first device <NUM>. The information about the first device <NUM> transmitted to the second device <NUM> is information for allowing the second device <NUM> to identify the first device <NUM> among the scanned peripheral devices, and may include information corresponding to the SSID of the first device <NUM>, or information corresponding to the service protocol.

Thereafter, when a registration request for the first device <NUM> is received from the second device <NUM>, the processor <NUM> may perform the registration procedure for the first device <NUM>. An account by users is managed in the server <NUM>, and the first device <NUM> can be registered in a specific user account. For example, as shown in <FIG>, a device may be registered for each user. The first device <NUM>, the third device <NUM> and the fourth device <NUM> are registered in the account of the first user and the fifth device <NUM> and the sixth device <NUM> are registered in the account of the second user. The devices registered in the server <NUM> have unique IDs, and the devices registered in the account of one user can have the same group ID. The unique ID and group ID can be used for device control and management. The devices can store a unique ID, a group ID, and can be used for connection to the server <NUM>.

<FIG> is views to describe an example to register devices by user accounts to a server according to an example that does not form part of the invention.

The processor <NUM> may, if the voice received from the second device <NUM> is related to registration of a plurality of devices, control the communicator <NUM> to transmit information on the plurality of devices to the second device <NUM>.

According to an example, it is possible to register a device to a user account based on a voice.

For example, when the voice received from the second device <NUM> corresponds to the voice of the first user registered in the processor <NUM> and the registration request for the first device is received from the second device <NUM>, the processor <NUM> may register the first device to the account of a first user. That is, if the voice is a voice of the first user, the device can be registered to an account of the first user, and if the voice is a voice of the second user, the device can be registered to an account of the second user.

The memory <NUM> of the server <NUM> may store the voice feature information of the first user and the voice feature information of the second user and the processor <NUM> may, if the received voice is for registration of a device, compare the received voice feature information with voice feature information of pre-registered users to identify a user corresponding to the voice, and register a device to an account of the identified user.

According to an example the devices registered to an account of the first user can be set so that the first user can exclusively use, and devices registered to an account of the second user can be set so that the second user can exclusively use. This setting can be done at the registration stage, or after registration in accordance with a user's manipulation.

If the first device <NUM> of the first user is set to use the first user exclusively, information may be required to authenticate the first user to use the first device <NUM>. For example, when the first device <NUM> is to be used, the first device <NUM> may request biometric information (voice, face, fingerprint, iris, etc.), password, pattern, etc. of the first user as authentication information. Only in the case where the authentication information is input, the first device <NUM> can be used.

According to an example, a device can be registered as a common device. The device which is registered for a common use can be used by users of a predetermined group.

<FIG> is a view to describe this example to register devices by user accounts to a server according to an example that does not form part of the invention.

Referring to <FIG>, when the first user A says "register air-conditioner as a common device", the voice is input through the microphone <NUM> of the second device <NUM>, and can be transmitted to the server <NUM>. The server <NUM> can recognize that the voice is the voice of the first user A, and may, from among devices registered to an account of the first user A, register the air-conditioner <NUM> to an account of the second user who belongs to a same group as the first user. Accordingly, not only the first user but also the second user can use the air-conditioner <NUM>.

In the above-described example, it has been described that the devices already registered in the accounts of the first user A are registered as common devices, but it is also possible to register a new device not registered in any user's account as a common device. For example, when the user wishes to newly register the air-conditioner, if the user speaks "register the air-conditioner as a common device," the voice can be inputted through the microphone <NUM> of the second device <NUM> and transmitted to the server <NUM>. The server <NUM> may analyze the voice and transmit, to the second device <NUM>, the information indicating that the information on the air-conditioner and the air-conditioner are to be registered, and the second device <NUM> may perform a registration procedure as described above with reference to <FIG>, and the second device <NUM> may transmit, to the server <NUM>, a registration request requesting registration of the air-conditioner as a common device. The server <NUM>, when a registration request is received, may register the air-conditioner to an account of the first user and an account of the second user belonging to the same group as the first user.

As in the above-described examples, devices may be registered in accounts of all users belonging to the same group, or according to still another example, a user who may use the device together may be designated and registered. For example, if the first user says "register the air-conditioner to be used along with Jane (second user)", the air-conditioner can be registered in the accounts of the first user and the second user.

According to the examples described above, since the account can be managed by the voice recognition of the user and the user other than the registered user cannot use it, the privacy management can be performed. For example, by simply saying "register TV as my device," it is possible to register the device as a personal device, and by only simply "register TV as a common device," it is possible to register the device as a common device. Therefore, even users who are not familiar with the IoT device of the related art can register the device easily.

According to one example not forming part of the invention, the first device <NUM> registered in the account of the first user can be set such that the first user can exclusively use, and a device registered to an account of the second user can be set so that only the second user can exclusively use. For example, the first device <NUM> can be used only when pre-registered authentication information is input. The authentication method may be password input, voice recognition, face recognition, and the like. It is also possible for the user to directly input information for authentication for cancelling exclusive use to the first device <NUM> and to input the information for authentication through the second device <NUM> or another device. For example, when the voice of the first user A desiring to cancel the exclusive use of the first device <NUM> through the microphone <NUM> of the second device <NUM> is received, the second device <NUM> may transmit the voice to the server <NUM>, and the processor <NUM> may control the communicator <NUM> to transmit the control information for cancelling exclusive use of the first device <NUM> to the first device <NUM>.

The voice of the first user A to cancel the exclusive use can be a voice to register the first device <NUM> as a common device as described above.

According to still another example not forming part of the invention, the voice of the first user who wishes to cancel the exclusive use may be a voice to temporarily permit the use of the first device <NUM> to another user. In this case, the processor <NUM> may temporarily transmit to the first device <NUM> the control information allowing the use of the other user.

<FIG> is a view to describe an example to cancel an exclusive use of the device according to an example that does not form part of the invention.

<FIG> shows a case where, when the TV <NUM> (e.g., the first device <NUM>) is registered to the account of the first user A and the TV <NUM> is set to be exclusively used for the first user, a second user B wishes to use the TV <NUM>. When the second user B wishes to use the TV <NUM> (for example, press a power button of a remote controller or a power button of TV), the TV <NUM> may request authentication information. In this case, the TV <NUM> can output a message such as "Please make the remote control read your fingerprint for using TV" and "use is limited. " As illustrated in <FIG>, the message can be output from the TV <NUM>, and the TV <NUM> may send information informing the access of the unauthenticated user to the second device <NUM> and it is possible for the second device <NUM> to output the message. For example, if the second device <NUM> includes a speaker, a voice such as "the use of the TV is limited" may be output.

Thereafter, when the first user A utters a voice "let others use a TV for one hour", the voice is input through the microphone of the second device <NUM>, and the second device <NUM> may transmit the voice to the server <NUM>. The server <NUM> can analyze voice, determine that the first user A wishes to cancel the exclusive use of the TV <NUM> for an hour, and transmit control information to the TV <NUM> for use of the TV <NUM> during one hour.

According to still another example, when the first user A does not designate use time and speak, for example, "let others use TV as well", the TV <NUM> can be used by others during a preset time or until the TV <NUM> is turned off.

According to still another example, the first user A may designate the second user B to use the TV <NUM>. For example, if it is said that "let Jane (second user) use the TV", the second user B only can use the TV for a certain period of time and the other user can use the TV <NUM>.

According to the above-described examples, parental control such as restriction of the use of children's game machines is possible. For example, when a child attempts to control a game machine registered with the parent's voice, "use of this device is limited" is output. Then, if the parent who registered the game machine by voice says "allow use for one hour," the limitation can be cancelled for temporary use. In addition, this embodiment can be used for lock / unlock a safe or a personal storage space.

<FIG> is a view to describe an embodiment to request confirmation from a user to register a device according to an embodiment of the disclosure.

<FIG> is a view to describe a procedure to confirm with a user to prevent a device, which a user does not wish to register, from being registered.

The second device <NUM> may acquire information about a device that the user wants to register from the received user voice, search an external device <NUM> (e.g., the first device <NUM>) corresponding to the acquired information, communicate with the external device <NUM> through a communication connection, and transmit control information to the external device <NUM> so that information indicating that the external device is to be registered is outputted from the external device <NUM>.

The second device <NUM>, when a plurality of external devices corresponding to the information acquired from the voice are searched, may establish communication connection with a device having greatest signal intensity (for example, beacon) and transmit control information to output to the connected external device information indicating that an external device is to be registered.

The first device <NUM> receiving the control information from the second device <NUM> may output information indicating that the first device <NUM> is ready for connection. For example, it is possible to output a voice message such as "ready for connection". Such sound source files may be prestored in the device. It is also possible to visually output information indicating that the device is ready for connection.

Thereafter, the second device <NUM> may output information for inquiring whether to register the external device <NUM>. For example, as shown in <FIG>, the second device <NUM> can output an inquiry voice such as "Do you want to register the air-conditioner to be connected?" through a speaker. If a voice (for example, "yes" "register, please", etc.) to agree to the inquiry voice is received through the microphone <NUM>, the second device <NUM> may transmit the information on the AP <NUM> and the server authentication information to the external device <NUM>. Then, the registration procedure can then be performed as described in <FIG>.

When information inquiring whether or not the second device <NUM> registers the external device <NUM> is output, and when a voice (for example, "No," "do not register") not to agree to the inquiry voice is received, the second device <NUM> can terminate the registration procedure. Alternatively, if several devices are searched, communication connection can be established with a device having signal intensity which is second largest and have the same check process as described above.

According to an embodiment described above, accurate registration of a device intended by a user can be made.

When the first device <NUM> is registered in the server <NUM>, the user can control the device. However, such device control does not form part of the invention.

According to one example not forming part of the invention, the user can control the first device <NUM> by voice using the second device <NUM>. For example, when a first user who has registered the first device <NUM> as a voice speaks "Turn on TV (first device)", the second device <NUM> receives the voice and transmits the voice to the server <NUM>, and the server <NUM> transmits a turn-on control command to the first device <NUM> registered in the account of the first user, and the first device <NUM> receiving the control command can be turned on.

According to another example it is also possible to control the first device <NUM> using a device other than the second device <NUM>. Examples of other devices include smartphones, tablets, digital TVs (DTVs), and the like. Here, these devices are called user terminal devices.

<FIG> is a view to describe a user terminal device to communicate with a server according to an example not forming part of the invention.

Referring to <FIG>, a user terminal device <NUM> is a device registered to the server <NUM> such as the first device <NUM> and can be used for the purpose to control other registered devices.

An application executed in the user terminal device <NUM>, for example, a smart home application or the like, is used to access the server <NUM> to register a device, or information on the pre-registered device can be read or deleted. Control information for integrated control of the devices can be registered or registered control information can be read or deleted.

When the smart home application is executed in the user terminal device <NUM>, at the same time as the execution of the smart home application, the user terminal device <NUM> may automatically log in to its own account in the server <NUM> through a prestored user identifier (ID) and a password. For some cases, by receiving the ID and password from a user, a user's account in the server <NUM> can be logged in. The log-in information is maintained for a predetermined period unless a user logs out, so within the effective period during which log-in information is maintained, it is not necessary for a user to log in to the server <NUM> every time.

When the first user logs in through the user terminal device <NUM>, information to control the devices of the first user registered in the server <NUM> can be transmitted to the user terminal device <NUM>. The user terminal device <NUM> may configure and display a control screen based on received information. <FIG> illustrates an example of a control screen displayed in the user terminal device <NUM>.

The user terminal device <NUM> may display a control screen including a list of devices <NUM>, <NUM>, <NUM> registered to the account of the first user (Mike). A user may control the devices <NUM>, <NUM>, and <NUM>. For example, power of the devices <NUM>, <NUM>, and <NUM> can be turned on or turned off through a control screen.

The server <NUM> can manage status information through periodic communication with devices registered in the account of the first user and can transmit status information to the user terminal device <NUM>. In the user terminal device <NUM>, status information of the devices can be displayed. For example, as illustrated in <FIG>, status information indicating that a broadcast program of CH11 is being broadcast on the TV <NUM>, the air-conditioner <NUM> is operating at <NUM> degrees, and the robot cleaner is in the automatic cleaning mode can be displayed on the user terminal device <NUM>.

When the information is updated in the server <NUM>, updated information can also be displayed in the user terminal device <NUM>. For example, when a new device is registered in the server <NUM>, a new device can be displayed on the control screen of the user terminal device <NUM>. According to one embodiment, the control screen displayed on the user terminal device <NUM> includes a menu <NUM> for updating information. When the menu <NUM> is selected, the user terminal device <NUM> may request information update to the server <NUM>. Accordingly, when a new device is registered by voice through the second device <NUM>, a new device can be displayed also in the user terminal device <NUM>.

According to an example not forming part of the invention, not only a device can be registered by voice through the second device <NUM>, but a device can also be registered through the user terminal device <NUM>. When the menu <NUM> for registering a device is selected, the user terminal device <NUM> displays a list of devices searched for by searching external devices in the vicinity, and when the user selects a device to be registered in the list, the user terminal device <NUM> may register the selected device with the server <NUM>.

<FIG> is a flowchart to describe a controlling method of an electronic apparatus according to an embodiment of the disclosure. The flowchart on the controlling method of the electronic apparatus of <FIG> can be configured with operations processed by the second device <NUM> described in this specification. That is, the electronic apparatus can be the second device <NUM>. Therefore, even if the description is omitted, the description relating to the second device <NUM> can be applied to the flowchart of <FIG>.

The electronic apparatus is a device which includes a microphone. Referring to <FIG>, the electronic apparatus acquires information on an external device which a user wishes to register from a voice received from a microphone in operation S1210.

In this case, the electronic apparatus may transmit a voice received through the microphone to the server and receive information on the external device from the server.

When the external device corresponding to the acquired information is found, the electronic apparatus transmits information on the AP to the external device so that the external device can communicate with the server, and transmits a registration request with respect to the external device to the server in operation S1220.

In this case, the electronic apparatus may search for an external device whose SSID includes information on the acquired external device.

When information with respect to the plurality of devices which a user wishes to register is acquired from the voice received through the microphone, the information on the AP can be transmitted sequentially to the plurality of external devices and a registration request with respect to the plurality of external devices to the server.

When information about an external device to be registered by the user is obtained from the voice, the electronic apparatus may transmit control information for causing the external device to output information informing that the external device is a registration target to the external device and output voice of inquiry about the registration of the external device through the speaker of the electronic apparatus. The electronic apparatus may transmit information on the access point to the external device and transmit a registration request for the external device to the server when a voice agreeing with the voice of the inquiry is received through the microphone.

In the meantime, when audio data including voice informing completion of registration of the external device is received from the server, the electronic apparatus may output audio data through the speaker.

According to the aforementioned embodiments, a device registration procedure of a network management service in which devices are connected via network and managed at home and plants can be done easily using a voice, and the registered device can be controlled using the voice, thus user convenience can be improved.

The various embodiments described above may be implemented in software, hardware, or a combination thereof. In accordance with a hardware implementation, the embodiments described in this disclosure may be implemented by using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), a processor, a controller, a microcontroller, a microprocessor, and an electrical unit for performing other functions. According to a software implementation, embodiments such as the procedures and functions described herein may be implemented in separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

The various embodiments of the disclosure may be implemented as software that includes instructions that may be stored in machine-readable storage media readable by a machine (e.g., a computer). A device may call instructions from a storage medium and that is operable in accordance with the called instructions, including an electronic apparatus (e.g., the first device <NUM>, the second device <NUM>, the server <NUM>, and the user terminal device <NUM>). When the instruction is executed by a processor, the processor may perform the function corresponding to the instruction, either directly or under the control of the processor, using other components. The instructions may include a code generated or executed by the compiler or interpreter. Here, "non-transitory" means that the storage medium does not include a signal and is tangible, but does not distinguish whether data is permanently or temporarily stored in a storage medium.

According to one embodiment, a method according to various embodiments disclosed herein may be provided in a computer program product. A computer program product may be traded between a seller and a purchaser as a commodity. A computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)) or distributed online through an application store (e.g., PlayStore ™). In the case of on-line distribution, at least a portion of the computer program product may be stored temporarily or generated temporarily in a storage medium such as a manufacturer's server, a server of an application store, or a memory of a relay server.

Claim 1:
An electronic apparatus (<NUM>), comprising:
a communication circuit (<NUM>);
a microphone (<NUM>);
a memory (<NUM>) for storing instructions; and
at least one processor (<NUM>) configured to execute the instructions to:
in response to receiving (S310) a voice through the microphone (<NUM>), obtain information (S320) on an external device (<NUM>) as a result of performing an analysis of the voice,
based on the information on the external device, perform communication (S330) with the external device (<NUM>) through the communication circuit (<NUM>), and
control the communication circuit (<NUM>) to transmit (S340) information on an access point to the external device (<NUM>) to enable the external device (<NUM>) to communicate with a server and
control the communication circuit (<NUM>) to transmit (S380) a registration request with respect to the external device (<NUM>) to the server (<NUM>).