Electronic apparatus and control method thereof

An electronic apparatus is disclosed. The electronic apparatus includes: a microphone, an IC chip configured to, based on a level of a user voice received through the microphone being equal to or greater than a threshold value set as a first level, identify whether the user voice includes a wake-up-word (WUW), and a processor configured to, based on the WUW being included in the user voice, transmit a signal corresponding to the user voice to an external electronic apparatus, and based on the transmitting of the signal corresponding to the user voice being completed, set the threshold value as a second level lower than the first level, wherein the IC chip is configured to, based on a subsequent user voice being received through the microphone, identify whether a level of the subsequent user voice is equal to or greater than the threshold value set as the second level, and based on the level of the subsequent user voice being equal to or greater than the threshold value set as the second level, identify whether the subsequent user voice includes the WUW.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application No. 10-2019-0068939, filed on Jun. 11, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference herein in its entirety.

BACKGROUND

The disclosure relates to an electronic apparatus and a control method thereof. For example, the disclosure relates to an electronic apparatus capable of recognizing a user voice and a control method thereof.

2. Description of Related Art

Various electronic apparatuses have been developed recently due to the development of electronic technologies. In particular, voice recognition apparatuses such as a remote control, an AI (Artificial Intelligence) speaker, a smartphone, and a smart TV that recognize a user voice and operate according to the user voice have been developed.

It is common that the voice recognition device performs a recognition of a user voice, when the user voice of a predetermined size or more is received.

However, the conventional voice recognition apparatus recognizes the user voice even when the user voice of relatively low size is received in order to increase a recognition rate of the user voice.

However, this may result in unnecessary power consumption. For example, even when a daily conversation voice is received instead of the user voice for controlling the voice recognition apparatus, the conventional voice recognition apparatus performs recognition of the user voice.

SUMMARY

Embodiments of the disclosure provide an electronic apparatus capable of increasing a recognition rate of a user voice while preventing and/or reducing unnecessary power consumption.

According to an example embodiment of the disclosure, an electronic apparatus includes: a microphone, an IC chip configured to, based on a level of a user voice received through the microphone being equal to or greater than a threshold value set as a first level, identify whether the user voice includes a wake-up-word (WUW), and a processor configured to, based on the WUW being included in the user voice, transmit a signal corresponding to the user voice to an external electronic apparatus, and based on the transmitting of the signal corresponding to the user voice being completed, set the threshold value to a second level lower than the first level, wherein the IC chip is configured to, based on a subsequent user voice being received through the microphone, identify whether a level of the subsequent user voice is equal to or greater than the threshold value set as the second level, and based on the level of the subsequent user voice being equal to or greater than the threshold value set as the second level, identify whether the subsequent user voice includes the WUW.

According to an example embodiment of the disclosure, a control method of an electronic apparatus includes: identifying whether a level of a user voice received through a microphone is equal to or greater than a threshold value set as a first level, identifying whether the user voice includes a wake-up-word (WUW) based on the level of the user voice being equal to or greater than the threshold value set as the first level, transmitting a signal corresponding to the user voice to an external electronic apparatus based on the WUW being included in the user voice, and setting the threshold value to a second level lower than a first level based on a transmission of a signal corresponding to the user voice being completed, wherein the control method further includes based on a subsequent user voice being received through the microphone, identifying whether a level of the subsequent user voice is equal to or greater than the threshold value set as the second level; and based on the level of the subsequent user voice being identified to be equal to or greater than the threshold value set as the second level, identifying whether the subsequent user voice includes the WUW.

According to an example embodiment of the disclosure, an electronic apparatus includes: a microphone, an IC chip configured to, based on a level of a user voice received through the microphone being equal to or greater than a threshold value set as a first level, identify whether the user voice includes a wake-up-word (WUW) and a processor configured to, based on the WUW being included in the user voice, perform an operation corresponding to the user voice, and set the threshold value as a second level lower than the first level, wherein the IC chip is configured to, based on a subsequent user voice being received through the microphone, identify whether a level of the subsequent user voice is equal to or greater than the threshold value set as the second level, and based on the level of the subsequent user voice being equal to or greater than the threshold value set as the second level, identify whether the subsequent user voice includes the WUW.

DETAILED DESCRIPTION

The terms used in the present disclosure and the claims are general terms selected in consideration of the functions of the various example embodiments of the present disclosure. However, such terms may be varied depending on an intention of those skilled in the art, a legal or technical interpretation, an emergence of a new technology, and the like. Also, there may be some arbitrarily selected terms. Such terms may be construed according to descriptions in the present disclosure, and may also be construed based on general contents of the present disclosure and a typical technical concept in the art unless the terms are not specifically defined.

In describing example embodiments, detailed description of relevant known functions or components may be omitted if it would obscure the description of the subject matter.

Furthermore, embodiments of the disclosure will be described in detail with reference to the accompanying drawings and the contents described in the accompanying drawings, but the disclosure is not limited or limited by the embodiments.

Hereinafter, various example embodiments will now be explained in greater detail with reference to the accompanying drawings.

FIG. 1is a diagram illustrating an example electronic system according to an embodiment of the disclosure.

Referring toFIG. 1, the electronic system10according to an embodiment of the disclosure includes an electronic apparatus100and an external electronic apparatus200.

The electronic apparatus100may, for example, be an apparatus capable of controlling the external electronic apparatus200, and may be implemented, for example, as a remote controller, as illustrated inFIG. 1. However, this is only an example, and the disclosure is not so limited. For example, the electronic apparatus100may include an electronic apparatus such as, for example, and without limitation, a smartphone, a tablet PC, a laptop, or the like, and may include a wearable device such as a smart watch, or the like.

In addition, the external electronic apparatus200may, for example, be an electronic apparatus to be controlled by the electronic apparatus100, and as illustrated inFIG. 1, may, for example, be a smart TV200. However, this is only an example, and the external electronic apparatus200is not so limited and may include various electronic apparatus such as, for example, and without limitation, a TV, an air conditioner, a washing machine, a refrigerator, an air cleaner, a robot cleaner, a humidifier, a door lock, a dishwasher, a security camera, a closed circuit television (CCTV), a security sensor, a light emitting diode (LED), lamps, heaters, a power meter, a power socket, an electrical outlet, multi-taps, a personal computers (PC), IP cameras, or the like.

The electronic apparatus100may control the external electronic apparatus200.

For example, the electronic apparatus100may establish a communication link with the external electronic apparatus200through a communication method such as, for example, and without limitation, Wi-Fi, ZigBee, Z-Wave, Bluetooth, or the like, and transmit a control signal to the external electronic apparatus200through wireless communication to control the external electronic apparatus200.

The control signal may be a signal corresponding to the user voice. For example, when the user voice is received through a microphone of the electronic apparatus100, the electronic apparatus100may identify whether the user voice includes a wake-up-word (WUW). When it is determined that the user voice includes a wake-up-word, the electronic apparatus100may transmit a signal corresponding to the user voice to the external electronic apparatus200. Accordingly, the external electronic apparatus200may perform a function corresponding to the user voice.

The electronic apparatus100may transmit, for example, an IR signal for controlling the external electronic apparatus200to the external electronic apparatus200. For this operation, the electronic apparatus100may include an IR receiver.

Hereinafter, the electronic apparatus100of the disclosure will be described in greater detail with reference toFIG. 2.

FIG. 2is a block diagram illustrating an example electronic apparatus according to an embodiment of the disclosure.

Referring toFIG. 2, the electronic apparatus100includes a microphone110, an IC chip120, and a processor (e.g., including processing circuitry)130.

The microphone110may receive a user voice. The user voice may be a voice for controlling the external electronic apparatus200, and may be various voices that occur around the electronic apparatus100.

The IC chip120may measure a level of the user voice received through the microphone110. For example, when the user voice is received through the microphone110of the IC chip120, a size (e.g., level) of the user voice may be measured based on an amplitude of the user voice.

However, this is only an example, and the IC chip120may measure the size of the user voice through various methods. As an example embodiment, the IC chip120may measure the size of the user voice based on a sensing value of a sensor that outputs a voltage having a size corresponding to the size of the user voice. For this operation, the IC chip120may include a sound detection sensor.

When the size of the user voice received through the microphone110is greater than or equal to a predetermined threshold value, the IC chip120may identify whether the user voice includes a wake-up-word (WUW).

For example, if the size of the user voice received through the microphone110is greater than or equal to the predetermined threshold value, the IC chip120may convert the user voice, which is an analog signal, into a digital signal. For this operation, the IC chip120may use an analog/digital converter (not illustrated). In addition, the IC chip120may apply a speech to text (STT) algorithm to the user voice converted into the digital signal, convert the user voice into text, and identify whether the text includes a wake-up-word.

For example, if the wake-up-word is ‘Hi, Bixby’, the IC chip120may identify whether ‘Hi, Bixby’ is included in the text.

Thereafter, when it is determined that the user voice includes the wake-up-word, the IC chip120may transmit a wake-up signal to the processor130.

The processor130may include various processing circuitry and control the overall operation of the electronic apparatus100. The processor130may include, for example, and without limitation, one or more of a dedicated processor, a central processing unit (CPU), application processor (AP), a communication processor (CP), or the like.

The processor130may transmit the wake-up signal received from the IC chip120to the external electronic apparatus200.

For example, when the wake-up signal is received from the IC chip120, the processor130may transmit the wake-up signal to the external electronic apparatus200through wireless communication. As an example, the processor130may the wake-up signal to the external electronic apparatus200through a Bluetooth communication method. For this operation, the processor130may include a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, or the like.

The wake-up signal may be a signal for activating a voice recognition function of the external electronic apparatus200. When the wake-up signal is received, the external electronic apparatus200may activate the voice recognition function and request the electronic apparatus100to transmit the voice signal.

When the signal requesting the transmission of the voice signal is received from the external electronic apparatus200in response to the transmission of the wake-up signal, the processor130may request the IC chip120to transmit a signal corresponding to the user voice.

In this example, the IC chip120may transmit a signal corresponding to the user voice to the processor130. For this operation, the IC chip120may, for example, store information about the user voice received through the microphone110in a buffer. For example, when the user voice is received through the microphone110, the IC chip120may store information about the user voice in the buffer, and when a signal that requests a transmission of the signal corresponding to the user voice from the processor130, the IC chip120may transmit the signal corresponding to the user voice to the processor130based on the information on the user voice stored in the buffer.

When the signal corresponding to the user voice is received from the IC chip120, the processor130may transmit the signal corresponding to the user voice to the external electronic apparatus200through wireless communication.

Accordingly, the external electronic apparatus200may perform a function corresponding to the user voice.

For example, when the signal corresponding to the user voice is received, the external electronic apparatus200may apply a speech to text (STT) algorithm to the user voice, convert the user voice into text, and perform a function corresponding to the user voice based on speech elements included in the text.

For example, if the user voice received through the microphone110is ‘Hi, Bixby, turn on the TV’, the external electronic apparatus200may turn on the power.

As described above, after the transmission of the wake-up signal, when a signal for requesting the transmission of a voice signal is received from the external electronic apparatus200, the signal corresponding to the user voice is transmitted to the external electronic apparatus200, but this is only an example. When it is determined that the wake-up-word is included in the user voice, the IC chip120may transmit a signal corresponding to the user voice to the processor130, and when the signal corresponding to the user voice is received, the processor130may transmit it to the external electronic apparatus300through wireless communication.

In addition, although the IC chip120and the processor130are described as separate components, it is only an example, and the processor130may perform a function performed by the IC chip120described above. In other words, when the user voice is received through the microphone110, the processor130may identify whether the size of the user voice is equal to or greater than a predetermined threshold value, and identify whether the user voice includes a wake-up-word.

The processor130may change the above-described predetermined threshold value to a relatively low threshold value based on a completion of transmission of the signal corresponding to the user voice. For example, the processor130may set the threshold value set as a first level to a second level lower than the first level.

For example, after transmitting the signal corresponding to the user voice to the external electronic apparatus200, the processor130, when a signal requesting to stop the transmission of the voice signal is received from the external electronic apparatus200, the processor130may identify that the transmission of the signal corresponding to the user voice is completed, and may change the predetermined threshold value to a relatively low threshold value.

It is considered that when the user utters a user voice including a wake-up-word, there is a high possibility of uttering a subsequent user voice including the wake-up-word. As an example, the user is likely to utter a user voice such as ‘Hi, Bixby, turn on the TV’, and then utter a user voice such as ‘Hi, Bixby, turn up the level’. Accordingly, it is necessary to determine whether the wake-up-word is included in the subsequent user voice even when a small size of the subsequent user voice is received by changing the threshold value to a low threshold value.

In other words, when the subsequent user voice is received through the microphone110, the IC chip120may identify whether the size of the subsequent user voice is greater than or equal to a threshold value set as the second level, and the size of the subsequent user voice is greater than or equal to the threshold value set as the second level, the IC chip120may identify whether a wake-up-word is included in the subsequent user voice.

As described above, the example embodiment performs the identification of whether the user voice includes a wake-up-word, when a user voice above the threshold value set to the first level relatively higher than the second level is received. Accordingly, when a user voice below the threshold value set as the first level, such as a daily conversation voice, or the like, is received, it is not identified whether the user voice includes a wake-up-word, thereby avoiding unnecessary power consumption and unnecessary operation of the IC chip.

In addition, the determination of whether the user voice includes a wake-up-word in a subsequent user voice is performed when a user voice having the threshold value set to the second level relatively lower than the first level is received. Accordingly, the disclosure may increase a recognition rate of the wake-up-word included in the subsequent user voice even through a small number of microphones.

FIG. 3is an operational flow diagram illustrating an example control method of an electronic apparatus according to an embodiment of the disclosure.

Hereinafter, for convenience of description, a state in which the IC chip120can identify the size of the user voice received through the microphone110is referred to as a first state (or sleep state), and a state in which the IC chip120can identify whether a wake-up-word is included is referred to as a second state (or an active state).

The processor130may determine and set a wake-up threshold value to a first level (S310). The wake-up threshold value may be set at the factory level, as well as various sizes according to a user command, and the first level may be a relatively high as described above.

The IC chip120may identify whether the size of the user voice is equal to or greater than a threshold value set as the first level when the user voice is received (S311) while operating in the first state (S312). As an example, the level of the user voice may be measured based on the amplitude of the user voice of the IC chip120.

The IC chip120may maintain the first state when the level of the user voice is less than the threshold value set as the first level, and the IC chip120may operate in the second state for identifying whether the wake-up-word is included in the user voice when the level of the user voice is greater than or equal to the threshold value set as the first level.

As described above, since the disclosure first determines whether to convert to the second state based on the threshold value set to a relatively high first level, when a small level of voice is received through the microphone110, it may not be converted to the second state. Accordingly, unnecessary power consumption and computational burden of the IC chip120may be prevented.

In the second state, the IC chip120may identify whether a wake-up-word is included in the user voice (S313). For example, the IC chip120may apply a speech to text (STT) algorithm to the user voice, convert the user voice to text, and identify whether the text includes a wake-up-word.

For example, if the wake-up-word is ‘Hi, Bixby’, the IC chip120may identify whether ‘Hi, Bixby’ is included in the text.

When it is determined that the user voice includes a wake-up-word, the IC chip120may generate a wake-up signal, transmit it to the processor130(S314), and then convert to the first state. If it is determined that the user voice does not include a wake-up-word, the IC chip120may convert to the first state without transmitting the wake-up signal.

When the wake-up signal is received from the IC chip120, the processor130may transit the wake-up signal to the external electronic apparatus200(S315), and receive a response signal with respect to the wake-up signal from the external electronic apparatus200(S316). The response signal may be a signal requesting transmission of a voice signal.

When the response signal is received from the external electronic apparatus200, the processor130may request the IC chip120to transmit a signal corresponding to the user voice (S317).

In this example, the IC chip120may transmit the signal corresponding to the user voice to the processor130(S318) based on information about the user voice stored in the buffer.

When the signal corresponding to the user voice is received from the IC chip120, the processor130may transmit the signal corresponding to the user voice to the external electronic apparatus200(S319).

When the receiving of the signal corresponding to the user voice is completed, the external electronic apparatus200may request the processor130to stop transmitting the voice signal (S320).

In this example, the processor130may set the threshold value set as the first level to a second level lower than the first level (S321).

Thereafter, while operating in the first state, when a subsequent user voice is received (S322), the IC chip120identifies whether the level of the subsequent user voice is greater than or equal to the threshold value set as the second level (S323), and if the level is less than the threshold value set as the second level, the IC chip may maintain the first state. If the level of the subsequent user voice is greater than or equal to the threshold value set as the second level, the IC chip120may operate in the second state for identifying whether the subsequent user voice includes a wake-up-word.

In the second state, the IC chip120may identify whether the wake-up-word is included in the subsequent user voice (S324), and when it is determined that the wake-up-word is included in the subsequent user voice, the IC chip120may generate a wake-up signal to transmit it to the processor120. When it is determined that the wake-up-word is not included in the subsequent user voice, the processor130may convert to the first state.

As described above, the determination of whether a wake-up-word is included in a subsequent user voice is performed when the user voice having a threshold value set as the second level relatively lower than the first level is received. Accordingly, the disclosure may increase a recognition rate of the wake-up-word included in the subsequent user voice even through a small number of microphones.

If the wake-up signal within a predetermined time is not received from the IC chip120after changing the threshold value, the processor130may reset the threshold value set as the second level to the first level (S325). In other words, the processor130may reset the threshold value set as the second level to the first level when a user voice including a wake-up-word is not received through the microphone110within the predetermined time after changing the threshold value. The predetermined time may be 60 seconds, but this is only an example, and the predetermined time may be variously set or changed according to a user command.

It is considered that if the wake-up signal is not received within the predetermined time after changing the threshold value, then the user is less likely to utter a voice to control the external electronic apparatus200.

FIG. 4is a flowchart illustrating an example operation performed when an electronic apparatus receives a user voice that does not include a wake-up-word, according to an embodiment of the disclosure.

The IC chip120may measure the level of the user voice received through the microphone110. If the size of the user voice is greater than or equal to a predetermined threshold value, the IC chip120may determine whether the wake-up-word is included in the user voice (S410).

If it is determined that the wake-up-word is not included in the user voice, the IC chip120may determine the number of times the user voice that does not include the wake-up-word is received (S420).

For this operation, when the user voice that does not include the wake-up-word is received, the IC chip120may store information on the number of times the user voice that does not include the wake-up-word is received in the memory. For example, when it is determined the user voice that that does not include the wake-up-word is received while the user voice that does not include the wake-up-word is received four times based on information on the number of times stored in the memory, the IC chip120may identify that the number of times the user voice which does not include the wake-up-word is received may be five times.

In addition, when it is determined that the number of times the user voice that does not include a wake-up-word is received exceeds the predetermined number of times, the IC chip120may transmit a signal requesting a change of the threshold value set as the first level to the processor130. The predetermined number of times may be four times, but this is only an example, and the predetermined number of times may be variously set or changed according to a user command.

When the signal requesting to change the threshold value set as the first level is received from the IC chip120, the processor130may set the threshold value to a third level higher than the first level (S430).

If this is a case when the user voice that does not include the wake-up-word is received several times, there may be a lot of noise around the electronic apparatus100, and the threshold value is set relatively high to prevent and/or reduce unnecessary power consumption of the electronic apparatus and to prevent and/or reduce unnecessary operation of the IC chip.

When it is determined that the predetermined time has passed from the time when the threshold value is changed, the processor130may reset the threshold value set as the third level to the first level. The predetermined time may be 60 minutes, but this is only an example, and the predetermined time may be variously set or changed according to a user command.

It may be determined to be a case where the noise around the electronic apparatus100is temporarily increased.

The processor130may determine the threshold value as a different level according to the level of the user voice. This will be described in greater detail below with reference toFIG. 5.

FIG. 5is a flowchart illustrating an example in which an electronic apparatus sets different threshold values for each user voice level, according to an embodiment of the disclosure.

The electronic apparatus100according to an embodiment of the disclosure may determine a threshold value as one of the first, second, and third levels, and the first level is lower than the second level, and the second level is lower than the third level. However, this is an example, and the technical idea of the disclosure will not be limited thereto.

The IC chip120may determine the level of the user voice received through the microphone110(S510). IF the level of the user voice is greater than or equal to the threshold value set as the first level, the IC chip120may identify whether the user voice includes a wake-up-word.

When the wake-up-word is determined not to be included in the user voice, the IC chip120may identify whether the level of the user voice is greater than or equal to the third level (S511). When the size of the user voice is determined to be greater than or equal to the third level, the IC chip120may increase Count_L3 (S511-1). For example, if Count_L3 is 0 and the user voice is determined to be greater than or equal to the third level, Count_L3 may be increased to 1.

When the level of the user voice is determined to be less than the third level, the IC chip120may identify whether the level of the user voice is greater than or equal to the second level (S512). When the level of the user voice is determined to be greater than or equal to the second level (S512-1), the IC chip120may increase Count_L2 and when the level of the user voice is determined to be less than the second level, the chip120may increase the Count_L1 (S513).

The IC chip120may identify whether the number of times the user voice that does not include the wake-up-word is received exceeds the predetermined number of times.

For example, the IC chip120may identify whether the number of Count_L3 exceeds the predetermined number of times (S514). The IC chip120may request the processor130to change the threshold value set as the first level to the third level when the number of Count_L3 exceeds the predetermined number of times.

The processor130may change the threshold value to correspond to the threshold value requested by the IC chip120. In other words, the threshold value set as the first level may change to the third level (S514-1).

If the number of Count_L3 is identified to be less than or equal to the predetermined number, the IC chip120may identify whether the number of Count_L2 exceeds the predetermined number (S515). The IC chip120may request the processor130to change the threshold value set as the first level to the second level when the number of Count_L2 exceeds the predetermined number.

In this case, the processor130may change the threshold value set as the first level to the second level (S515-1).

If the number of Count_L2 is identified to be equal to or less than the predetermined number, the IC chip120may maintain the threshold value as the first level (S516).

When the threshold value is changed by the processor130, Count_L1, Count_L2, and Count_L3 may be initialized to 0 (S517).

As described above, the disclosure may prevent and/or reduce power consumption of the electronic apparatus100and increase a recognition rate of the wake-up-word by determining different threshold values according to the degree of noise around the electronic apparatus100.

As described above, when it is identified that the predetermined time has passed from the time when the threshold value is changed, the processor may reset the threshold value set as the second level or the third level to the first level.

FIG. 6Ais a diagram illustrating an example in which an electronic apparatus controls an external electronic apparatus based on a user voice, according to an embodiment of the disclosure, andFIG. 6Bis a diagram illustrating an example in which an electronic apparatus displays information about a threshold value through an external electronic apparatus, according to an embodiment of the disclosure.

Referring toFIG. 6A, the user may utter a user voice such as ‘Hi, Bixby, turn on the TV’. In this example, if the user voice is identified to be equal to or greater than the threshold value set as the first level, the electronic apparats100may identify whether the wake-up-word ‘Hi, Bixby’ is included in the user voice.

When the user voice is identified to include the wake-up-word, the electronic apparatus100may transmit a wake-up signal to the external electronic apparatus200, and when a signal requesting transmission of the voice signal is received from the external electronic apparatus200in response to the transmission of the wake-up signal, the electronic apparatus100may transmit a signal corresponding to the user voice to the external electronic apparatus200.

For example, the external electronic apparatus200may perform functions corresponding to the user voice. For example, as illustrated inFIG. 6A, the external electronic apparatus200may turn on power according to the user voice.

The electronic apparatus100may determine the threshold value set as the first level to the second level.

The electronic apparatus100may transmit information that relates to the threshold value set in the electronic apparatus100to the external electronic apparatus100. For example, when the threshold value is set as the first level, the electronic apparatus100may transmit information about the first level to the external electronic apparatus200, and when the threshold value is set as the second level, information about the second level may be transmitted to the external electronic apparatus200.

The external electronic apparatus200may display information about the threshold value set in the electronic apparatus100.

For example, referring toFIG. 6B, the external electronic apparatus200may display information such as “Threshold of remote control has changed to low. The remote control can recognize small voices”.

Accordingly, the user may visually check the threshold value set in the electronic apparatus100, and may efficiently control the external electronic apparatus200.

FIG. 7Ais a diagram illustrating an example in which an electronic apparatus is operated based on a user voice, according to an embodiment of the disclosure, andFIG. 7Bis a diagram illustrating an example in which an electronic apparatus displays information about a threshold value according to an embodiment of the disclosure.

It has been described that the electronic apparatus100according to an embodiment of the disclosure controls the external electronic apparatus200according to the user voice. However, this is only an example, and when the user voice is received, the electronic apparatus100may control the electronic apparatus100itself according to the user voice.

For example, the electronic apparatus100may be implemented as an AI speaker, a smartphone, a smart TV, or the like. In this case, a technical idea similar to the above-described technical idea may be applied.

For example, when the user voice is received through the microphone110, the IC chip120of the electronic apparatus100may identify whether the level of the user voice is greater than or equal to a threshold value set as the first level. If the level of the user voice is greater than or equal to the threshold value set as the first level, the IC chip120may identify whether the user voice includes a wake-up-word.

For example, referring toFIG. 7A, the user may utter a user voice such as ‘Hi, Bixby, turn on the TV’. In this example, when the user voice is identified to be equal to or greater than the threshold value set as the first level, the IC chip120may identify whether the wake-up-word ‘Hi, Bixby’ is included in the user voice.

In addition, when the wake-up-word is identified to be included in the user voice, the IC chip120may transmit a signal corresponding to the user voice to the processor130.

When a signal corresponding to the user voice is received, the processor130may perform analysis of the user voice. For example, the processor130may convert a user voice into text by applying a speech to text (STT) algorithm to the user voice. In addition, the processor130may recognize an utterance factor included in the text and perform a function corresponding to the user voice based on the utterance factor.

For example, as illustrated inFIG. 7A, when the user voice such as ‘Hi, Bixby, turn on the TV’ is received, the processor130may turn on the power of the electronic apparatus100according to the user voice.

The processor130may determine the threshold value set as the first level to the second level.

Accordingly, when the subsequent user voice is received through the microphone110, the IC chip120may identify whether the level of the subsequent user voice is greater than or equal to the threshold value set as the second level, and when the level of the subsequent user voice is greater than or equal to the threshold value set as the second level, the IC chip120may identify whether the wake-up-word is included in the subsequent user voice.

The IC chip120and the processor130have been described as separate configurations, but this is only an example, and the processor130may perform a function performed by the above-described IC chip120. In other words, when the user voice is received through the microphone110, the processor130may identify whether the level of the user voice is equal to or greater than the threshold value set as the first level, and identify whether the user voice includes a wake-up-word. The threshold value set as the first level may then be set as the second level, and when the subsequent user voice is received through the microphone110, the processor130may identify whether the level of the subsequent user voice is greater than or equal to the threshold value set as the second level, and when the level of the subsequent user voice is greater than or equal to the threshold value set as the second level, the processor130may identify whether the subsequent user voice includes the wake-up-word.

The electronic apparatus100may display information about the threshold value set in the electronic apparatus100. To do so, the electronic apparatus100may include a display.

For example, when the threshold value is set as the first level, the electronic apparatus100may display information about the first level, and when the threshold value is set as the second level, the electronic apparatus100may display information about the second level.

For example, referring toFIG. 7B, the electronic apparatus100may display information such as “Threshold of TV has changed to low. The TV can recognize small voices”.

Accordingly, the user may visually check the threshold value set in the electronic apparatus100, and may efficiently control the electronic apparatus200.

FIG. 8is a block diagram illustrating an example configuration of an example electronic apparatus according to an embodiment of the disclosure.

Referring toFIG. 8, the electronic apparatus100may include a microphone110, an IC chip120, a memory140, a display150, an inputter (e.g., including input circuitry)160, a speaker170, a sensor180, a communicator (e.g., including communication circuitry)190, and a processor (e.g., including processing circuitry)130. Hereinafter, parts overlapping with the above description may not be repeated here.

The memory140may store an operating system (OS) for controlling the overall operation of the components of the electronic apparatus100and commands or data related to the components of the electronic apparatus100.

The processor130may include various processing circuitry and control a plurality of hardware components or software elements of the electronic apparatus100using diverse commands or data stored in the memory140, load and process a command or data received from at least one of the other components, and store diverse data in a non-volatile the memory.

The memory140may store the historic utterance information. The historic utterance information may include information on the user voice received through the microphone110, information on the number of times the user voice was received, or information on the number of times the user voice does not include a trigger word.

The display150may display various screens. For example, the display150may display a screen including response information corresponding to the user voice.

The display150may be implemented as various types of displays, such as, for example, and without limitation, a liquid crystal display (LCD), a plasma display panel (PDP), and the like. The display150may include a driving circuit, a backlight unit, and the like which may be implemented in forms such as an a-si TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), and the like. The display150may be implemented as a touch screen by combining with a touch sensor.

The inputter160may include various input circuitry and receive a user input. The inputter160may include, for example, a button and a touch screen, or the like.

The speaker170may be configured to output various audio data on which various processing operations such as decoding, amplification, and noise filtering are performed by an audio processor (not illustrated).

According to an embodiment of the disclosure, the speaker170may output a sound when a user voice including a wake-up-word is received, thereby providing feedback to the user that the voice recognition function is being performed.

The sensor180may output a voltage having a size corresponding to the level of the user voice. Accordingly, the IC chip120may identify the level of the user voice based on a sensing value of the sensor180.

The sensor180may sense the movement of the electronic apparatus100. For example, the sensor180may be implemented as an acceleration sensor, a gyro sensor, or a geomagnetic sensor, and detect the movement of the electronic apparatus100.

The communicator190may include various communication circuitry for performing communication with the external apparatus. For example, the communicator190may communicate with various external electronic apparatus through a wireless communication method such as, for example, and without limitation, Bluetooth (BT), a Bluetooth low energy (BLE), a wireless fidelity (WI-FI), Zigbee, or the like, or infrared (IR) communication method. The communicator190may be mounted on the processor130and may be included in the electronic apparatus100in a separate configuration from the processor130.

FIG. 9is an operational flow diagram illustrating an example control method of an electronic apparatus according to an embodiment of the disclosure. Hereinafter, parts overlapping with the above description may not be repeated here.

The processor130may determine a threshold value of a wake-up as a first level (S910). The first level may be a relatively high compared to a second level described later.

The IC chip120may identify whether the level of the user voice is greater than or equal to the threshold value set as the first level when the user voice is received (S911) while operating in the first state (S912). As an example, the IC chip120may measure the level of the user voice may be measured based on the amplitude of the user voice.

The IC chip120may maintain the first state when the level of the user voice is less than the threshold value set as the first level, and operate in a second state to identify whether the user voice includes a wake-up-word when the level of the user voice is greater than or equal to the threshold value set as the first level,

In the second state, the IC chip120may identify whether the wake-up-word is included in the user voice in the second state (S913). For example, the IC chip120may apply a speech to text (STT) algorithm to the user voice, convert the user voice to text, and identify whether the text includes the wake-up-word.

For example, if the wake-up-word is ‘Hi, Bixby’, the IC chip120may identify whether ‘Hi, Bixby’ is included in the text.

When the wake-up-word is identified to be included in the user voice, the IC chip120may transmit a signal corresponding to the user voice to the processor130(S914) and convert to the first state.

When a signal corresponding to the user voice is received from the IC chip120, the processor130may transmit the signal corresponding to the user voice to the external electronic apparatus200(S915). The signal corresponding to the user voice may further include a signal for waking up the external electronic apparatus200. Accordingly, the external electronic apparatus200may initiate a voice recognition function based on the wake-up signal, and perform an operation corresponding to the user voice.

The processor130may determine the threshold value set as the first level as a second level lower than the first level (S916).

While being operated in the first state, when the subsequent user voice is received (S917), the IC chip120may identify whether the level of the subsequent user voice is greater than or equal to the threshold value set as a second level (S918), maintain the first state if the level of the subsequent user voice is less than the threshold value set as the second level, and operate in the second state for identifying whether the subsequent user voice includes the wake-up-word if the level of the subsequent user voice is greater than or equal to the threshold value set as the second level.

The IC chip120may identify whether the wake-up-word is included in the subsequent user voice in the second state (S919), and if the wake-up-word is identified to be included in the subsequent user voice, the IC chip120may transmit a signal corresponding to the subsequent user voice to the processor130.

According to various embodiments of the disclosure as described above, the disclosure includes a configuration of performing a voice recognition when a level of a user voice is a relatively higher than a threshold value, thereby preventing and/or reducing power consumption due to unnecessary voice recognition.

In addition, since the disclosure includes a configuration of performing voice recognition based on a relatively low threshold value after receiving a user voice including a wake-up-word (WUW), thereby increasing a recognition rate of the user voice through a small number of microphones.

The methods according to the above-described example embodiments may be realized as software or applications that may be installed in the existing electronic apparatus.

Further, the methods according to the above-described example embodiments may be realized by upgrading the software or hardware of the existing electronic apparatus.

The above-described example embodiments may be executed through an embedded server in the electronic apparatus or through an external server outside the electronic apparatus.

A non-transitory computer readable medium in which a program sequentially performing the controlling method according to the present disclosure is stored may be provided.

The non-transitory computer readable recording medium may refer, for example, to a medium that stores data and that can be read by devices. For example, the above-described various applications or programs may be stored in the non-transitory computer readable medium, for example, a compact disc (CD), a digital versatile disc (DVD), a hard disc, a Blu-ray disc, a universal serial bus (USB), a memory card, a read only memory (ROM), and the like, and may be provided.

While the disclosure has been illustrated and described with reference to various example embodiments, it will be understood that the various example embodiments are intended to be illustrative, not limiting. Those skilled in the art will understand and appreciate that various modifications, additions and substitutions are possible, without departing from the true spirit and full scope of the disclosure, including the accompanying claims. Accordingly, such modifications, additions and substitutions should also be understood to fall within the scope of the present disclosure.