DISPLAY DEVICE AND OPERATION METHOD THEREOF

A display device, according to one embodiment of the present disclosure, comprises: a display for displaying at least one input field; a speech acquisition unit for acquiring speech inputted in the input field; and a control unit for converting the speech to text, wherein the control unit may convert the speech to text by character unit or by phrase unit according to the type of the input field.

TECHNICAL FIELD

The present disclosure relates to a display device and a method of operating thereof, and more specifically, to convert voice input into an input field into text.

BACKGROUND ART

Recently, digital TV service using wired or wireless communication network has become popular. Digital TV service may provide a variety of service that cannot be provided by existing analog broadcasting service.

For example, IPTV (Internet Protocol Television), a type of digital TV service, and smart TV service provide interactivity that allows user to actively select the type of program to watch and the viewing time. IPTV and smart TV services may provide various additional services, such as Internet search, home shopping, and online games, based on this interactivity.

In this way, when the display device provides function such as Internet search, home shopping, and online games, it may display an input field for logging in and an input field for search. The display device cannot only receive text to be input into these input field using button provided on the remote control, but may also receive input by recognizing the user's voice. However, since the display device converts the recognized user's voice into words on a word by word, there is a problem that errors occur when non-linguistic character string such as ID is converted into specific word. “For example, when a user intends to input ‘icadot’ as their ID, but since the display device converts the voice-recognized ‘icadat’ on a word by word, there is a problem that input ID is converted into unintended characters such as ‘I see AT&T’ or ‘I can do it’.”

DISCLOSURE

Technical Problem

The present disclosure seeks to minimize error that occur when converting the user's voice into text when receiving input to an input field as the user's voice.

The present disclosure seeks to increase the accuracy of speech-to-text conversion when the input to the input field is input by the user's voice.

Technical Solution

The present disclosure seeks to apply a method of converting a user's voice into text differently according to the type of input field.

A display device according to an embodiment of the present disclosure may comprise: a display configured to display at least one input field, a voice acquisition unit configured to acquire a voice input to the input field, and a control unit configured to convert the voice into text, wherein the control unit is further configured to convert the voice into text on a character unit or word unit according to a type of the input field.wherein the control unit may convert the voice into character unit if the input field is a field that receives an ID, email address, or password, and convert the voice into word unit if the input field is a field that receives a search word.wherein the control unit may obtain an attribute of the input field, and obtain the type of the input field based on the obtained attribute.wherein the control unit may display the converted text in the input field without spacing, if the type of the input field is the first type.wherein the control unit may, if the type of the input field is the first type, when a word meaning a space is recognized, display the converted text as the recognized word in the input field.wherein the control unit may display the converted text in the input field using only alphabet, number, and preset special character if the type of the input field is the first type.wherein the control unit may display the converted text to a language set as default in the input field if the type of the input field is the second type.wherein the control unit may convert the voice into the character unit through an input mode switching function if the type of input field is the second type.wherein the control unit may display an icon for switching the input mode if the type of the input field is the second type.

An operating method of a display device according to an embodiment of the present disclosure may comprise displaying at least one input field, obtaining a voice input to the input field; and converting the voice into text, wherein the step of converting the voice into text may comprise: obtaining a type of the input field, and converting the voice into the text on a character unit or a word unit according to the type of the input field.

Advantageous Effects

According to an embodiment of the present disclosure, since the voice is converted into letter or word unit according to the input field, speech-to-text conversion is performed according to the user's intention, and the accuracy of speech-to-text conversion is improved.

According to the embodiment of the present disclosure, there is an advantage in improving the limitation of voice input only when inputting existing search word, etc. In other words, there is an advantage in that voice input is possible even when entering an ID, password, or email address.

BEST MODE

Hereinafter, embodiments relating to the present disclosure will be described in detail with reference to the drawings. The suffixes “module” and “unit” for components used in the description below are assigned or mixed in consideration of easiness in writing the specification and do not have distinctive meanings or roles by themselves.

FIG.1is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

Referring toFIG.1, a display device100may include a broadcast reception unit130, an external device interface unit135, a storage unit140, a user interface unit150, a control unit170, a wireless communication unit173, voice acquisition unit175, a display unit180, an audio output unit185, and a power supply unit190.

The broadcast reception unit130may include a tuner131, a demodulation unit132, and a network interface unit133.

The tuner131may select a specific broadcast channel according to a channel selection command. The tuner131may receive broadcast signals for the selected specific broadcast channel.

The demodulation unit132may divide the received broadcast signals into video signals, audio signals, and broadcast program related data signals and restore the divided video signals, audio signals, and data signals to an output available form.

The network interface unit133may provide an interface for connecting the display device100to a wired/wireless network including the Internet network. The network interface unit133may transmit or receive data to or from another user or another electronic device through an accessed network or another network linked to the accessed network.

The network interface unit133may access a predetermined webpage through an accessed network or another network linked to the accessed network. That is, the network interface unit133may transmit or receive data to or from a corresponding server by accessing a predetermined webpage through the network.

Then, the network interface unit133may receive contents or data provided from a content provider or a network operator. That is, the network interface unit133may receive contents such as movies, advertisements, games, VODs, and broadcast signals, which are provided from a content provider or a network provider, through network and information relating thereto.

Additionally, the network interface unit133may receive firmware update information and update files provided from a network operator and transmit data to an Internet or content provider or a network operator.

The network interface unit133may select and receive a desired application among applications open to the air, through network.

The external device interface unit135may receive an application or an application list in an adjacent external device and deliver it to the control unit170or the storage unit140.

The external device interface unit135may provide a connection path between the display device100and an external device. The external device interface unit135may receive at least one an image or audio output from an external device that is wirelessly or wiredly connected to the display device100and deliver it to the control unit170. The external device interface unit135may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, at least one High Definition Multimedia Interface (HDMI) terminal, and a component terminal.

An image signal of an external device input through the external device interface unit135may be output through the display unit180. A sound signal of an external device input through the external device interface unit135may be output through the audio output unit185.

An external device connectable to the external device interface unit135may be one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB Memory, and a home theater system, but this is just exemplary.

Additionally, some of the content data stored in the display device100may be transmitted to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device100.

The storage unit140may store signal-processed image, voice, or data signals stored by a program in order for each signal processing and control in the control unit170.

Additionally, the storage unit140may perform a function for temporarily storing image, voice, or data signals output from the external device interface unit135or the network interface unit133and may store information on a predetermined image through a channel memory function.

The storage unit140may store an application or an application list input from the external device interface unit135or the network interface unit133.

The display device100may play content files (for example, video files, still image files, music files, document files, application files, and so on) stored in the storage unit140and provide them to a user.

The user interface unit150may deliver signals input by a user to the control unit170or deliver signals from the control unit170to a user. For example, the user interface unit150may receive or process control signals such as power on/off, channel selection, and screen setting from the remote control device200or transmit control signals from the control unit170to the remote control device200according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF), and IR.

Additionally, the user interface unit150may deliver, to the control unit170, control signals input from local keys (not shown) such as a power key, a channel key, a volume key, and a setting key.

Image signals that are image-processed in the control unit170may be input to the display unit180and displayed as an image corresponding to corresponding image signals. Additionally, image signals that are image-processed in the control unit170may be input to an external output device through the external device interface unit135.

Voice signals processed in the control unit170may be output to the audio output unit185. Additionally, voice signals processed in the control unit170may be input to an external output device through the external device interface unit135.

Besides that, the control unit170may control overall operations in the display device100.

Additionally, the control unit170may control the display device100by a user command or internal program input through the user interface unit150and download a desired application or application list into the display device100in access to network.

The control unit170may output channel information selected by a user together with processed image or voice signals through the display unit180or the audio output unit185.

Additionally, according to an external device image playback command received through the user interface unit150, the control unit170may output image signals or voice signals of an external device such as a camera or a camcorder, which are input through the external device interface unit135, through the display unit180or the audio output unit185.

Moreover, the control unit170may control the display unit180to display images and control broadcast images input through the tuner131, external input images input through the external device interface unit135, images input through the network interface unit, or images stored in the storage unit140to be displayed on the display unit180. In this case, an image displayed on the display unit180may be a still image or video and also may be a 2D image or a 3D image.

Additionally, the control unit170may play content stored in the display device100, received broadcast content, and external input content input from the outside, and the content may be in various formats such as broadcast images, external input images, audio files, still images, accessed web screens, and document files.

Moreover, the wireless communication unit173may perform a wired or wireless communication with an external electronic device. The wireless communication unit173may perform short-range communication with an external device. For this, the wireless communication unit173may support short-range communication by using at least one of Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies. The wireless communication unit173may support wireless communication between the display device100and a wireless communication system, between the display device100and another display device100, or between networks including the display device100and another display device100(or an external server) through wireless area networks. The wireless area networks may be wireless personal area networks.

Herein, the other display device100may be a mobile terminal such as a wearable device (for example, a smart watch, a smart glass, and a head mounted display (HMD)) or a smartphone, which is capable of exchanging data (or inter-working) with the display device100. The wireless communication unit173may detect (or recognize) a communicable wearable device around the display device100. Furthermore, if the detected wearable device is a device authenticated to communicate with the display device100, the control unit170may transmit at least part of data processed in the display device100to the wearable device through the wireless communication unit173. Accordingly, a user of the wearable device may use the data processed in the display device100through the wearable device.

The voice acquisition unit175may acquire audio. The voice acquisition unit175may include at least one microphone (not shown) and acquire audio of adjacent of display device100through a microphone (not shown)

The display unit180may convert image signal, data signal, or on-screen display (OSD) signal, which are processed in the control unit170, or images signal or data signal, which are received in the external device interface unit135, into R, G, and B signals to generate driving signal.

Furthermore, the display device100shown inFIG.1is just one embodiment of the present invention and thus, some of the components shown may be integrated, added, or omitted according to the specification of the actually implemented display device100.

That is, if necessary, two or more components may be integrated into one component or one component may be divided into two or more components and configured. Additionally, a function performed by each block is to describe an embodiment of the present invention and its specific operation or device does not limit the scope of the present invention.

According to another embodiment of the present invention, unlikeFIG.1, the display device100may receive images through the network interface unit133or the external device interface unit135and play them without including the tuner131and the demodulation unit132.

For example, the display device100may be divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services and a content playback device for playing contents input from the image processing device.

In this case, an operating method of a display device according to an embodiment of the present invention described below may be performed by one of the display device described with reference toFIG.1, an image processing device such as the separated set-top box, and a content playback device including the display unit180and the audio output unit185.

The audio output unit185receives the audio-processed signal from the control unit170and outputs it as audio.

The power supply unit190supplies the corresponding power throughout the display device100. In particular, power may be supplied to the control unit170, which can be implemented in the form of a system on chip (SOC), the display unit180for displaying images, and the audio output unit185for audio output.

Specifically, the power supply unit190may include a converter that converts alternating current power to direct current power and a dc/dc converter that converts the level of direct current power.

Then, referring toFIGS.2and3, a remote control device is described according to an embodiment of the present invention.

FIG.2is a block diagram illustrating a remote control device according to an embodiment of the present invention andFIG.3is a view illustrating an actual configuration of a remote control device according to an embodiment of the present invention.

First, referring toFIG.2, a remote control device200may include a fingerprint recognition unit210, a wireless communication unit220, a user input unit230, a sensor unit240, an output unit250, a power supply unit260, a storage unit270, a control unit280, and a sound acquisition unit290.

Referring toFIG.2, the wireless communication unit220transmits/receives signals to/from an arbitrary any one of display devices according to the above-mentioned embodiments of the present invention.

The remote control device200may include a radio frequency (RF) module221for transmitting/receiving signals to/from the display device100according to the RF communication standards and an IR module223for transmitting/receiving signals to/from the display device100according to the IR communication standards. Additionally, the remote control device200may include a Bluetooth module225for transmitting/receiving signals to/from the display device100according to the Bluetooth communication standards. Additionally, the remote control device200may include a Near Field Communication (NFC) module227for transmitting/receiving signals to/from the display device100according to the NFC communication standards and a WLAN module229for transmitting/receiving signals to/from the display device100according to the Wireless LAN (WLAN) communication standards.

Additionally, the remote control device200may transmit signals containing information on a movement of the remote control device200to the display device100through the wireless communication unit220.

Moreover, the remote control device200may receive signals transmitted from the display device100through the RF module221and if necessary, may transmit a command on power on/off, channel change, and volume change to the display device100through the IR module223.

The user input unit230may be configured with a keypad button, a touch pad, or a touch screen. A user may manipulate the user input unit230to input a command relating to the display device100to the remote control device200. If the user input unit230includes a hard key button, a user may input a command relating to the display device100to the remote control device200through the push operation of the hard key button. This will be described with reference toFIG.3.

Referring toFIG.3, the remote control device200may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button212, a power button231, a home button232, a live button233, an external input button234, a voice adjustment button235, a voice recognition button236, a channel change button237, a check button238, and a back button239.

The fingerprint recognition button212may be a button for recognizing a user's fingerprint. According to an embodiment of the present invention, the fingerprint recognition button212may perform a push operation and receive a push operation and a fingerprint recognition operation. The power button231may be button for turning on/off the power of the display device100. The home button232may be a button for moving to the home screen of the display device100. The live button233may be a button for displaying live broadcast programs. The external input button234may be a button for receiving an external input connected to the display device100. The voice adjustment button235may be a button for adjusting the size of a volume output from the display device100. The voice recognition button236may be a button for receiving user's voice and recognizing the received voice. The channel change button237may be a button for receiving broadcast signals of a specific broadcast channel. The check button238may be a button for selecting a specific function and the back button239may be a button for returning to a previous screen.

If the user input unit230includes a touch screen, a user may touch a soft key of the touch screen to input a command relating to the display device100to the remote control device200. Additionally, the user input unit230may include various kinds of input means manipulated by a user, for example, a scroll key and a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit240may include a gyro sensor241or an acceleration sensor243and the gyro sensor241may sense information on a movement of the remote control device200.

For example, the gyro sensor241may sense information on an operation of the remote control device200on the basis of x, y, and z axes and the acceleration sensor243may sense information on a movement speed of the remote control device200. Moreover, the remote control device200may further include a distance measurement sensor and sense a distance with respect to the display unit180of the display device100.

The output unit250may output image or voice signals in response to manipulation of the user input unit230or image or voice signals corresponding to signals transmitted from the display device100. A user may recognize whether the user input unit230is manipulated or the display device100is controlled through the output unit250.

For example, the output unit250may include an LED module251for flashing, a vibration module253for generating vibration, a sound output module255for outputting sound, or a display module257for outputting an image, if the user input unit230is manipulated or signals are transmitted/received to/from the display device100through the wireless communication unit220.

Additionally, the power supply unit260supplies power to the remote control device200and if the remote control device200does not move for a predetermined time, stops the power supply, so that power waste may be reduced. The power supply unit260may resume the power supply if a predetermined key provided at the remote control device200is manipulated.

The storage unit270may store various kinds of programs and application data necessary for control or operation of the remote control device200. If the remote control device200transmits/receives signals wirelessly through the display device100and the RF module221, the remote control device200and the display device100transmits/receives signals through a predetermined frequency band.

The control unit280of the remote control device200may store, in the storage unit270, information on a frequency band for transmitting/receiving signals to/from the display device100paired with the remote control device200and refer to it.

The control unit280controls general matters relating to control of the remote control device200. The control unit280may transmit a signal corresponding to a predetermined key manipulation of the user input unit230or a signal corresponding to movement of the remote control device200sensed by the sensor unit240to the display device100through the wireless communication unit220.

Additionally, the sound acquisition unit290of the remote control device200may obtain voice.

The sound acquisition unit290may include at least one microphone and obtain voice through the microphone291.

FIG.4is a view of utilizing a remote control device according to an embodiment of the present invention.

FIG.4(a)illustrates that a pointer205corresponding to the remote control device200is displayed on the display unit180.

A user may move or rotate the remote control device200vertically or horizontally. The pointer205displayed on the display unit180of the display device100corresponds to a movement of the remote control device200. Since the corresponding pointer205is moved and displayed according to a movement on a 3D space as show in the drawing, the remote control device200may be referred to as a spatial remote control device.

FIG.4(b)illustrates that if a user moves the remote control device200, the pointer205displayed on the display unit180of the display device100is moved to the left according to the movement of the remote control device200.

Information on a movement of the remote control device200detected through a sensor of the remote control device200is transmitted to the display device100. The display device100may calculate the coordinates of the pointer205from the information on the movement of the remote control device200. The display device100may display the pointer205to match the calculated coordinates.

FIG.4(c)illustrates that while a specific button in the remote control device200is pressed, a user moves the remote control device200away from the display unit180. Thus, a selection area in the display unit180corresponding to the pointer205may be zoomed in and displayed larger.

On the other hand, if a user moves the remote control device200close to the display unit180, a selection area in the display unit180corresponding to the pointer205may be zoomed out and displayed in a reduced size.

On the other hand, if the remote control device200is moved away from the display unit180, a selection area may be zoomed out and if the remote control device200is moved closer to the display unit180, a selection area may be zoomed in.

Additionally, if a specific button in the remote control device200is pressed, recognition of a vertical or horizontal movement may be excluded. That is, if the remote control device200is moved away from or closer to the display unit180, the up, down, left, or right movement cannot be recognized and only the back and forth movement may be recognized. While a specific button in the remote control device200is not pressed, only the pointer205is moved according to the up, down, left or right movement of the remote control device200.

Moreover, the moving speed or moving direction of the pointer205may correspond to the moving speed or moving direction of the remote control device200.

Furthermore, a pointer in this specification means an object displayed on the display unit180in response to an operation of the remote control device200. Accordingly, besides an arrow form displayed as the pointer205in the drawing, various forms of objects are possible. For example, the above concept includes a point, a cursor, a prompt, and a thick outline. Then, the pointer205may be displayed in correspondence to one point of a horizontal axis and a vertical axis on the display unit180and also may be displayed in correspondence to a plurality of points such as a line and a surface.

Meanwhile, the display device100may provide functions such as Internet search, home shopping, and online game. For example, the display device100may provide various functions such as Internet search, home shopping, online game, etc. through application.

The display device100may display at least one input field on the display180when providing the various functions described above.

An input field may be a UI (User Interface) for inputting text. The input field may receive text such as character and number. The control unit170may select an input field through the pointer203or the like and then, when text is input, display the input text in the input field.

The control unit170may receive text to be input into the input field through a button provided on the remote control device200. Alternatively, the control unit170may receive text to be input into the input field by recognizing the user's voice through the voice acquisition unit175.

Meanwhile, conventionally, when the control unit170recognizes the user's voice, it converts the text word by word. Accordingly, the control unit170converts the input user voice into a similar word even though it does not correspond to a specific word. In particular, when a user speaks to input an ID, password, or email, there is a high possibility that the text will be converted into characters different from the user's intent. This is because most ID, password, or email are composed of non-linguistic letters, and these letters are transformed into characters recognized as word unit. For example, the user intent to input “icadot” as the ID, but the control unit170converts into word unit as “I see AT&T” or “I can do it”, so there is problem occurring an error.

To minimize the occurrence of such error, the present disclosure seeks to perform speech recognition (STT: Speech-to-Text) in different way according to the input field.

First, with reference toFIG.5, the input field will be described.

FIG.5is a diagram illustrating an example of a screen on which a display device displays at least one input field according to an embodiment of the present disclosure.

Display180may display at least one input field. For example, the control unit170may control the display180to display at least one input field501,502, or503when accessing a portal site, etc.

The input fields501,502, and503may include an input field501for entering a search term, an input field502for entering an ID, and an input field503for entering a password, but as this is only an example, it is reasonable that it is not limited thereto.

The control unit170according to an embodiment of the present disclosure may distinguish type of input field and perform speech-to-text conversion (STT) differently for each type of input field.

With reference toFIGS.6and7, a method in which the display device100according to an embodiment of the present disclosure performs speech-to-text conversion differently according to the type of input field will be described in detail.

FIG.6is a control block diagram for explaining how a display device according to an embodiment of the present disclosure performs speech-to-text conversion differently according to the input field, andFIG.7is a flow chart illustrating a method in which a display device according to an embodiment of the present disclosure performs speech-to-text conversion differently according to the input field.

The display device100may include at least part or all of a voice input recognition unit191, an input field attribute check unit192, an input field attribute DB193, or a text conversion unit194.

The voice input recognition unit191, the input field attribute check unit192, the input field attribute DB193, or the text conversion unit194may be a component of the control unit170.

The voice input recognition unit191may recognize the user's voice. The voice input recognition unit191may be the voice acquisition unit175ofFIG.1. The voice acquisition unit175may acquire the voice input to the input field.

The input field attribute check unit192may check the attribute of the input field. In particular, the input field attribute check unit192may obtain the input type among the attributes of the input field and obtain the type of the input field based on the input type.

According to one embodiment, the control unit170may check the attribute of the input field to distinguish the type of input field. The control unit170may obtain the attribute of the input field and obtain the type of the input field based on the obtained attribute.

Specifically, the input type of the input field may be email, password, text, etc. The control unit170may preset an input type to be classified as a first type and an input type to be classified as a second type. For example, the control unit170may set email or password as an input type to be classified as a first type, and set text, etc. as an input type to be classified as a second type. The control unit170may obtain the input type of the input field in which voice recognition is performed/activated, and determine the input field as one of the first type or the second type based on the input type. For example, if the input type is email, the control unit170may determine the corresponding input field as the first type, and if the input type is text, the control unit170may determine the corresponding input field as the second type.

According to the embodiment, the storage unit140may store a table mapping the type of input field for each of a plurality of input types. This table may be stored in the input field attribute DB193.

The input field attribute DB193may store data to distinguish the type of input field. The input field attribute DB193may store data for determining the input field as either the first type or the second type for each attribute of the input field. The input field attribute DB193may store data that determines whether the voice to be input will be converted into character unit or word unit according to the attribute of the input field. An example of such data may be the table described above.

The text conversion unit194may convert the voice input through the voice input recognition unit191into text. The character conversion unit194may include a character unit conversion module195and a word unit conversion module196.

The character unit conversion module195may convert the input user voice into characters on a character unit basis. The character unit conversion module195may perform speech-to-text conversion using a character unit language model. For example, when the character unit conversion module195receives a user's voice input in English, it may perform character conversion on an alphabet basis.

The word unit conversion module196may convert the input user voice into text on a word-by-word basis. The word unit conversion module196may perform speech-to-text conversion using a word unit language model. As an example, the word unit conversion module196may convert the user's voice into text on a word-by-word basis.

Accordingly, the control unit170may perform speech-to-text conversion through the character unit conversion module195if the input field is the first type, and perform speech-to-text conversion through the word unit conversion module196when the input field is the second type.

That is, the control unit170converts voice into text, and may convert voice into text on a character unit or word unit according to the type of input field.

Next, with reference toFIG.7, a method of performing different speech-to-text conversion (STT) according to the type of input field will be described in detail.

The control unit170may recognize voice (S11).

The control unit170may start voice recognition for a specific input field.

The control unit170may determine whether the input field has an attribute that allows non-linguistic character string (S13).

That is, the control unit170may analyze the attribute of the input field and obtain whether the attribute of the input field allowing non-linguistic character string. Here, a list of non-linguistic character string may mean a list of characters that have no linguistic meaning. If it is an input field that receives an ID, password, email, URL, etc., the control unit170may determine that the input field has an attribute that allowing non-linguistic character string.

Meanwhile, step S13may be a step of determining the type of input field.

That is, according to the embodiment, in step S13, the control unit170may obtain the type of the input field. Specifically, the control unit170may obtain the type of the input field by determining the input field as either the first type or the second type based on the attribute of the input field.

In this specification, the first type of input field is an input field with an attribute that allows non-linguistic character string, and the second type of input field may refer to the remaining input fields excluding the first type.

If the input field has the attribute that allows non-linguistic character string, the control unit170may perform speech-to-text conversion using a character unit language model (S21).

That is, if the input field is a field that receives an ID, email address, or password, the control unit170may convert the voice into character unit/Alphabet unit. If the input field is the first type, the control unit170may convert the voice into text character by character.

The control unit170may check allowable character (S23) and convert the recognized voice into character unit (S25).

The control unit170may set allowable character (including space) differently according to the type of input field.

When the type of input field is the first type, the control unit170may only allow English alphabet, number, and preset special character (for example, @ used in email address). Accordingly, when the type of input field is the first type, the control unit170may display converted character in the input field using only alphabet, number, and preset special character.

Additionally, when the type of input field is the first type, the control unit170may display the converted characters as the recognized word in the input field when a word meaning a space is recognized. That is, when a word corresponding to “(for example, blank, space, etc.)” is recognized, the control unit170may display the word itself (e.g., blank, space, etc.) in the input field. That is, the control unit170may not space even if the word corresponding to “(for example, blank, space, etc.)” is recognized.

Additionally, the control unit170may not support spacing when the type of input field is the first type. Accordingly, when the type of input field is the first type, the control unit170may display the converted character in the input field without space.

The control unit170may obtain whether the voice speech is terminated (S27) and end speech-to-text conversion when the voice speech is terminated (S29).

Meanwhile, in step S13, if the control unit170determines that the input field does not have an attribute that allows non-linguistic character string, it may perform speech-to-text conversion using a word unit language model (S31).

For example, if the input field is a field that receives a search word, the control unit170may determine that it does not have an attribute that allows non-linguistic character string. As another example, the control unit170may determine that if the input field does not correspond to a field that receives an ID, email address, or password, it does not have the attribute that allows non-linguistic character string.

The control unit170may check allowable characters (S33) and convert the recognized voice into word unit (S35).

If the type of input field is the second type, the control unit170may perform text conversion into the language set as default. That is, when the type of input field is the second type, the control unit170may display characters converted to the language set as default in the input field. That is, when the type of input field is the second type, the control unit170is not limited to English and may perform text conversion to the set language.

When the type of input field is the second type, the control unit170may perform character conversion on a word-by-word basis and perform spacing for each of words.

Meanwhile, even when the type of input field is the second type, non-linguistic character string may be required. Accordingly, when the type of input field is the second type, the control unit170may provide an input mode switching function that converts voice into character unit for input of non-linguistic character string. If the type of input field is the second type, the control unit170may display an icon (not shown) for switching the input mode. If the type of input field is the second type, the control unit170may convert the voice into character unit through an input mode switching function, and in this case, spacing may not be supported.

The control unit170obtains whether the voice speech has ended (S37), and may end speech-to-text conversion when the voice speech has ended (S39).

According to the above-described method, if the input voice is “icadot”, the control unit170may display “icadot” on the input field if the input field is of the first type, and display “I see AT&T”, “I can do it” or “Ica dot”, etc if the input field is of the second type on the input field.

In addition, when the default setting language is a language other than English, such as Korean or French, even if the input voice is the same, if the input field is the first type, the control unit170may display the text converted to English in the input field, and display the text converted to English in the input field. If is the second type, characters converted to the default setting language may be displayed in the input field.

The present disclosure described above may be implemented as computer-readable code on a program-recorded medium. Computer-readable media includes all types of recording devices that store data that may be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Additionally, the computer may include a processor329of the sound reproduction device300. Accordingly, the above detailed description should not be construed as restrictive in all respects and should be considered illustrative. The scope of this specification should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of this specification are included in the scope of this specification.

The above description is merely an illustrative explanation of the technical idea of the present invention, and various modifications and variations will be possible to those skilled in the art without departing from the essential characteristics of the present invention.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but rather to explain it, and the scope of the technical idea of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be construed as being included in the scope of rights of the present invention.