Patent Description:
Patent application <CIT> discloses automatic instant translation from a source language to a target language.

With development of technology and improvement of people's living standard, people are more closely connected with to computer systems. People frequently use computer systems whether they are at home or at work. Recently, computer systems play an important role in video game industry. For example, a gaming computer is designed for playing games. A good interaction between players in the same team is very important. However, the poor communication or communication difficulty may easy occur between players who using different languages, and thus resulting in poor records. Thus, the prior art has to be improved.

The present invention therefore provides an electronic system and a multimedia processing method capable of improving the user experience to solve the above mentioned problems.

This is achieved by an electronic system and a multimedia processing method according to the claims.

The dependent claims pertain to corresponding further developments and improvements.

Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, hardware manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are utilized in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. Also, the term "couple" is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.

Please refer to <FIG>, which is a schematic diagram illustrating an electronic system <NUM> according to an embodiment of the present invention. The electronic system <NUM> includes a host <NUM>, an audio output device <NUM>, an audio input device <NUM> and a display <NUM>. The host <NUM> can be a desktop computer, a notebook, a mobile communication device, but not limited thereto. The host <NUM> includes an application program <NUM>, an audio processing module <NUM>, a relay processing module <NUM>, a smart interpreter engine <NUM> and a driver <NUM>. The application program <NUM> is stored in a storage device (not shown in figures) of the host <NUM> and executed by a processing circuit (not shown in figures) of the host <NUM>. The application program <NUM> is configured to process audio streams. The audio streams correspond to a first language. Audio data of the audio streams may be classified into a plurality of audio (sound) categories. The audio processing module <NUM> can acquire at least one sound type of audio data (or speech data) from the audio streams processed by the application program <NUM> as audio data corresponding to a first language. The audio processing module <NUM> can transmit the acquired audio data corresponding to the first language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data corresponding to the first language to the smart interpreter engine <NUM> for processing. Moreover, the audio processing module <NUM> can transmit the acquired audio data corresponding to the first language to the driver <NUM>. The driver <NUM> can convert the audio data acquired by the audio processing module <NUM> and corresponding to the first language into an analog speech signal corresponding to the first language. The driver <NUM> can transmit the analog speech signal corresponding to the first language to the audio output device <NUM>. For example, the driver <NUM> transmits the speech data corresponding to the first language to the audio output device <NUM> through a transmission interface (e.g., universal serial bus (USB) interface).

The audio output device <NUM> is utilized for playing the analog speech signal corresponding to the first language. The audio output device <NUM> can be a headphone or a speaker, but not limited thereto. The audio input device <NUM> is utilized for acquiring speech sounds in the current environment to generate an analog speech signal corresponding to a first language. The audio input device <NUM> can be a microphone, but not limited thereto. The audio output device <NUM>, the audio input device <NUM> and the display <NUM> can be connected to the host <NUM> through wireless or wired connections. In addition, the audio output device <NUM> and the audio input device <NUM> may be integrated onto a single structural element, such as a headset product.

The audio input device <NUM> can transmit the acquired analog speech signal corresponding to the first language to the driver <NUM>. The driver <NUM> can convert the analog speech signal acquired by the audio input device <NUM> and corresponding to the first language into audio data corresponding to the first language into audio data corresponding to the first language. The driver <NUM> can transmit the audio data corresponding to the first language to the audio processing module <NUM>. When receiving the audio data corresponding to the first language from the driver <NUM>, the audio processing module <NUM> transmits the audio data corresponding to the first language to the relay processing module <NUM>. When receiving the audio data corresponding to the first language from the audio processing module <NUM>, the relay processing module <NUM> transmits the audio data corresponding to the smart interpreter engine <NUM>.

The smart interpreter engine <NUM> can convert the audio data corresponding to the first language into text data corresponding to a second language. The smart interpreter engine <NUM> can further convert the text data corresponding to the second language into audio data corresponding to the second language. The smart interpreter engine <NUM> can be integrated into the relay processing module <NUM>. The smart interpreter engine <NUM> can also be disposed in a cloud device for processing data transmitted by the relay processing module <NUM>. For example, please refer to <FIG>, which is a schematic diagram illustrating the smart interpreter engine <NUM> according to an alternative embodiment of the present invention. As shown in <FIG>, the smart interpreter engine <NUM> is disposed in a cloud server <NUM>, such that the relay processing module <NUM> can communicate with the smart interpreter engine <NUM> through a wired or wireless network for transmitting related data.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> operating in a first operation mode (rendering mode) according to a first exemplary embodiment of the invention. As shown in <FIG>, the audio processing module <NUM> includes an audio engine <NUM>. For example, the audio engine <NUM> can be an audio processing object (APO). In the first operation mode (rendering mode), the audio engine <NUM> of the audio processing module <NUM> can acquire a first sound type of audio data from audio streams processed by the application program <NUM> for acting as audio data SREMOTE corresponding to a first language. For example, audio (sound) category of Microsoft Windows <NUM> operating system includes at least the following: movie, media, game chat, speech, communications, alerts, sound effects, game media, game effect, others. Each audio data can be tagged with one of sound categories. The audio engine <NUM> can acquire at least one sound type of audio data from audio streams processed by the application program <NUM> for acting as audio data SREMOTE corresponding to a first language. In an embodiment, the audio engine <NUM> acquires all of the audio data tagged as "Game chat" from the audio streams processed by the application program <NUM> for acting as the audio data SREMOTE corresponding to the first language according to the audio category tagged with the audio data. In an alternative embodiment, the audio engine <NUM> acquires all of the audio data tagged as any of "Game chat", "communications" and "others" from the audio streams processed by the application program <NUM> for acting as the audio data SREMOTE corresponding to the first language according to the audio category tagged with the audio data.

For example, please further refer to <FIG> and <FIG>. If the application program <NUM> is game software. The audio engine <NUM> includes a stream effect (SFX) APO. As shown in Table <NUM>, the SFX APO can receive audio (sound) data of game from the application program <NUM> for sound effect processing. For example, the SFX APO can obtain audio data tagged as "game chat" (e.g., player vocal shown in Table <NUM>) for sound effect processing. Before sound effect processing, the SFX APO can copy the audio data tagged as "game chat", and the copied audio data is utilized as the audio data SREMOTE corresponding to the first language. In other words, the audio engine <NUM> can utilize the APO to acquire the required sound types of audio data from the audio streams. In more detail, the audio engine <NUM> merely acquires the required sound types of audio data from the audio streams without further processing the acquired audio data.

Moreover, the audio engine <NUM> transmits the audio data SREMOTE corresponding to the first language to the relay processing module <NUM> and the driver <NUM>. The relay processing module <NUM> transmits the audio data SREMOTE corresponding to the first language to the smart interpreter engine <NUM>. The smart interpreter engine <NUM> converts the audio data SREMOTE corresponding to the first language into text data TXTREMOTE corresponding to a second language and provides the text data TXTREMOTE corresponding to the second language to the delay processing module <NUM>. After that, the delay processing module <NUM> provides the text data TXTREMOTE corresponding to the second language to the display <NUM>. The display <NUM> displays the text data TXTREMOTE corresponding to the second language for the user. Further, since the audio data SREMOTE corresponding to the first language is a digital signal, the driver <NUM> converts the audio data SREMOTE corresponding to the first language into an analog speech signal SREMOTE' corresponding to the first language. The analog speech signal SREMOTE' corresponding to the first language is an analog signal. For example, the driver <NUM> includes a digital to analog converter (not shown in figures). The digital to analog converter can convert the audio data SREMOTE corresponding to the first language into an analog speech signal SREMOTE' corresponding to the first language. The driver <NUM> transmits the analog speech signal SREMOTE' corresponding to the first language to the audio output device <NUM>. The audio output device <NUM> playbacks the analog speech signal SREMOTE' corresponding to the first language to generate sound to the user.

For example, if the first language is English and the second language is Chinese. After acquiring the audio data SREMOTE in English, the audio processing module <NUM> provides the audio data SREMOTE in English to the smart interpreter engine <NUM> through the delay processing module <NUM>. The smart interpreter engine <NUM> converts the audio data SREMOTE in English into text data TXTREMOTE in Chinese, such that the display <NUM> displays the text data TXTREMOTE in Chinese. Meanwhile, the driver <NUM> converts the audio data SREMOTE in English into an analog speech signal SREMOTE' in English and transmits the analog speech signal SREMOTE' in English to the audio output device <NUM> for playback. Therefore, when a user familiar with the second language is using the electronic system <NUM>, the user can hear the analog speech signal SREMOTE' corresponding to the first language played by the audio output device <NUM> and see the text data TXTREMOTE corresponding to the second language displayed by the display <NUM>. Under such a situation, even the user does not understand the analog speech signal SREMOTE' corresponding to the first language, the user can understand and perceive what the information conveyed by the audio data SREMOTE corresponding to the first language while seeing the text data TXTREMOTE corresponding to the second language displayed by the display <NUM>.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> operating in a second operation mode (capturing mode) according to a first exemplary embodiment of the invention. As shown in <FIG>, the audio processing module <NUM> includes an audio engine <NUM>. For example, the audio engine <NUM> can be an APO. In the second operation mode (capturing mode), the audio input device <NUM> acquires speech sounds of the current environment to generate an analog speech signal SLO corresponding to a first language. The audio input device <NUM> transmits the analog speech signal SLO corresponding to the first language to the driver <NUM>. Since the analog speech signal SLO corresponding to the first language is an analog signal, the driver <NUM> converts the analog speech signal SLO corresponding to the first language into audio data SLO' corresponding to the first language. The audio data SLO' corresponding to the first language is a digital signal. For example, the driver <NUM> includes an analog to digital converter (not shown in figures). The analog to digital converter can convert the analog speech signal SLO corresponding to the first language into the audio data SLO' corresponding to the first language. The driver <NUM> transmits the audio data SLO' corresponding to the first language to the audio engine <NUM>. The audio engine <NUM> transmits the audio data SLO' corresponding to the first language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data SLO' corresponding to the first language to the smart interpreter engine <NUM>.

The smart interpreter engine <NUM> converts the audio data SLO' corresponding to the first language into audio data SLO_O corresponding to a second language. In an embodiment, the smart interpreter engine <NUM> converts the audio data SLO' corresponding to the first language into text data corresponding to the first language and further converts the text data corresponding to the first language into text data corresponding to the second language. Further, the smart interpreter engine <NUM> converts the text data corresponding to the second language into audio data SLO_O corresponding to the second language. In an alternative embodiment, the smart interpreter engine <NUM> converts the audio data SLO' corresponding to the first language into text data corresponding to the second language and further converts the text data corresponding to the second language into audio data SLO_O corresponding to the second language. Moreover, the smart interpreter engine <NUM> transmits the audio data SLO_O corresponding to the second language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data SLO_O corresponding to the second language to the audio engine <NUM>. The audio engine <NUM> provides the audio data SLO_O corresponding to the second language to the application program <NUM>. The application program <NUM> provides the audio data SLO_O corresponding to the second language to the external device. As a result, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system <NUM> when hearing the audio data SLO_O corresponding to the second language outputted by the electronic system <NUM>.

In other words, when the electronic system <NUM> operates in a first operation mode (rendering mode), the audio processing module <NUM> transmits the audio data SREMOTE corresponding to the first language, which is acquired from the audio streams, to the relay processing module <NUM>. When the electronic system <NUM> operates in a second operation mode (capturing mode), the audio processing module <NUM> transmits the audio data SLO' corresponding to the first language, which is converted by the driver <NUM>, to the relay processing module <NUM>. Moreover, the relay processing module <NUM> receives and provides the audio data SLO_O corresponding to the second language to the application program <NUM>. Since the relay processing module <NUM> is disposed in the host <NUM>, the audio data SREMOTE corresponding to the first language and the audio data SLO' converted by the driver and corresponding to the first language can be transmitted to the relay processing module <NUM> by the audio processing module <NUM>, without being transmitted through the driver <NUM>. In addition, during the first operation mode (rendering mode), the relay processing module <NUM> transmits the audio data SREMOTE corresponding to the first language to the smart interpreter engine <NUM> and transmits the text data TXTREMOTE corresponding to the second language to the display <NUM> for display. During the second operation mode (capturing mode), the relay processing module <NUM> transmits the audio data SLO' corresponding to the first language to the smart interpreter engine <NUM> and transmits audio data SLO_O to the audio processing module <NUM>. Therefore, the relay processing module <NUM> can coordinate and arrange the input and output of the smart interpreter engine <NUM> for realizing related data conversion process.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> operating in a first operation mode (rendering mode) according to a second exemplary embodiment of the invention. As shown in <FIG>, the audio processing module <NUM> includes an audio engine <NUM> and a virtual driver <NUM>. For example, the audio engine <NUM> can be an APO. In an embodiment, the audio engine <NUM> can be a user mode component of an operating system. The virtual driver <NUM> can be a kernel mode component of the operating system. The virtual driver <NUM> can execute in the kernel mode. In the first operation mode (rendering mode), the audio engine <NUM> can acquire at least one sound type of audio data from audio streams processed by the application program <NUM> for acting as audio data SREMOTE corresponding to a first language. The audio engine <NUM> can utilize the APO to acquire required sound types of audio data. The audio engine <NUM> merely acquires the required sound types of audio data from the audio streams without further processing the acquired audio data. Moreover, the virtual driver <NUM> can intercept the audio data SREMOTE, which is acquired by the audio engine <NUM>, corresponding to the first language. Further, the virtual driver <NUM> transmits the audio data SREMOTE corresponding to the first language to the relay processing module <NUM> and the driver <NUM>. That is, the virtual driver <NUM> can intercept the audio data SREMOTE corresponding to the first language from the audio engine <NUM> and transmits the intercepted audio data SREMOTE remaining untouched or unchanged to the relay processing module <NUM> and the driver <NUM>.

The relay processing module <NUM> transmits the audio data SREMOTE corresponding to the first language to the smart interpreter engine <NUM>. The smart interpreter engine <NUM> converts the audio data SREMOTE corresponding to the first language into text data TXTREMOTE corresponding to a second language and provides the text data TXTREMOTE corresponding to the second language to the delay processing module <NUM>. Further, the delay processing module <NUM> provides the text data TXTREMOTE corresponding to the second language to the display <NUM>. The display <NUM> displays the text data TXTREMOTE corresponding to the second language for the user. In addition, since the audio data SREMOTE corresponding to the first language is a digital signal, the driver <NUM> converts the audio data SREMOTE corresponding to the first language into an analog speech signal SREMOTE' corresponding to the first language. The analog speech signal SREMOTE' corresponding to the first language is an analog signal. For example, the driver <NUM> includes a digital to analog converter (not shown in figures). The digital to analog converter can convert the audio data SREMOTE corresponding to the first language into an analog speech signal SREMOTE' corresponding to the first language. The driver <NUM> transmits the analog speech signal SREMOTE' corresponding to the first language to the audio output device <NUM>. The audio output device <NUM> playbacks the analog speech signal SREMOTE' corresponding to the first language to generate sound to the user. In other words, when a user familiar with the second language is using the electronic system <NUM>, the user can hear the analog speech signal SREMOTE' corresponding to the first language played by the audio output device <NUM> and see the text data TXTREMOTE corresponding to the second language displayed by the display <NUM>. Under such a situation, even the user does not understand the analog speech signal SREMOTE' corresponding to the first language, the user can understand and perceive what the information conveyed by the audio data SREMOTE corresponding to the first language while seeing the text data TXTREMOTE corresponding to the second language displayed by the display <NUM>.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> operating in a second operation mode (capturing mode) according to a second exemplary embodiment of the invention. As shown in <FIG>, the audio processing module <NUM> includes an audio engine <NUM> and a virtual driver <NUM>. For example, the audio engine <NUM> can be an APO. In an embodiment, the audio engine <NUM> can be a user mode component of an operating system. The virtual driver <NUM> can be a kernel mode component of the operating system. The virtual driver <NUM> can execute in the kernel mode. In the second operation mode (capturing mode), the audio input device <NUM> acquires speech sounds of the current environment to generate an analog speech signal SLO corresponding to a first language. The audio input device <NUM> transmits the analog speech signal SLO corresponding to the first language to the driver <NUM>. Since the analog speech signal SLO corresponding to the first language is an analog signal, the driver <NUM> converts the analog speech signal SLO corresponding to the first language into audio data SLO' corresponding to the first language. The audio data SLO' corresponding to the first language is a digital signal. For example, the driver <NUM> includes an analog to digital converter (not shown in figures). The analog to digital converter can convert the analog speech signal SLO corresponding to the first language into the audio data SLO' corresponding to the first language. After that, the virtual driver <NUM> can intercept the audio data SLO' converted by the driver <NUM> and corresponding to the first language. The virtual driver <NUM> transmits the audio data SLO' remaining untouched or unchanged to the relay processing module <NUM>. For example, the user can develop and create a virtual driver <NUM> on the platform of the operating system (e.g., Microsoft Windows <NUM> operating system) and the virtual driver <NUM> may be set to work within a driver layer. The virtual driver <NUM> utilizes a software to simulate a hardware (e.g., audio input device <NUM>) for replacing the original software, such that when intercepting the audio data SLO' corresponding to the first language, which is converted by the driver <NUM>, the virtual driver <NUM> can transmit the audio data SLO' remaining untouched to the relay processing module <NUM>.

The relay processing module <NUM> transmits the audio data SLO' corresponding to the first language to the smart interpreter engine <NUM>. The smart interpreter engine <NUM> converts the audio data SLO' corresponding to the first language into audio data SLO_O corresponding to a second language. The smart interpreter engine <NUM> transmits the audio data SLO_O corresponding to the second language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data SLO_O corresponding to the second language to the virtual driver <NUM>. The virtual driver <NUM> transmits the audio data SLO_O (remaining untouched or unchanged) corresponding to the second language to the audio engine <NUM>. The audio engine <NUM> provides the audio data SLO_O corresponding to the second language to the application program <NUM>. The application program <NUM> provides the audio data SLO_O corresponding to the second language to the external device. As a result, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system <NUM> when hearing the audio data SLO_O corresponding to the second language outputted by the electronic system <NUM>.

Please refer to <FIG> is a schematic diagram of the smart interpreter engine <NUM> shown in <FIG> according to an exemplary embodiment of the invention. The smart interpreter engine <NUM> includes a noise suppression module <NUM>, a vocal identification module <NUM>, a speech to text converter <NUM>, a natural language processing (NLP) module <NUM>, a translator <NUM>, a text to speech converter <NUM> and a text database <NUM>. When the electronic system <NUM> operates in the first operation mode (capturing mode), the audio processing module <NUM> transmits the audio data SREMOTE corresponding to the first language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data SREMOTE corresponding to the first language to the smart interpreter engine <NUM>. The noise suppression module <NUM> performs a noise suppression process on the audio data SREMOTE corresponding to the first language for reducing noise component in the audio data. The vocal identification module <NUM> performs a vocal identification process on the noise-suppressed audio data SREMOTE corresponding to the first language to generate vocal identification data corresponding to the first language. The vocal identification data is vocal data in the noise-suppressed audio data SREMOTE, which is determined as a human voice by the vocal identification module <NUM>. In addition, if there is no noise suppression requirement, the smart interpreter engine <NUM> can directly transmit the noise-suppressed audio data SREMOTE to the vocal identification module <NUM> for vocal identification processing. The speech to text converter <NUM> converts the vocal identification data corresponding to the first language into text data corresponding to the first language. The text data corresponding to the first language may include at least one word.

The NLP module <NUM> can convert the text data corresponding to the first language into glossary text data corresponding to the first language. For example, the NLP module <NUM> converts the text data corresponding to the first language into glossary text data corresponding to the first language according to the application program <NUM> being executed in the host <NUM>. The host <NUM> can inform the smart interpreter engine <NUM> of information of the application program <NUM> being executed in the host <NUM>. Besides, the smart interpreter engine <NUM> can ask the host <NUM> which application program <NUM> is executing by the host <NUM>. For example, the NLP module <NUM> queries the text database <NUM> according to the application program <NUM> being executed in the host <NUM> and the text data corresponding to the first language converted by the speech to text converter <NUM>. The text database <NUM> includes a plurality of text samples corresponding to the first language and a plurality of application programs, and a plurality of glossary texts corresponding to the text samples. For example, a first text sample corresponding to the first language and a first application program has corresponding glossary text corresponding to the first language. A second text sample corresponding to the first language and a second application program has corresponding glossary text corresponding to the first language and so on. Each text sample includes at least one word. Each glossary text includes at least one word. As such, the NLP module <NUM> can compare the application program <NUM> being executed in the host <NUM> and the text data corresponding to the first language with the text samples of the text database <NUM>, so as to find out the match results and accordingly determine the corresponding glossary text.

When a word of the text data corresponding to the first language matches a first text sample of the plurality of text samples of the text database <NUM> and the application program <NUM> being executed in the host <NUM> matches an application program corresponding to the first text sample, the NLP module <NUM> converts the word of the text data corresponding to the first language into the glossary text corresponding to the first text sample. When a plurality of words of the text data corresponding to the first language matches a first text sample of the plurality of text samples of the text database <NUM> and the application program <NUM> being executed in the host <NUM> matches an application program corresponding to the first text sample, the NLP module <NUM> converts the plurality of words of the text data corresponding to the first language into the glossary text corresponding to the first text sample. Moreover, the translator <NUM> converts the glossary text data corresponding to the first language into text data TXTREMOTE corresponding to a second language. As a result the text data TXTREMOTE corresponding to a second language can be provided to the display <NUM> for display to the user.

For example, please refer to Table <NUM>. Table <NUM> illustrates an exemplary embodiment of the text database <NUM>. Suppose the first language is English and the second language is Chinese. The first application program is League of Legends game software. The second application program is Minecraft game software. The third application program is SimCity game software. The fourth application program is general application program. For example, in this embodiment, the fourth application program can be any application program except the fifth application program. The glossary text corresponding to the fourth application program may be a daily life expression, rather than a glossary text dedicated to a component, a prop or a role in a specific game software. The fifth application program is PUBG (PLAYER UNKNOWN'S BATTLE GROUNDS) game software. If an English word in the text data is "flash" and the application program <NUM> being executed in the host <NUM> is the first application program, the NLP module <NUM> converts the English word "flash" into a glossary text "flash" of English corresponding to the first application program. The translator <NUM> converts the glossary text "flash" of English into Chinese words "<IMG>" (Chinese characters). If an English word in the text data is "flash" and the application program <NUM> being executed in the host <NUM> is the second application program, the NLP module <NUM> converts the English word "flash" into a glossary text "accelerator" of English corresponding to the second application program. The translator <NUM> converts the glossary text "accelerator" of English into Chinese words "<IMG>" (Chinese characters). In other words, each application program may apply different glossary texts (i.e. different glossary texts for different application programs). The user can choose different text database (also called language pack) for the smart interpreter engine <NUM>. The smart interpreter engine <NUM> can also detect the kind of application program being executed and accordingly switch to the corresponding text database for interpretation. If an English word in the text data is "feeder" and the application program <NUM> being executed in the host <NUM> is the first application program, the NLP module <NUM> converts the English word "feeder" into a glossary text "fertilizer" of English corresponding to the first application program. The translator <NUM> converts the glossary text "fertilizer" of English into Chinese words "<IMG>" (Chinese characters). If an English word in the text data is "feeder" and the application program <NUM> being executed in the host <NUM> is the third application program, the NLP module <NUM> converts the English feeder "flash" into a glossary text "feeder" of English corresponding to the third application program. The translator <NUM> converts the glossary text "feeder" of English into Chinese words "<IMG>" (Chinese characters)and the like.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> applied for an online game according to an exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in <FIG>, the users UA, UB and UC are utilizing their electronic systems to implement the first application program (e.g., League of Legends game software) for playing League of Legends online game, respectively. For example, the user UB utilizes the electronic system <NUM> of the invention to implement the first application program. When playing the League of Legends online game, the user UA says "use flash" in English and the corresponding analog speech signal of English is generated and transmitted to the electronic system <NUM> utilized by the user UB through the network. The electronic system <NUM> utilized by the user UB converts the analog speech signal of English in to audio data SREMOTE (digital data) of English. Since the host <NUM> is currently implementing the first application program, the smart interpreter engine <NUM> converts the audio data "flash" of English into Chinese words "<IMG>" (Chinese characters) after querying the text database <NUM>. Moreover, the smart interpreter engine <NUM> converts the audio data "use" of English into Chinese words "æffl" (Chinese characters) after querying the text database <NUM>. Therefore, as shown in <FIG>, the user UB can hear the spoken words "use flash" in English played by the audio output device <NUM> based on the analog speech data SREMOTE'. A display area 400A of the display <NUM> shows the Chinese words "æffl" in Chinese characters. A display area 400B of the display <NUM> shows the Chinese words "<IMG>" in Chinese characters. As a result, although the user UB does not understand English and does hear the analog speech data SREMOTE' (i.e. the spoken words "use flash") of English played by the audio output device <NUM>, the user UB can still understand and perceive what the information conveyed by the user UA while seeing the Chinese words "<IMG>" in Chinese characters displayed on the display <NUM>. Therefore, the electronic system <NUM> can not only convert the speech data into text data, but also provide flexible glossary translation for different application situations, so as to meet player's demands and increase player immersion in the esports game.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> applied for an online game according to an alternative exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in <FIG>, the users UA, UB and UC are utilizing their electronic systems to implement the second application program (e.g., Minecraft game software) for playing Minecraft online game, respectively. For example, the user UB utilizes the electronic system <NUM> of the invention to implement the second application program. When playing the Minecraft online game, the user UA says "use flash" in English and the corresponding analog speech signal of English is generated and transmitted to the electronic system <NUM> utilized by the user UB through the network. The electronic system <NUM> utilized by the user UB converts the analog speech signal of English in to audio data SREMOTE (digital data) of English. Since the host <NUM> is currently implementing the second application program, the smart interpreter engine <NUM> converts the audio data "flash" of English into Chinese words "" (Chinese characters) after querying the text database <NUM>. Moreover, the smart interpreter engine <NUM> converts the speech data "use" of English into Chinese words "æffl" (Chinese characters) after querying the text database <NUM>. Therefore, as shown in <FIG>, the user UB can hear the spoken words "use flash" in English played by the audio output device <NUM> based on the analog speech data SREMOTE'. A display area 400C of the display <NUM> shows Chinese words "æffl" in Chinese characters. A display area 400D of the display <NUM> shows Chinese words "<IMG>" in Chinese characters. As a result, although the user UB does not understand English and does hear the analog speech data SREMOTE' (i.e. the spoken words "use flash") of English played by the audio output device <NUM>, the user UB can still understand and perceive what the information conveyed by the user UA while seeing the Chinese words "<IMG>" in Chinese characters displayed on the display <NUM>.

Please further refer to <FIG> and <FIG>. When the electronic system <NUM> operates in the second operation mode (capturing mode), the driver <NUM> converts the analog speech signal SLO corresponding to the first language into audio data SLO' corresponding to the first language and transmits the audio data SLO' corresponding to the first language to the audio processing module <NUM>. The audio processing module <NUM> transmits the audio data SLO' corresponding to the first language to the relay processing module <NUM>. After that, the relay processing module <NUM> transmits the audio data SLO' corresponding to the first language to the smart interpreter engine <NUM>. Further, the noise suppression module <NUM> performs a noise suppression process on the audio data SLO' corresponding to the first language for reducing noise component in the audio data. The vocal identification module <NUM> performs a vocal identification process on the noise-suppressed audio data SLO' corresponding to the first language to generate vocal identification data corresponding to the first language. The speech to text converter <NUM> converts the vocal identification data corresponding to the first language into text data corresponding to the first language. As mentioned above, The NLP module <NUM> can convert the text data corresponding to the first language into glossary text data corresponding to the first language. The translator <NUM> converts the glossary text data corresponding to the first language into text data corresponding to a second language. Moreover, the text to speech converter <NUM> converts the text data corresponding to the second language into the audio data SLO_O corresponding to the second language. After that, the smart interpreter engine <NUM> transmits the audio data SLO_O corresponding to the second language to the relay processing module <NUM>. The relay processing module <NUM> transmits the audio data SLO_O corresponding to the second language to the audio processing module <NUM>. The audio processing module <NUM> transmits the audio data SLO_O corresponding to the second language to the application program <NUM>. The application program <NUM> provides the audio data SLO_O corresponding to the second language to the external devices. Under such a situation, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system <NUM> after hearing the audio data SLO_O corresponding to the second language outputted by the electronic system <NUM>.

Please refer to <FIG> is a schematic diagram of the electronic system <NUM> applied for an online game according to an alternative exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in <FIG>, the users UA, UB and UC are utilizing their electronic systems to implement the first application program (e.g., League of Legends game software) for playing League of Legends online game, respectively. For example, the user UA utilizes the electronic system <NUM> of the invention to implement the first application program. When playing the League of Legends online game, the user UA says "use flash" in English and the corresponding analog speech signal of English is generated. The driver <NUM> of the electronic system <NUM> utilized by the user UA converts the analog speech signal of English into digital audio data of English. Since the host <NUM> is currently implementing the first application program, the smart interpreter engine <NUM> converts the audio data "use flash" of English into audio data "<IMG> <IMG>" (i.e. "shih yung shan hsien" in Romanized form) of Chinese and provides the converted audio data of Chinese to the user UB. As a result, the user UB can understand and perceive what the information conveyed by the user UA while hearing the speech data "<IMG>" (i.e. "shih yung shan hsien" in Romanized form) of Chinese.

Claim 1:
An electronic system (<NUM>) comprising:
a host (<NUM>), comprising:
an audio processing module (<NUM>) for acquiring audio data corresponding to a first language from audio streams processed by an application program (<NUM>) executed on the host (<NUM>), wherein the application program (<NUM>) executed on the host (<NUM>) comprises a specific game software;
a relay processing module (<NUM>) for receiving the audio data corresponding to the first language from the audio processing module (<NUM>);
a smart interpreter engine (<NUM>) for receiving the audio data corresponding to the first language from the relay processing module (<NUM>) and converting the audio data corresponding to the first language into text data corresponding to the first language, and converting the text data corresponding to the first language into text data corresponding to a second language according to the game software executed on the host (<NUM>), the smart interpreter engine (<NUM>) comprising:
a natural language processing module (<NUM>) for converting the text data corresponding to the first language into glossary text data corresponding to the first language according to the game software executed by the host (<NUM>);
a text database (<NUM>) comprising a plurality of text samples corresponding to the first language and a plurality of game software, and a plurality of glossary texts corresponding to the text samples, wherein the natural language processing module (<NUM>) queries the text database (<NUM>) to determine the glossary text data corresponding to the first language according to the game software being executed in the host (<NUM>) and the text data corresponding to the first language; and
a translator (<NUM>) for converting the glossary text data corresponding to the first language into text data corresponding to the second language, wherein the smart interpreter engine (<NUM>) transmits the text data corresponding to the second language to the relay processing module (<NUM>); and
a driver (<NUM>) for converting the audio data corresponding to the first language into an analog speech signal corresponding to the first language;
an audio output device (<NUM>) for playing the analog speech signal corresponding to the first language; and
a display (<NUM>) for receiving the text data corresponding to the second language from the relay processing module (<NUM>) and displaying the text data corresponding to the second language.