Patent Publication Number: US-2021193107-A1

Title: Multimedia processing method and electronic system

Description:
CROSS REFERENCE TO RELATED APPLICATIONS 
     This application is a continuation application of U.S. application Ser. No. 16/430,407 filed on Jun. 3rd, 2019, wherein U.S. application Ser. No. 16/430,407 is further a continuation-in-part application of U.S. application Ser. No. 16/200,556, filed on Nov. 26, 2018. The contents of these applications are incorporated herein by reference. 
    
    
     BACKGROUND OF THE INVENTION 
     1. Field of the Invention 
     The present invention relates to an electronic system and multimedia processing method, and more particularly, to an electronic system and multimedia processing method capable of acquiring audio data in game and submitting audio data to a smart interpreter engine for vocal identification and neural machine translation, and thus improving the user experience. 
     2. Description of the Prior Art 
     With development of technology and improvement of people&#39;s living standard, people are more closely connected with to computer systems. People frequently use computer systems whether they are at home or at work. Recently, computer systems play an important role in video game industry. For example, a gaming computer is designed for playing games. A good interaction between players in the same team is very important. However, the poor communication or communication difficulty may easy occur between players who using different languages, and thus resulting in poor records. Thus, the prior art has to be improved. 
     SUMMARY OF THE INVENTION 
     It is therefore a primary objective of the present invention to provide an electronic system and multimedia processing method capable of improving the user experience, to solve the above-mentioned problem. 
     According to an embodiment of the present invention, an exemplary electronic system is disclosed. The exemplary electronic system comprises a host, comprising: an audio processing module for acquiring audio data corresponding to a first language from audio streams processed by an application program executed on the host, wherein the application program executed on the host comprises a specific game software; and a smart interpreter engine for receiving the audio data corresponding to the first language from the audio processing module and converting the audio data corresponding to the first language into text data corresponding to a second language according to the game software executed on the host; and a display for receiving the text data corresponding to the second language from the smart interpreter engine and displaying the text data corresponding to the second language 
     According to an embodiment of the present invention, an exemplary multimedia processing method for an electronic system is disclosed. The electronic system comprises a host, the host comprising an audio processing module and a smart interpreter engine, the multimedia processing method comprises utilizing the audio processing module to acquire audio data corresponding to a first language from audio streams processed by an application program executed on the host and transmit the audio data corresponding to the first language to the smart interpreter engine, wherein the application program executed on the host comprises a specific game software; utilizing the smart interpreter engine to convert the audio data corresponding to the first language into text data corresponding to a second language according to the game software executed on the host and transmit the text data corresponding to the second language to the display; and utilizing the display to receive the text data corresponding to the second language from the smart interpreter engine and display the text data corresponding to the second language. 
     According to an embodiment of the present invention, an exemplary electronic system is disclosed. The exemplary electronic system comprises an audio input device for acquiring speech sounds of current environment to generate an analog speech signal corresponding to a first language; and a host, comprising: a driver for receiving the analog speech signal corresponding to the first language from the audio input device and converting the analog speech signal corresponding to the first language into audio data corresponding to the first language; an audio processing module for obtaining the audio data corresponding to the first language from the driver; and a smart interpreter engine for receiving the audio data corresponding to the first language from the audio processing module and converting the audio data corresponding to the first language into audio data corresponding to a second language according to an application program executed on the host, wherein the application program executed on the host comprises a specific game software; wherein after the audio data corresponding to the second language is converted by the smart interpreter engine, the audio processing module transmits the audio data corresponding to the second language to the game software executed by the host. 
     According to an embodiment of the present invention, an exemplary multimedia processing method is disclosed. The electronic system comprises an audio input device and a host, the host comprising an audio processing module, a smart interpreter engine and a driver. The exemplary multimedia processing method comprises utilizing the audio input device to acquire speech sounds of current environment to generate an analog speech signal corresponding to a first language; utilizing the driver to receive the analog speech signal corresponding to the first language from the audio input device and convert the analog speech signal corresponding to the first language into audio data corresponding to the first language; utilizing the audio processing module to obtain the audio data corresponding to the first language from the driver and transmit the audio data corresponding to the first language to the smart interpreter engine; utilizing the smart interpreter engine to convert the audio data corresponding to the first language into audio data corresponding to a second language according to an application program executed in the host, wherein the application program executed on the host comprises a specific game software, and utilizing the smart interpreter engine to transmit the audio data corresponding to the second language to the audio processing module; and utilizing the audio processing module to receive the audio data corresponding to the second language from the smart interpreter engine and transmit the audio data corresponding to the second language to the application program executed by the host. 
     These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is a schematic diagram illustrating an electronic system according to an embodiment of the present invention. 
         FIG. 2  is a schematic diagram of the smart interpreter engine shown in  FIG. 1  according to a first exemplary embodiment of the invention. 
         FIG. 3  is a schematic diagram of the electronic system operating in a first operation mode according to a first exemplary embodiment of the invention. 
         FIG. 4  is a schematic diagram of the electronic system operating in a second operation mode according to a first exemplary embodiment of the invention. 
         FIG. 5  is a schematic diagram of the electronic system operating in a first operation mode according to a second exemplary embodiment of the invention. 
         FIG. 6  is a schematic diagram of the electronic system operating in a second operation mode according to a second exemplary embodiment of the invention. 
         FIG. 7  is a schematic diagram of the smart interpreter engine shown in  FIG. 1  according to a second exemplary embodiment of the invention. 
         FIGS. 8-10  are schematic diagrams of the electronic system applied for an online game according to exemplary embodiments of the invention respectively. 
     
    
    
     DETAILED DESCRIPTION 
     Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, hardware manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms “include” and “comprise” are utilized in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections. 
     Please refer to  FIG. 1 , which is a schematic diagram illustrating an electronic system  1  according to an embodiment of the present invention. The electronic system  1  includes a host  10 , an audio output device  20 , an audio input device  30  and a display  40 . The host  10  can be a desktop computer, a notebook, a mobile communication device, but not limited thereto. The host  10  includes an application program  100 , an audio processing module  102 , a relay processing module  104 , a smart interpreter engine  106  and a driver  108 . The application program  100  is stored in a storage device (not shown in figures) of the host  10  and executed by a processing circuit (not shown in figures) of the host  10 . The application program  100  is configured to process audio streams. The audio streams correspond to a first language. Audio data of the audio streams maybe classified into a plurality of audio (sound) categories. The audio processing module  102  can acquire at least one sound type of audio data (or speech data) from the audio streams processed by the application program  100  as audio data corresponding to a first language. The audio processing module  102  can transmit the acquired audio data corresponding to the first language to the relay processing module  104 . The relay processing module  104  transmits the audio data corresponding to the first language to the smart interpreter engine  106  for processing. Moreover, the audio processing module  102  can transmit the acquired audio data corresponding to the first language to the driver  108 . The driver  108  can convert the audio data acquired by the audio processing module  102  and corresponding to the first language into an analog speech signal corresponding to the first language. The driver  108  can transmit the analog speech signal corresponding to the first language to the audio output device  20 . For example, the driver  108  transmits the speech data corresponding to the first language to the audio output device  20  through a transmission interface (e.g., universal serial bus (USB) interface). 
     The audio output device  20  is utilized for playing the analog speech signal. For example, the audio output device  20  is utilized for playing the analog speech signal corresponding to the first language or the second language. The audio output device  20  can be a headphone or a speaker, but not limited thereto. The audio input device  30  is utilized for acquiring speech sounds in the current environment to generate an analog speech signal corresponding to a first language. The audio input device  30  can be a microphone, but not limited thereto. The audio output device  20 , the audio input device  30  and the display  40  can be connected to the host  10  through wireless or wired connections. In addition, the audio output device  20  and the audio input device  30  may be integrated onto a single structural element, such as a headset product. 
     The audio input device  30  can transmit the acquired analog speech signal corresponding to the first language to the driver  108 . The driver  18  can convert the analog speech signal acquired by the audio input device  30  and corresponding to the first language into audio data corresponding to the first language into audio data corresponding to the first language. The driver  18  can transmit the audio data corresponding to the first language to the audio processing module  102 . When receiving the audio data corresponding to the first language from the driver  108 , the audio processing module  102  transmits the audio data corresponding to the first language to the relay processing module  104 . When receiving the audio data corresponding to the first language from the audio processing module  102 , the relay processing module  104  transmits the audio data corresponding to the smart interpreter engine  106 . 
     The smart interpreter engine  106  can convert the audio data corresponding to the first language into text data corresponding to a second language. The smart interpreter engine  106  can further convert the text data corresponding to the second language into audio data corresponding to the second language. The smart interpreter engine  106  can be integrated into the relay processing module  104 . The smart interpreter engine  106  can also be disposed in a cloud device for processing data transmitted by the relay processing module  104 . For example, please refer to  FIG. 2 , which is a schematic diagram illustrating the smart interpreter engine  106  according to an alternative embodiment of the present invention. As shown in  FIG. 2 , the smart interpreter engine  106  is disposed in a cloud server  50 , such that the relay processing module  104  can communicate with the smart interpreter engine  106  through a wired or wireless network for transmitting related data. 
     Please refer to  FIG. 3 .  FIG. 3  is a schematic diagram of the electronic system  1  operating in a first operation mode (rendering mode) according to a first exemplary embodiment of the invention. As shown in  FIG. 3 , the audio processing module  102  includes an audio engine  1022 . For example, the audio engine  1022  can be an audio processing object (APO). In the first operation mode (rendering mode), the audio engine  1022  of the audio processing module  102  can acquire a first sound type of audio data from audio streams processed by the application program  100  for acting as audio data S REMOTE  corresponding to a first language. For example, audio (sound) category of Microsoft Windows 10 operating system includes at least the following: movie, media, game chat, speech, communications, alerts, sound effects, game media, game effect, others. Each audio data can be tagged with one of sound categories. The audio engine  1022  can acquire at least one sound type of audio data from audio streams processed by the application program  100  for acting as audio data S REMOTE  corresponding to a first language. In an embodiment, the audio engine  1022  acquires all of the audio data tagged as “Game chat” from the audio streams processed by the application program  100  for acting as the audio data S REMOTE  corresponding to the first language according to the audio category tagged with the audio data. In an alternative embodiment, the audio engine  1022  acquires all of the audio data tagged as any of “Game chat”, “communications” and “others” from the audio streams processed by the application program  100  for acting as the audio data S REMOTE  corresponding to the first language according to the audio category tagged with the audio data. 
     For example, please further refer to  FIG. 1  and  FIG. 3 . If the application program  100  is game software. The audio engine  1022  includes a stream effect (SFX) APO. As shown in Table 1, the SFX APO can receive audio (sound) data of game from the application program  100  for sound effect processing. For example, the SFX APO can obtain audio data tagged as “game chat” (e.g., player vocal shown in Table 1) for sound effect processing. Before sound effect processing, the SFX APO can copy the audio data tagged as “game chat”, and the copied audio data is utilized as the audio data S REMOTE  corresponding to the first language. In other words, the audio engine  1022  can utilize the APO to acquire the required sound types of audio data from the audio streams. In more detail, the audio engine  1022  merely acquires the required sound types of audio data from the audio streams without further processing the acquired audio data. 
     
       
         
           
               
               
               
               
               
               
             
               
                 TABLE 1 
               
               
                   
               
             
            
               
                 Sound 
                 Background 
                 Partial 
                 NPC 
                 Game 
                 Player  
               
               
                 data in 
                 Music 
                 sound 
                 Sound 
                 environment 
                 vocal (for 
               
               
                 game 
                 (BGM) 
                 effect 
                   
                 sound 
                 communi- 
               
               
                   
                   
                 (Punch 
                   
                   
                 cation, live 
               
               
                   
                   
                 sound, 
                   
                   
                 broadcast) 
               
               
                   
                   
                 collision 
                   
                   
                   
               
               
                   
                   
                 sound . . .  
                   
                   
                   
               
               
                   
                   
                 etc.) 
                   
                   
                   
               
               
                 Audio 
                 In Game 
                 Game 
                 Game 
                 Game Effect 
                 Game  
               
               
                 Stream 
                 Music 
                 Effect 
                 Effect 
                   
                 Chat 
               
               
                 Category 
                   
                   
                   
                   
                   
               
               
                 Of 
                   
                   
                   
                   
                   
               
               
                 Windows 
                   
                   
                   
                   
                   
               
               
                 10 
                   
                   
                   
                   
                   
               
               
                 operating 
                   
                   
                   
                   
                   
               
               
                 system 
               
               
                   
               
            
           
         
       
     
     Moreover, the audio engine  1022  transmits the audio data S REMOTE  corresponding to the first language to the relay processing module  104  and the driver  108 . The relay processing module  104  transmits the audio data S REMOTE  corresponding to the first language to the smart interpreter engine  106 . The smart interpreter engine  106  converts the audio data S REMOTE  corresponding to the first language into text data TXT REMOTE  corresponding to a second language and provides the text data TXT REMOTE  corresponding to the second language to the delay processing module  104 . After that, the delay processing module  104  provides the text data TXT REMOTE  corresponding to the second language to the display  40 . The display  40  displays the text data TXT REMOTE  corresponding to the second language for the user. Further, since the audio data S REMOTE  corresponding to the first language is a digital signal, the driver  108  converts the audio data S REMOTE  corresponding to the first language into an analog speech signal S REMOTE′  corresponding to the first language. The analog speech signal S REMOTE′  corresponding to the first language is an analog signal. For example, the driver  108  includes a digital to analog converter (not shown in figures). The digital to analog converter can convert the audio data S REMOTE  corresponding to the first language into an analog speech signal S REMOTE′  corresponding to the first language. The driver  108  transmits the analog speech signal S REMOTE′  corresponding to the first language to the audio output device  20 . The audio output device  20  playbacks the analog speech signal S REMOTE′  corresponding to the first language to generate sound to the user. In addition, the smart interpreter engine  106  converts the text data TXT REMOTE  corresponding to the second language into audio data corresponding to the second language and provides the audio data corresponding to the second language to the delay processing module  104 . After that, the delay processing module  104  provides the audio data corresponding to the second language to the audio processing module  102 . The audio processing module  102  transmits the audio data corresponding to the second language to the driver  108 . The driver  108  converts the audio data corresponding to the second language into an analog speech signal corresponding to the second language. The driver  108  transmits the analog speech signal corresponding to the second language to the audio output device  20 . The audio output device  20  can also playback the analog speech signal corresponding to the second language to generate sound to the user. 
     For example, if the first language is English and the second language is Chinese. After acquiring the audio data S REMOTE  in English, the audio processing module  102  provides the audio data S REMOTE  in English to the smart interpreter engine  106  through the delay processing module  104 . The smart interpreter engine  106  converts the audio data S REMOTE  in English into text data TXT REMOTE  in Chinese, such that the display  40  displays the text data TXT REMOTE  in Chinese. Meanwhile, the driver  108  converts the audio data S REMOTE  in English into an analog speech signal S REMOTE′  in English and transmits the analog speech signal S REMOTE′  in English to the audio output device  20  for playback. Therefore, when a user familiar with the second language is using the electronic system  1 , the user can hear the analog speech signal S REMOTE′  corresponding to the first language played by the audio output device  20  and see the text data TXT REMOTE  corresponding to the second language displayed by the display  40 . Under such a situation, even the user does not understand the analog speech signal S REMOTE′  corresponding to the first language, the user can understand and perceive what the information conveyed by the audio data S REMOTE  corresponding to the first language while seeing the text data TXT REMOTE  corresponding to the second language displayed by the display  40 . 
     Please refer to  FIG. 4 .  FIG. 4  is a schematic diagram of the electronic system  1  operating in a second operation mode (capturing mode) according to a first exemplary embodiment of the invention. As shown in  FIG. 4 , the audio processing module  102  includes an audio engine  1022 . For example, the audio engine  1022  can be an APO. In the second operation mode (capturing mode), the audio input device  30  acquires speech sounds of the current environment to generate an analog speech signal S LO  corresponding to a first language. The audio input device  30  transmits the analog speech signal S LO  corresponding to the first language to the driver  108 . Since the analog speech signal S LO  corresponding to the first language is an analog signal, the driver  108  converts the analog speech signal S LO′  corresponding to the first language into audio data S LO′  corresponding to the first language. The audio data S LO′  corresponding to the first language is a digital signal. For example, the driver  108  includes an analog to digital converter (not shown in figures). The analog to digital converter can convert the analog speech signal S LO  corresponding to the first language into the audio data S LO′  corresponding to the first language. The driver  108  transmits the audio data S LO′  corresponding to the first language to the audio engine  1022 . The audio engine  1022  transmits the audio data S LO′  corresponding to the first language to the relay processing module  104 . The relay processing module  104  transmits the audio data S LO′  corresponding to the first language to the smart interpreter engine  106 . 
     The smart interpreter engine  106  converts the audio data S LO′  corresponding to the first language into audio data S LO_O  corresponding to a second language. In an embodiment, the smart interpreter engine  106  converts the audio data S LO′  corresponding to the first language into text data corresponding to the first language and further converts the text data corresponding to the first language into text data corresponding to the second language. Further, the smart interpreter engine  106  converts the text data corresponding to the second language into audio data S LO_O  corresponding to the second language. In an alternative embodiment, the smart interpreter engine  106  converts the audio data S LO′  corresponding to the first language into text data corresponding to the second language and further converts the text data corresponding to the second language into audio data S LO_O  corresponding to the second language. Moreover, the smart interpreter engine  106  transmits the audio data S LO_O  corresponding to the second language to the relay processing module  104 . The relay processing module  104  transmits the audio data S LO_O  corresponding to the second language to the audio engine  1022 . The audio engine  1022  provides the audio data S LO_O  corresponding to the second language to the application program  100 . The application program  100  provides the audio data S LO_O  corresponding to the second language to the external device. As a result, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system  1  when hearing the audio data S LO_O  corresponding to the second language outputted by the electronic system  1 . 
     In other words, when the electronic system  1  operates in a first operation mode (rendering mode), the audio processing module  102  transmits the audio data S REMOTE  corresponding to the first language, which is acquired from the audio streams, to the relay processing module  104 . When the electronic system  1  operates in a second operation mode (capturing mode), the audio processing module  102  transmits the audio data S LO′  corresponding to the first language, which is converted by the driver  108 , to the relay processing module  104 . Moreover, the relay processing module  104  receives and provides the audio data S LO_O  corresponding to the second language to the application program  100 . Since the relay processing module  104  is disposed in the host  10 , the audio data S REMOTE  corresponding to the first language and the audio data S LO′  converted by the driver and corresponding to the first language can be transmitted to the relay processing module  104  by the audio processing module  102 , without being transmitted through the driver  108 . In addition, during the first operation mode (rendering mode), the relay processing module  104  transmits the audio data S REMOTE  corresponding to the first language to the smart interpreter engine  106  and transmits the text data TXT REMOTE  corresponding to the second language to the display  40  for display. During the second operation mode (capturing mode), the relay processing module  104  transmits the audio data S LO′  corresponding to the first language to the smart interpreter engine  106  and transmits audio data S LO_O  to the audio processing module  102 . Therefore, the relay processing module  104  can coordinate and arrange the input and output of the smart interpreter engine  106  for realizing related data conversion process. 
     Please refer to  FIG. 5 .  FIG. 5  is a schematic diagram of the electronic system  1  operating in a first operation mode (rendering mode) according to a second exemplary embodiment of the invention. As shown in  FIG. 5 , the audio processing module  102  includes an audio engine  1022  and a virtual driver  1024 . For example, the audio engine  1022  can be an APO. In an embodiment, the audio engine  1022  can be a user mode component of an operating system. The virtual driver  1024  can be a kernel mode component of the operating system. The virtual driver  1024  can execute in the kernel mode. In the first operation mode (rendering mode), the audio engine  1022  can acquire at least one sound type of audio data from audio streams processed by the application program  100  for acting as audio data S REMOTE  corresponding to a first language. The audio engine  1022  can utilize the APO to acquire required sound types of audio data. The audio engine  1022  merely acquires the required sound types of audio data from the audio streams without further processing the acquired audio data. Moreover, the virtual driver  1024  can intercept the audio data S REMOTE , which is acquired by the audio engine  1022 , corresponding to the first language. Further, the virtual driver  1024  transmits the audio data S REMOTE  corresponding to the first language to the relay processing module  104  and the driver  108 . That is, the virtual driver  1024  can intercept the audio data S REMOTE  corresponding to the first language from the audio engine  1022  and transmits the intercepted audio data S REMOTE  remaining untouched or unchanged to the relay processing module  104  and the driver  108 . 
     The relay processing module  104  transmits the audio data S REMOTE  corresponding to the first language to the smart interpreter engine  106 . The smart interpreter engine  106  converts the audio data S REMOTE  corresponding to the first language into text data TXT REMOTE  corresponding to a second language and provides the text data TXT REMOTE  corresponding to the second language to the delay processing module  104 . Further, the delay processing module  104  provides the text data TXT REMOTE  corresponding to the second language to the display  40 . The display  40  displays the text data TXT REMOTE  corresponding to the second language for the user. In addition, since the audio data S REMOTE  corresponding to the first language is a digital signal, the driver  108  converts the audio data S REMOTE  corresponding to the first language into an analog speech signal S REMOTE′  corresponding to the first language. The analog speech signal S REMOTE′  corresponding to the first language is an analog signal. For example, the driver  108  includes a digital to analog converter (not shown in figures). The digital to analog converter can convert the audio data S REMOTE  corresponding to the first language into an analog speech signal S REMOTE′  corresponding to the first language. The driver  108  transmits the analog speech signal S REMOTE′  corresponding to the first language to the audio output device  20 . The audio output device  20  playbacks the analog speech signal S REMOTE′  corresponding to the first language to generate sound to the user. In other words, when a user familiar with the second language is using the electronic system  1 , the user can hear the analog speech signal S REMOTE′  corresponding to the first language played by the audio output device  20  and see the text data TXT REMOTE  corresponding to the second language displayed by the display  40 . Under such a situation, even the user does not understand the analog speech signal S REMOTE′  corresponding to the first language, the user can understand and perceive what the information conveyed by the audio data S REMOTE  corresponding to the first language while seeing the text data TXT REMOTE  corresponding to the second language displayed by the display  40 . 
     Please refer to  FIG. 6 .  FIG. 6  is a schematic diagram of the electronic system  1  operating in a second operation mode (capturing mode) according to a second exemplary embodiment of the invention. As shown in  FIG. 6 , the audio processing module  102  includes an audio engine  1022  and a virtual driver  1024 . For example, the audio engine  1022  can be an APO. In an embodiment, the audio engine  1022  can be a user mode component of an operating system. The virtual driver  1024  can be a kernel mode component of the operating system. The virtual driver  1024  can execute in the kernel mode. In the second operation mode (capturing mode), the audio input device  30  acquires speech sounds of the current environment to generate an analog speech signal S LO  corresponding to a first language. The audio input device  30  transmits the analog speech signal S LO  corresponding to the first language to the driver  108 . Since the analog speech signal S LO  corresponding to the first language is an analog signal, the driver  108  converts the analog speech signal S LO  corresponding to the first language into audio data S LO′  corresponding to the first language. The audio data S LO′  corresponding to the first language is a digital signal. For example, the driver  108  includes an analog to digital converter (not shown in figures). The analog to digital converter can convert the analog speech signal S LO  corresponding to the first language into the audio data S LO  corresponding to the first language. After that, the virtual driver  1024  can intercept the audio data S LO′  converted by the driver  108  and corresponding to the first language. The virtual driver  1024  transmits the audio data S LO′  remaining untouched or unchanged to the relay processing module  104 . For example, the user can develop and create a virtual driver  1024  on the platform of the operating system (e.g., Microsoft Windows 10 operating system) and the virtual driver  1024  may be set to work within a driver layer. The virtual driver  1024  utilizes a software to simulate a hardware (e.g., audio input device  30 ) for replacing the original software, such that when intercepting the audio data S LO′  corresponding to the first language, which is converted by the driver  108 , the virtual driver  1024  can transmit the audio data S LO′  remaining untouched to the relay processing module  104 . 
     The relay processing module  104  transmits the audio data S LO′  corresponding to the first language to the smart interpreter engine  106 . The smart interpreter engine  106  converts the audio data S LO′  corresponding to the first language into audio data S LO_O  corresponding to a second language. The smart interpreter engine  106  transmits the audio data S LO_O  corresponding to the second language to the relay processing module  104 . The relay processing module  104  transmits the audio data S LO_O  corresponding to the second language to the virtual driver  1024 . The virtual driver  1024  transmits the audio data S LO_O  (remaining untouched or unchanged) corresponding to the second language to the audio engine  1022 . The audio engine  1022  provides the audio data S LO_O  corresponding to the second language to the application program  100 . The application program  100  provides the audio data S LO_O  corresponding to the second language to the external device. As a result, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system  1  when hearing the audio data S LO_O  corresponding to the second language outputted by the electronic system  1 . 
     Please refer to  FIG. 7 .  FIG. 7  is a schematic diagram of the smart interpreter engine  106  shown in  FIG. 1  according to an exemplary embodiment of the invention. The smart interpreter engine  106  includes a noise suppression module  1060 , a vocal identification module  1062 , a speech to text converter  1064 , a natural language processing (NLP) module  1066 , a translator  1068 , a text to speech converter  1070  and a text database  1072 . When the electronic system  1  operates in the first operation mode (capturing mode), the audio processing module  102  transmits the audio data S REMOTE  corresponding to the first language to the relay processing module  104 . The relay processing module  104  transmits the audio data S REMOTE  corresponding to the first language to the smart interpreter engine  106 . The noise suppression module  1060  performs a noise suppression process on the audio data S REMOTE  corresponding to the first language for reducing noise component in the audio data. The vocal identification module  1062  performs a vocal identification process on the noise-suppressed audio data S REMOTE  corresponding to the first language to generate vocal identification data corresponding to the first language. The vocal identification data is vocal data in the noise-suppressed audio data S REMOTE , which is determined as a human voice by the vocal identification module  1062 . In addition, if there is no noise suppression requirement, the smart interpreter engine  106  can directly transmit the noise-suppressed audio data S REMOTE  to the vocal identification module  1062  for vocal identification processing. The speech to text converter  1064  converts the vocal identification data corresponding to the first language into text data corresponding to the first language. The text data corresponding to the first language may include at least one word. 
     The NLP module  1066  can convert the text data corresponding to the first language into glossary text data corresponding to the first language. For example, the NLP module  1066  converts the text data corresponding to the first language into glossary text data corresponding to the first language according to the application program  100  being executed in the host  10 . The host  10  can inform the smart interpreter engine  106  of information of the application program  100  being executed in the host  10 . Besides, the smart interpreter engine  106  can ask the host  10  which application program  100  is executing by the host  10 . For example, the NLP module  1066  queries the text database  1072  according to the application program  100  being executed in the host  10  and the text data corresponding to the first language converted by the speech to text converter  1064 . The text database  1072  includes a plurality of text samples corresponding to the first language and a plurality of application programs, and a plurality of glossary texts corresponding to the text samples. For example, a first text sample corresponding to the first language and a first application program has corresponding glossary text corresponding to the first language. A second text sample corresponding to the first language and a second application program has corresponding glossary text corresponding to the first language and so on. Each text sample includes at least one word. Each glossary text includes at least one word. As such, the NLP module  1066  can compare the application program  100  being executed in the host  10  and the text data corresponding to the first language with the text samples of the text database  1072 , so as to find out the match results and accordingly determine the corresponding glossary text. 
     When a word of the text data corresponding to the first language matches a first text sample of the plurality of text samples of the text database  1072  and the application program  100  being executed in the host  10  matches an application program corresponding to the first text sample, the NLP module  1066  converts the word of the text data corresponding to the first language into the glossary text corresponding to the first text sample. When a plurality of words of the text data corresponding to the first language matches a first text sample of the plurality of text samples of the text database  1072  and the application program  100  being executed in the host  10  matches an application program corresponding to the first text sample, the NLP module  1066  converts the plurality of words of the text data corresponding to the first language into the glossary text corresponding to the first text sample. Moreover, the translator  1068  converts the glossary text data corresponding to the first language into text data TXT REMOTE  corresponding to a second language. As a result the text data TXT REMOTE  corresponding to a second language can be provided to the display  40  for display to the user. 
     For example, please refer to Table 2. Table 2 illustrates an exemplary embodiment of the text database  1062 . Suppose the first language is English and the second language is Chinese. The first application program is League of Legends game software. The second application program is Minecraft game software. The third application program is SimCity game software. The fourth application program is general application program. For example, in this embodiment, the fourth application program can be any application program except the fifth application program. The glossary text corresponding to the fourth application program may be a daily life expression, rather than a glossary text dedicated to a component, a prop or a role in a specific game software. The fifth application program is PUBG (PLAYER UNKNOWN&#39;S BATTLE GROUNDS) game software. If an English word in the text data is “flash” and the application program  100  being executed in the host  10  is the first application program, the NLP module  1066  converts the English word “flash” into a glossary text “flash” of English corresponding to the first application program. The translator  1068  converts the glossary text “flash” of English into Chinese words “ ” (Chinese characters). If an English word in the text data is “flash” and the application program  100  being executed in the host  10  is the second application program, the NLP module  1066  converts the English word “flash” into a glossary text “accelerator” of English corresponding to the second application program. The translator  1068  converts the glossary text “accelerator” of English into Chinese words “ ” (Chinese characters). In other words, each application program may apply different glossary texts (i.e. different glossary texts for different application programs). The user can choose different text database (also called language pack) for the smart interpreter engine  106 . The smart interpreter engine  106  can also detect the kind of application program being executed and accordingly switch to the corresponding text database for interpretation. If an English word in the text data is “feeder” and the application program  100  being executed in the host  10  is the first application program, the NLP module  1066  converts the English word “feeder” into a glossary text “fertilizer” of English corresponding to the first application program. The translator  1068  converts the glossary text “fertilizer” of English into Chinese words “ ” (Chinese characters). If an English word in the text data is “feeder” and the application program  100  being executed in the host  10  is the third application program, the NLP module  1066  converts the English feeder “flash” into a glossary text “feeder” of English corresponding to the third application program. The translator  1068  converts the glossary text “feeder” of English into Chinese words “ ” (Chinese characters)and the like. 
     
       
         
           
               
               
               
               
               
             
               
                 TABLE 2 
               
               
                   
               
               
                   
                   
                   
                   
                 text 
               
               
                 text data 
                   
                 glossary 
                 meanings of 
                 corresponding 
               
               
                 cor- 
                   
                 text 
                 glossary text 
                 to second 
               
               
                 responding 
                   
                 corresponding 
                 corresponding 
                 language 
               
               
                 to first 
                 application 
                 to first 
                 to first 
                 after 
               
               
                 language 
                 program 
                 language 
                 language 
                 translated 
               
               
                   
               
             
            
               
                 Flash 
                 first 
                 Flash 
                 a skill from 
                 
                   
                 
               
               
                   
                 application 
                   
                 Summoner 
                 (“shan 
               
               
                   
                 program 
                   
                 that quick 
                 hsien” in 
               
               
                   
                   
                   
                 moves from  
                 Romanized 
               
               
                   
                   
                   
                 A place to B 
                 form) 
               
               
                   
                   
                   
                 place 
                   
               
               
                   
                 second 
                 Accelerator 
                 an 
                 
                   
                 
               
               
                   
                 application 
                   
                 accelerator 
                 (“chia su 
               
               
                   
                 program 
                   
                 for 
                 chi” in 
               
               
                   
                   
                   
                 character 
                 Romanized 
               
               
                   
                   
                   
                 motion 
                 form) 
               
               
                 Feeder 
                 first 
                 Fertilizer 
                 the player 
                 
                   
                 
               
               
                   
                 application 
                   
                 control a NPC 
                 (“fei liao” 
               
               
                   
                 program 
                   
                 always play 
                 in  
               
               
                   
                   
                   
                 quick dead 
                 Romanized 
               
               
                   
                   
                   
                   
                 form) 
               
               
                   
                 third 
                 Feeder 
                 the man in 
                 
                   
                 
               
               
                   
                 application 
                   
                 the farm  
                 (“wei yang 
               
               
                   
                 program 
                   
                 and job is 
                 che” in 
               
               
                   
                   
                   
                 feeding 
                 Romanized 
               
               
                   
                   
                   
                 livestock 
                 form) 
               
               
                 Chicken 
                 fourth 
                 Eat chicken 
                 cooked 
                 
                   
                 
               
               
                 Dinner 
                 application 
                   
                 chicken 
                 (“chih chi” 
               
               
                   
                 program 
                   
                 and be the 
                 in 
               
               
                   
                   
                   
                 dinner 
                 Romanized 
               
               
                   
                   
                   
                   
                 form) 
               
               
                   
                 fifth 
                 Win 
                 “WINER, 
                 
                   
                 
               
               
                   
                 application 
                   
                 WINER, 
                 (“sheng li” 
               
               
                   
                 program 
                   
                 CHICKEN 
                 in 
               
               
                   
                   
                   
                 DINNER” 
                 Romanized 
               
               
                   
                   
                   
                 means the  
                 form) 
               
               
                   
                   
                   
                 won side of  
                   
               
               
                   
                   
                   
                 the battle or 
                   
               
               
                   
                   
                   
                 play game 
               
               
                   
               
            
           
         
       
     
     Please refer to  FIG. 8 .  FIG. 8  is a schematic diagram of the electronic system  1  applied for an online game according to an exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in  FIG. 8 , the users UA, UB and UC are utilizing their electronic systems to implement the first application program (e.g., League of Legends game software) for playing League of Legends online game, respectively. For example, the user UB utilizes the electronic system  1  of the invention to implement the first application program. When playing the League of Legends online game, the user UA says “use flash” in English and the corresponding analog speech signal of English is generated and transmitted to the electronic system  1  utilized by the user UB through the network. The electronic system  1  utilized by the user UB converts the analog speech signal of English in to audio data S REMOTE  (digital data) of English. Since the host  10  is currently implementing the first application program, the smart interpreter engine  106  converts the audio data “flash” of English into Chinese words “ ” (Chinese characters) after querying the text database  1072 . Moreover, the smart interpreter engine  106  converts the audio data “use” of English into Chinese words “ ” (Chinese characters) after querying the text database  1072 . Therefore, as shown in  FIG. 8 , the user UB can hear the spoken words “use flash” in English played by the audio output device  20  based on the analog speech data S REMOTE′ . A display area  400 A of the display  40  shows the Chinese words “ ” in Chinese characters. A display area  400 B of the display  40  shows the Chinese words “   ” in Chinese characters. As a result, although the user UB does not understand English and does hear the analog speech data S REMOTE′  (i.e. the spoken words “use flash”) of English played by the audio output device  20 , the user UB can still understand and perceive what the information conveyed by the user UA while seeing the Chinese words “ ” in Chinese characters displayed on the display  40 . Therefore, the electronic system  1  can not only convert the speech data into text data, but also provide flexible glossary translation for different application situations, so as to meet player&#39;s demands and increase player immersion in the esports game. 
     Please refer to  FIG. 9 .  FIG. 9  is a schematic diagram of the electronic system  1  applied for an online game according to an alternative exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in  FIG. 9 , the users UA, UB and UC are utilizing their electronic systems to implement the second application program (e.g., Minecraft game software) for playing Minecraft online game, respectively. For example, the user UB utilizes the electronic system  1  of the invention to implement the second application program. When playing the Minecraft online game, the user UA says “use flash” in English and the corresponding analog speech signal of English is generated and transmitted to the electronic system  1  utilized by the user UB through the network. The electronic system  1  utilized by the user UB converts the analog speech signal of English in to audio data S REMOTE  (digital data) of English. Since the host  10  is currently implementing the second application program, the smart interpreter engine  106  converts the audio data “flash” of English into Chinese words “ ” (Chinese characters) after querying the text database  1072 . Moreover, the smart interpreter engine  106  converts the speech data “use” of English into Chinese words “ ” (Chinese characters) after querying the text database  1072 . Therefore, as shown in  FIG. 9 , the user UB can hear the spoken words “use flash” in English played by the audio output device  20  based on the analog speech data S REMOTE′ . A display area  400 C of the display  40  shows Chinese words “ ” in Chinese characters. A display area  400 D of the display  40  shows Chinese words “ ” in Chinese characters. As a result, although the user UB does not understand English and does hear the analog speech data S REMOTE′  (i.e. the spoken words “use flash”) of English played by the audio output device  20 , the user UB can still understand and perceive what the information conveyed by the user UA while seeing the Chinese words “ ” in Chinese characters displayed on the display  40 . 
     Please further refer to  FIGS. 4 and 6-7 . When the electronic system  1  operates in the second operation mode (capturing mode), the driver  108  converts the analog speech signal S LO  corresponding to the first language into audio data S LO′  corresponding to the first language and transmits the audio data S LO′  corresponding to the first language to the audio processing module  102 . The audio processing module  102  transmits the audio data S LO′  corresponding to the first language to the relay processing module  104 . After that, the relay processing module  104  transmits the audio data S LO′  corresponding to the first language to the smart interpreter engine  106 . Further, the noise suppression module  1060  performs a noise suppression process on the audio data S LO′  corresponding to the first language for reducing noise component in the audio data. The vocal identification module  1062  performs a vocal identification process on the noise-suppressed audio data S LO′  corresponding to the first language to generate vocal identification data corresponding to the first language. The speech to text converter  1064  converts the vocal identification data corresponding to the first language into text data corresponding to the first language. As mentioned above, The NLP module  1066  can convert the text data corresponding to the first language into glossary text data corresponding to the first language. The translator  1068  converts the glossary text data corresponding to the first language into text data corresponding to a second language. Moreover, the text to speech converter  1070  converts the text data corresponding to the second language into the audio data S LO_O  corresponding to the second language. After that, the smart interpreter engine  106  transmits the audio data S LO_O  corresponding to the second language to the relay processing module  104 . The relay processing module  104  transmits the audio data S LO_O  corresponding to the second language to the audio processing module  102 . The audio processing module  102  transmits the audio data S LO_O  corresponding to the second language to the application program  100 . The application program  100  provides the audio data S LO_O  corresponding to the second language to the external devices. Under such a situation, when a user familiar with the second language is using the external device, the user can understand and perceive the information conveyed by the user of the electronic system  1  after hearing the audio data S LO_O  corresponding to the second language outputted by the electronic system  1 . 
     Please refer to  FIG. 10 .  FIG. 10  is a schematic diagram of the electronic system  1  applied for an online game according to an alternative exemplary embodiment of the invention. The user UA can speak English, and can hear and understand English. The user UB can speak Chinese, and can hear and understand Chinese. The user UC can speak German, and can hear and understand German. As shown in  FIG. 10 , the users UA, UB and UC are utilizing their electronic systems to implement the first application program (e.g., League of Legends game software) for playing League of Legends online game, respectively. For example, the user UA utilizes the electronic system  1  of the invention to implement the first application program. When playing the League of Legends online game, the user UA says “use flash” in English and the corresponding analog speech signal of English is generated. The driver  108  of the electronic system  1  utilized by the user UA converts the analog speech signal of English into digital audio data of English. Since the host  10  is currently implementing the first application program, the smart interpreter engine  106  converts the audio data “use flash” of English into audio data “   ” (i.e. “shih yung shan hsien” in Romanized form) of Chinese and provides the converted audio data of Chinese to the user UB. As a result, the user UB can understand and perceive what the information conveyed by the user UA while hearing the speech data “ ” (i.e. “shih yung shan hsien” in Romanized form) of Chinese. 
     In summary, the embodiments of the invention provide the user utilizing the electronic system  1  to hear the analog speech data corresponding to the first language played by the audio output device  20  and see the text data displayed by the display  40 . Under such a situation, even the user does not understand the analog speech data corresponding to the first language, the user can understand and perceive what the information conveyed by the speech data corresponding to the first language while seeing the text data corresponding to the second language displayed by the display  40 . Besides, the embodiments of the invention can convert the analog speech data inputted by the user corresponding to the first language into audio data corresponding to a second language, so as to allow other user can understand what the user utilizing the electronic system  1  conveys. Moreover, the embodiments of the invention can acquire audio data in game and submit audio data to a smart interpreter engine for vocal identification and neural machine translation so as to facilitate the user to easy understand what the other user conveys. As such, the embodiments of the invention can bring good interaction between users using different languages and effectively improve the user experience. 
     Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.