Patent Publication Number: US-2002010590-A1

Title: Language independent voice communication system

Description:
BACKGROUND OF THE INVENTION  
       [0001] (a) Field of the Invention  
       [0002] The present invention relates to a language independent voice communication system and, in particular, to a language independent voice communication system enabling people using different languages to communicate each other in real time using an improved speech recognition and multi-language translation mechanism through wire or wireless communication networks.  
       [0003] (b) Description of the Related Art  
       [0004] Generally, many countries have developed speech recognition technologies, that recognizes their own native or official language as sentence base. The speech recognition technology has been adopted for operating electronic appliances such as computer, cellular phone, automatic door, etc. in accordance with voice commands.  
       [0005] Also, the speech recognition technology is used for language educational purpose in such a way that a computer terminal displays an input speech inputted through a microphone as phrases as pronounced and spelled.  
       [0006] In this speech recognition technology, the input speech is searched in a large quantity of frequently spoken samples that are previously recorded in a storage medium and sequentially displayed as corresponding phrases if there exists the corresponding phrases. On the other hand, if there exists no corresponding phrase, an error message is displayed.  
       [0007] However, since this technology is limitedly applied to only a few languages such as universal or native one, an implementation of an inter-language translation service using the speech recognition technology is difficult particularly in wire and wireless communication fields such as international calling service and computer network communication.  
       SUMMARY OF THE INVENTION  
       [0008] The present invention has been made in an effort to solve the above problems.  
       [0009] It is an object of the present invention to a language independent voice communication system enabling people using different languages to communicate each other in real time using an improved speech recognition and multi-language translation mechanism through wire or wireless communication networks.  
       [0010] To achieve the above abject, the language independent voice communication system of the present invention comprises, a translation unit for translating a one language input speech to one or more corresponding other language speeches. The translation unit comprises a speech recognizer for recognizing the input speech, at least one translation module electrically connected to the speech recognizer for translating the recognized first language input speech to the corresponding other language speech, and output means electrically connected to the translation modules for outputting the translated speeches. 
     
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
     [0011] The above and other objects and features of the instant invention will become apparent from the following description of preferred embodiments taken in conjunction with the accompanying drawings, in which:  
     [0012]FIG. 1 is a schematic view illustrating a language independent voice communication system in accordance with a preferred embodiment of the present invention;  
     [0013]FIG. 2 is a circuit diagram illustrating translation unit of the language independent voice communication system of FIG. 1;  
     [0014]FIG. 3 is a circuit diagram illustrating translation unit of the language independent voice communication system in accordance with another preferred embodiment of the present invention; and  
     [0015]FIG. 4 is a circuit diagram illustrating translation unit of the language independent voice communication system in accordance with still another preferred embodiment of the present invention. 
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS  
     [0016] Preferred embodiments of the present invention will be described hereinafter with reference to the accompanying drawings.  
     [0017] The language independent voice communication system of the present invention can recognize and translate one language into one or more languages and vice versa. However, to simplify the explanation, two different languages, i.e., English and Korean, are exemplary adopted for implementing the recognition and translation mechanism of the language independent voice communication system of the present invention. Referring to FIG. 1, the language independent voice communication system of the present invention comprises first and second language translation unit.  
     [0018] The first language translation unit recognizes a first language (Korean) input speech, phrases the recognized first language input speech, translates the first language phrase into a corresponding second language (English) phrase, and transmits the translated second language phrase in encoded signal.  
     [0019] The second language translation unit receives the encoded second language (English) phrase signal from the first language translation unit, decodes the second language signal into the second language phrase, and outputs the second language phrase in a corresponding second language speech.  
     [0020] Also, it is possible that the first translation unit  10  encodes the first language speech (Korean) into a first language speech signal and transmits the encoded first language speech signal such that the second translation unit  10  decodes the first language speech signal received from the first language translation unit, phrases the first language speech into a first language phrase, translates the first language phrase into the corresponding second language (English) phrase, and outputs the second language phrase in second language speech.  
     [0021] The first and second language translation unit have functions so as to recognize a plurality of language-based speeches, transmit and receive signals, translate one language phrase into corresponding other language phrase, vice versa, verbalize a plurality of language-based phrases.  
     [0022]FIG. 2 is a circuit diagram showing the translation unit of the language independent voice communication system according to a first preferred embodiment of the present invention.  
     [0023] Referring to FIG. 2, the translation unit comprises at least one microphone  101   a  ( 101   b ) for inputting a speech, at least one speaker  124   a  ( 124   b ) for outputting the speech, a second switch unit SW 2  for selecting the appropriate microphone  101   a  ( 101   b ) and speaker  124   a  ( 124   b ), an input and output amplifiers  111  and  123  connected to the first switch unit SW 2  for amplifying respective input and output signals, a speech recognizer  112  connected to the input amplifier  111 , the speech recognizer  112  for recognizing the input speech signal, the speech recognizer  112  having an analog/digital (A/D) converter, a translation module  113  connected to the speech recognizer  112  for interpreting a first language speech signal into a corresponding second language speech signal, a digital/analog (D/A) converter  114  connected to the translation module  113  for converting the digital second language speech signal into an analog second language signal, a modulator  115 , a first switch unit SW 1  for selecting one of an transmitting and receiving modes, a transmission amplifier  116  for amplifying transmission signal, a receiving amplifier  121  connected to the first switch unit SW 1  for amplifying a receiving signal, a demodulator  122  interposed between the output amplifier  123  and the receiving amplifier  121  for demodulating the received signal, and a diplexer  120  for transmitting signal through an antenna  130 .  
     [0024] The switch unit SW 2  is a headset jack such that the speech input and output are performed through an exterior microphone  101   b  and earphone  124   b  of the headset when the jack is connected into a receiving port (not shown) and through a built-in microphone  101   a  and speaker  124   a  when the jack is disconnected.  
     [0025] The translation module  113  comprises a first language reference database first language  113   b  for storing first language speech samples, a second language reference database  113   c  for storing second-language speech samples, and a translation controller  113   a  (e.g. preferred using microprocessor) for controlling translation of the first language speech into the second language speech.  
     [0026] The translation controller  113   a , sequentially, refers to the first language reference database  113   b  when receiving a first language speech signal from the speech recognizer  112 , phrases the first language speech if a same or similar speech sample exists in the first language reference database  113   b , refers to the second language reference database  113   c  for finding a corresponding second language phrase, translates the first language phrase into a corresponding second language phrase if the corresponding second language phrase exists in the second reference database  113   c , and produces a corresponding second language speech signal.  
     [0027] The first and second language reference databases  113   b  and  113   c  have the same structure and each reference database  113   b  ( 113   c ) has a mapping table (not shown) for mapping speech signal to corresponding phrase such that a speech signal is mapped to a phrase, vice versa. The translation controller  113   a  calculates a percentage of an identical proportion of between the input speech signal and the referred speech sample in the first and second language reference databases  113   b  and  113   c  so as to map the input speech signal to the corresponding reference speech sample if the identical percentage is equal to or greater than a predetermined threshold value. The input speech signal having the identical percentage equal to or greater than the predetermined threshold value is learned and stored in a previously assigned area of the reference database  113   b  ( 113   c ) together with the percentage value so as to accelerate translation by referring to speech sample in descending order of the percentage when the same input speech pattern is inputted next time.  
     [0028] Also, the translation controller  113   a  detects finally referred times of the speech samples in case when there is a plurality of corresponding speech sample in the reference database  113   b  ( 113   c ) so as to map the input speech signal to the lately referred speech sample among them.  
     [0029] The speech samples are grouped into at least one group in accordance with referred frequency such that the translation controller  113   a  refers to the reference database  113   b  ( 113   c ) from a frequently referred group, resulting in reducing a speech sample reference time.  
     [0030] The translation module  113  is a removable/attachable module implemented in a read only memory pack (ROM PACK) such that one or more translation modules, each having different language reference databases, can be attached to the translation unit  10  ( 20 ) or be changed each other.  
     [0031] In case when a plurality of translation modules  113  are attached to the translation unit  10  ( 20 ), the translation modules  113  are connected to the speech recognizer  112  in parallel and distinguishes input speech languages using language codes (for example, Korean=001, English=002, Chinese=003, Japanese=004, etc.) assigned to the different languages so as to enable one language speech to be translated into a plurality of different language speeches by detecting sequential language codes. That is, if the sequential code is “001002”, the input speech signal is Korean and output speech signal is English, and if the sequential code is “001003”, the input speech signal is Korean and the output speech signal is Chinese.  
     [0032] The operation of the language independent voice communication system according to the first preferred embodiment of the present invention will be described hereinafter.  
     [0033] Once the second switch unit SW 2  of the first translation unit  10  (see FIG. 1) is on for transmitting mode, a first language (Korean) input speech signal from the microphone  101   a  ( 101   b ) is amplified by the amplifier  111  and then the first language input speech signal digitalized by the speech recognizer  112 . Consequently, the digitalized first language input speech signal is sent to the translation module  113  such that the translation controller  113   a  temporally stores the first language input speech signal and looks up the first language reference database  113   b  for finding the same or similar speech sample therein. If the speech sample exists in the first language reference database  113   b , the translation controller  113  looks up the second language (English) reference database  113   c  for finding a corresponding second language speech sample. If the corresponding second language speech sample exists in the second language reference database  113   c , the translation controller  113   a  sends the corresponding second language speech sample to the D/A converter  114 . The second language speech sample is converted into an analog second language speech signal and then modulated for wireless propagation in the modulator  115 . The modulated second language speech signal is transmitted to the second translation unit  20  (see FIG. 1) through the first switch unit SW 1 , the amplifier  116 , the diplexer, and the antenna  130 . The second language speech signal received through the antenna  130  of the second translation unit  20  is sent to the demodulator  122  via the diplexer  120 , the first switch unit SW 1 , and the amplifier  121  such that the second language speech signal is demodulated and outputted through the speak  124   a  ( 124   b ) as the second language speech. In the receiving mode, terminals f and d of the first switch unit SW 1  are connected.  
     [0034] Also, when the second language speech is inputted through the microphone  101   a  ( 101   b ) a translation unit, the corresponding first language speech is outputted through the speaker  124   a  ( 124   b ) of the counterpart translation unit through the above-explained processes.  
     [0035] The translation controller  113   a , sequentially, refers to the first language reference database  113   b  when receiving a first language speech signal from the speech recognizer  112 , phrases the first language speech if a same or similar speech sample exists in the first language reference database  113   b , refers to the second language reference database  113   c  for finding a corresponding second language phrase, translates the first language phrase into a corresponding second language phrase if the corresponding second language phrase exists in the second reference database  113   c , and produces a corresponding second language speech signal.  
     [0036] The first and second language reference databases  113   b  and  113   c  have the same structure and each reference database  113   b  ( 113   c ) has a mapping table (not shown) for mapping speech signal to corresponding phrase such that a speech signal is mapped to a phrase, vice versa.  
     [0037] The translation controller  113   a  calculates a percentage of an identical proportion between the input speech signal and the referred speech sample in the first and second language reference databases  113   b  and  113   c  so as to map the input speech signal to the corresponding reference speech sample if the identical percentage is equal to or greater than a predetermined threshold value of 80%. The input speech signal having the identical percentage equal to or greater than 80% is learned and stored in a previously assigned area of the reference database  113   b  ( 113   c ) together with the percentage value so as to accelerate translation by referring to speech sample in descending order of the percentage when the same input speech pattern is inputted next time.  
     [0038] Also, the translation controller  113   a  detects finally referred times of the speech samples in case when there exists a plurality of corresponding speech sample having 100% of identical percentage in the reference database  113   b  ( 113   c ) so as to map the input speech signal to the lately referred speech sample among them.  
     [0039] The speech samples are grouped into at least one group in accordance with referred frequency such that the translation controller  113   a  refers to the reference database  113   b  ( 113   c ) from a frequently referred group having the highest reference priority, resulting in reducing a speech sample reference time.  
     [0040] The translation module  113  is a removable/attachable module implemented in a read only memory pack (ROM PACK) such that one or more translation modules, each having different language reference databases, can be attached to the translation unit  10  ( 20 ) or be changed each other. Also, the language databases can be modularized as the ROM PACK such that a plurality of languages can be translated.  
     [0041] A second preferred embodiment of the present invention will be described hereinafter with reference to the accompanying FIG. 3.  
     [0042] In the second preferred embodiment of the present invention, the language independent voice communication system is implemented in a telephone network.  
     [0043]FIG. 3 is a circuit diagram illustrating the translation unit implemented in a telephone set.  
     [0044] The translation unit  10  ( 20 ) is interposed between a main body  331  and a handset (or headset)  332  of the telephone set so as to translate a first language input speech signal from the handset  332  into a second language output speech signal and output the translated second language speech signal to the main body  331 . Also, the translation unit  10  ( 20 ) translates a second language input speech signal from the main body  331  via a telephone network into a second language speech signal and send output the translated first language speech signal to the handset  332 .  
     [0045] The translation unit  10  ( 20 ) comprises a first and second speech recognizers  312  and  324  having respective A/D converters, a first language translation module  313  connected to the first speech recognizer  312  for translating the first language speech signal into the second language speech signal, and a second language translation module  323  connected to the second language speech recognizer  324  for translating the second language speech signal into the first language speech signal.  
     [0046] The translation module  313  ( 323 ) comprises a first language reference database  313   b  ( 323   b ) for storing first language speech samples, a second language reference database  313   c  for storing second language speech samples, and a translation controller  313   a  ( 323   a ) for controlling translation of the first language speech into the second language speech.  
     [0047] The translation controller  313   a  ( 323   a ), sequentially, refers to the first language reference database  313   b  ( 323   b ) when receiving a first language speech signal from the speech recognizer  312  ( 324 , phrases the first language speech if a same or similar speech sample exists in the first language reference database  313   b  ( 323   b ), refers to the second language reference database  313   c  ( 323   c ) for finding a corresponding second language phrase, translates the first language phrase into a corresponding second language phrase if the corresponding second language phrase exists in the second reference database  113   c , and produces a corresponding second language speech signal.  
     [0048] In this embodiment, since the two translation modules  313  and  323  are attached in parallel, it is possible to provide a translation and language education functions by connecting the handset of the telephone set to the input part of the translation unit and connecting the output part of the translation unit to a handset connection port. Also, the translation unit can be selectively set as a bypass mode just for bypassing, translation mode, and tele-translation mode using a 3-way switch  330   b.    
     [0049] Also, the translation unit can provide translation function between the mobile phones or between the mobile and wired phones by connecting a headset of the mobile phone to the input part of the translation unit and connecting the output part of the translation unit to the headset port of the mobile phone. In this case, the mobile phone can be used as a portable language-training device.  
     [0050] Furthermore, the translation unit can be provided as an internet phone service connection by connecting a microphone and speaker jack of a personal computer (PC) having internet phone function to the output part of the translation unit and connecting the input part of the translation unit to a microphone and speaker ports of the PC.  
     [0051] A third preferred embodiment of the present invention will be described hereinafter with reference to the accompanying FIG. 4.  
     [0052]FIG. 4 is a circuit diagram illustrating the language independent voice communication system implemented in a mobile communication network. Referring to FIG. 4, the language independent voice communication system comprises wire/wireless translation unit. The wire/wireless translation unit connected to a telephone set  430   c  via physical lines and wirelessly communicates with a base station such that the wire/wireless translation unit translates a first (second) language input speech signal from the telephone set  430   c  into a second (first) language output speech signal so as to transmit the translated output speech signal through a physical or/and wireless channels, vice versa.  
     [0053] The wire/wireless translation unit comprises at least one translation module that translates at least one language speech signal into at least one corresponding other language speech signal.  
     [0054] The wire/wireless translation unit comprises wire communication supporting unit interposed between a telephone set  430   c  and the translation module  314   a  and wireless communication supporting unit  420   b  interposed between the translation module  413   a  and an antenna.  
     [0055] The wire communication supporting means is provided with a first amplifier  411 , a speech recognizer  412  including an A/D converter, a second amplifier  421 , and a D/A converter  422  so as to support speech signal communication between the telephone set  430   c  and the translation module  314   a.    
     [0056] The wireless communication supporting means  420   a  is provided with a pair of A/D and D/A converters, a pair of modulator and demodulators, a pair of input and output amplifiers so as to support wireless speech signal communication between the translation module  413   a  and other mobile stations  420   b  and  420   c . The mobile station can be a cellular phone or Trunked Radio System (TRS) phone.  
     [0057] The telephone set  430   c  can be bridged with other telephone sets  430   a  and  430   c  so as to receive the speech signal from the translation module  413   a.    
     [0058] Also, the wireless communication supporting means  420   a  can be bridged with other mobile stations  420   c  and  420   c  having the same manufactured serial number in cellular communication or having same channel in TRS communication so as to receive the same speech signal from the translation module  413   a  via the base station.  
     [0059] The translation module  413   a  has at least two language reference databases, each being provided with mapping tables for mapping one language speech signal  413   b  ( 413   c ) to other language speech signal  413   e  ( 413   d ).  
     [0060] In this embodiment of the present invention, the translation function can be provided between two mobile stations that have the same manufactured serial number (it is possible only when the mobile communication company provides same identification code to the two mobile station).  
     [0061] That is, one of the two mobile stations  420   a  and  420   b  becomes a transmitter and the other a receiver such that a first language speech from the transmitter is outputted as a corresponding second language speech at the no receiver. In order to expect this mobile communication translation, the translation unit provides an integrated first (Korean) and second (English) language input modules connected in parallel and an integrated first and second language output modules connected in parallel.  
     [0062] To translate one language speech into another, a specific code is assigned to each language, for example, Korean=001, English=002, Chinese=003, Japanese=004, French=005, etc. such that a translation language pair can be selected by sequentially entering two language codes. Exemplary, an English-to-Korean translation is required, the translation unit is set by entering sequential code of “002001.” 
     [0063] Also, the translation unit implemented in a cellular phone can provide translation function by connecting a jack integrated, in parallel, with two pair of headsets to a jack port of the cellular phone. In this case, the microphones and earphones of the two pair headsets should be balanced in impedance by increasing the impedances of the microphones and earphones twice.  
     [0064] The translation unit can be applied to a computer network in order to provide an online translation service in such a manner that if a server equipped with the translation unit together with a plurality of different language reference samples receives a speech signal from a client computer translates the received speech signal into a required language speech signal and returns the translated speech signal to the client such that the client computer output the translated speech through a speaker installed therein. In this manner, the translation unit can be used for the purpose of commercial translation or online dictionary service.  
     [0065] As described above, the language independent voice communication system of the present invention uses the speech recognition technologies developed in various countries for their domestic purposes by modularizing each speech recognition technology such that there is no need to develop other speech recognizer engine, resulting in reduction of development time consumption.  
     [0066] Also, since the language independent voice communication system of the present invention uses a plurality of different language translation modules connected in parallel, one language can be translated into several other languages at the same time independent to the input language.  
     [0067] Furthermore, by utilizing the translation unit of the present invention in the wire and/or wireless communication networks, the language independent voice communication system can be applied to various fields such as the language independent conference, online translation and dictionary services, etc.  
     [0068] Although the preferred embodiments of the invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.