Abstract:
The present invention discloses the system design, module requirements, specifications and methods that comprise the core technology required to enable the development of a viable Multi-Lingual Auto-Translation Telephony System. During a conversation utilizing said Multi-Lingual Auto-Translation Telephony System, each participant speaks only one language for the duration of the conversation, and there is no limit on the number of participants that may participate in said conversation, provided said number of participants is two or greater, nor is there any limit on the number of different languages that may be employed by said different participants during said conversation.

Description:
[0001]    This application claims priority from provisional application Ser. No. 60/986,601, filed on Nov. 9, 2007. 
     
    
     BACKGROUND OF THE INVENTION  
       [0002]    1. Field of the Invention 
         [0003]    The system employs the following technologies: Telephony, Internet, Statistical Speaker Independent and Background Noise tolerant Voice Recognition (SVR), Statistical Machine Translation (SMT), and Language and Country Location Specific Voice Synthesis (VS). 
         [0004]    2. Description of Prior Art 
         [0005]    With advances in Speech Recognition, Statistical Machine Translation, and Voice Synthesis, automated Multi-Lingual Voice-to-Voice translation has become a reality. The accuracy of Statistical Machine Translation is greatly enhanced when all of the material to be translated relates to a specific pre-defined subject area or topic (e.g., Military, Finance, Business, etc.), known as a “Domain”. The basic idea is that while words and phrases may have several different meanings, when using a Domain, a situation where “everybody” is talking about precisely the same subject, the probability that the intended meaning of the specific words and phrases used, as they relate to the specific topic or domain, naturally become significantly more specific and narrowly defined. Thus the resulting translation will more precisely reflect what the speaker actually intends to convey and translation accuracy is significantly increased. An example of Voice-to-Voice translation utilizing Statistical Machine Translation and a Subject Specific Domain is IBM&#39;s MASTOR PC based Voice-to-Voice translation system with a Subject Specific Domain relating to “The War in Iraq”. The MASTOR PC system is currently being used on laptop PCs by U.S. Armed Forces deployed in Iraq in 2006. It is being used to interactively communicate with Arabic speaking Iraqis. The MASTOR PC system is reported to achieve highly accurate interactive translation results. 
         [0006]    Given the above mentioned advances in Multi-Lingual Voice-to-Voice translation, it would therefore be most advantageous for a system and methods to be developed that would extend this capability to the existing infrastructure in the world of telephony, including, wire-line, mobile, Internet based VOIP, or any combination thereof. 
       SUMMARY OF THE INVENTION  
       [0007]    The present invention utilizes Voice-to-Voice translation technology, detailed in the Description of Prior Art Section (above) together with a Network Telephony Server Conference Call Bridge or an Internet VOIP Conference Bridge to enable Voice-to-Voice Multi-Lingual Auto-Translated telephone calls. Designing a viable Multi-Lingual Telephony system entails the solution of problems that are both practical as well as technical. 
         [0008]    First, there is the question of how can people both talk and concurrently hear translations of what other people said, while connected to a Telephony Network Server or a VOIP software Conference Bridge. In a Multi-Lingual Auto-Translated telephone conversation in which the participants are speaking a maximum of two languages, there should be no inherent problem with multiple speakers and multiple voice translations to be heard by all conversation participants on a conference bridge, as long as all participants talk “In-Turn”. 
         [0009]    For example, a speaker would first talk in his own language, and all other participants on the Conference Bridge would hear the speaker as he or she talks. This speaker would then signal to the system that a translation of his/her words should be initiated. The speakers dialogue would then be translated into the second language and then vocalized via voice synthesis in the second language, so that all telephone call participants on the bridge would then hear the voice synthesized translation of the speakers&#39; words in the second language, regardless of whether each participant understands the second language or not. 
         [0010]    A flaw in this approach becomes apparent when using a conference bridge for conversations in which three or more languages are spoken by the conversation participants. The problem is not one of talking “in turn” nor is the problem that the talker is speaking original dialogue on the conference bridge and the other participants hear the original speech of a talker while he/she is speaking in a language that other conversation participants may not understand. In fact, hearing a conversation participant talk in their own language is actually positive in that all conversation participates regardless if they understand the speaker&#39;s language or not, will be able to distinguish the mood and tone of the speaker&#39;s voice. 
         [0011]    Rather, in a conversation in which three or more languages spoken, for all conversation participants to hear voice multiple synthesized translations of each speaker “while he/she is on the bridge” would make each conversation participant&#39;s experience far too lengthy, burdensome, and untenable (i.e., for each conversation participant would have to listen to at least two voice synthesized translations in languages that they probably do not understand). 
         [0012]    Utilizing the method detailed hereunder, when a speaker signals to the system that a translation of his/her words should be initiated, each conversation participant would then be taken “off the conference bridge”, and while “off the conference bridge” each said respective conversation participation would then hear the respective voice synthesized translation of the previous speakers words, in each participant&#39;s own respective language. After each conversation participant hears a voice synthesized translation of the previous speakers words, while “off the conference bridge”, each conversation participant is then brought back “on the conference bridge”, and the conversation continues. In this manner, each conversation participant hears only one voice synthesized translation, each in his/her own respective language, and the process is far more concise and user-friendly. 
         [0013]    Next, there is the practical issue of “who talks when”, which in a multi-lingual telephone conversation is an important issue which must be resolved in an easily comprehensible and user friendly manner. 
         [0014]    The present invention utilizes DSP (Digital Signal Processing) to monitor each conference call participant&#39;s use of the telephone keypad (or alternatively the use of standard voice commands) to effect a coherent and well orchestrated conversation. 
         [0015]    The initiator of the telephone call (i.e., the subscriber who pays for the call) will usually make his opening remarks or welcoming statement. In order to signal that he/she has finished talking and wants the dialogue to be translated to each respective conversation participant, the speaker will hit (press) a particular key on the telephone key pad (i.e., the pound “#” key). Once the pound key is hit, the system will take all respective telephone call participants “Off the Bridge” in order to hear the voice synthesized translation of what the previous speaker said in his/her own respective native language. After each call participant finishes hearing the verbalized translation of what the previous speaker said, the system will then automatically bring all telephone call participants back “On the Bridge”. 
         [0016]    It should be noted that the telephone number of each participant, as well each participants native language (or language of choice) as well as their gender (in order to determine the gender to be used for Voice Synthesis vocalized translation to be heard by other participants while they are “Off the Bridge), are all easily specified by the subscriber in the subscriber&#39;s “Address Book”, located in a subscriber&#39;s own “Internet Subscriber&#39;s Interface Module” described in below “Detailed Description of the Invention” section). 
         [0017]    There are several possible scenarios regarding the issue of “Who Talks Next”. Said scenarios are described in below in the “Detailed Description of the Invention” section. The scenario is chosen by the subscriber who will indicate said chosen scenario option in their own “Internet Subscriber&#39;s Interface Module”. In one such scenario, when participants are “On the Bridge” they can hit a particular key on the telephone key pad (i.e., the star “*” key), in order to inform the subscriber (who pays for the call that they would like a turn to talk). The subscriber then chooses who will talk next by hitting a particular key on the telephone key pad, and then saying the name of the participant that the subscriber wants to talk next. At this point, all participants are then brought “Off the Bridge”, and informed in their own respective language the name of the participant who will talk next, after said notification, all participants are brought back “On the Bridge”, and control for talking will be automatically initiated for the chosen participant. 
         [0018]    Utilizing the method disclosed in USPTO Patent Application 20080177528 (Serial No. 008082, Series Code: 12), Filed: Jan. 8, 2008 “Method of enabling any-directional translation of selected languages”, the system will be enabled with the capability to effect conversations with participants who use &gt;2 (any number of different) languages thereby enabling each telephone call participant to both talk with any and all other participants in their own native language, as well as to hear vocalized translated responses of any and all of the other conversation participants in their own language. 
         [0019]    The above, as well as other functionality, required to manage and orchestrate a Multi-Lingual Auto-Translated telephone conversation is performed by the “Command &amp; Control Module”, which is described in detail below in the “Detailed Description of the Invention” section. 
         [0020]    It should be noted that procedure for a participant to enter an “Auto-Translated Multi-Lingual” conference call is similar to that of entering a regular conference call, with just a few differences. The participant will dial a specified conference bridge telephone number, and will be asked for a conference code, which conference code was automatically e-mailed to the participant when the subscriber, using their own “Internet Subscriber&#39;s Interface Module” scheduled the call. 
         [0021]    Unlike regular single language conference calls, the participant entering the conference bridge will also be requested to say his/her name, which will be recorded for the purpose of announcing his/her arrival to the other conference call participants. Also, each participant entering the conference call will then have to wait for an “Interrupt” before they will be automatically brought “On the Bridge”, and his/her arrival announced to all other participants. An “Interrupt” is a point in time when “no one is talking”. That is; a point in time after which participants are brought back “On the Bridge”, after hearing translations of the previous speaker in their own respective languages. 
         [0022]    The accuracy of a statistical translation engine corresponds to the amount of “Original Language Text” which is translated by professional human translators into one or more respective other languages, on a sentence by sentence basis. These Original Language documents and respective professional human translations thereof are input to a “Statistical Language Construction Engine”, which through the implementation of probability theory will then construct “Statistical Language Pairs”. The same process is used to construct “Context Specific Domains”. 
         [0023]    As such, the system disclosed herein, is designed to continually improve the accuracy and relevance of the systems translation capability by employing a very simple methodology that is inherent in the system. As part of the legal contract to which every potential subscriber must agree to (i.e., click “I Agree”) during the registration process for new subscribers, the contract, available to the user, will specify that the company providing the system may anonymously copy “Original Speaker Text” (not translations) from the conversations initiated by the subscriber. This statistically valid percentage of this “Original Speaker Text” is submitted, on a sentence-by-sentence basis, to professional human translators for translation into other respective languages. These Original Language sentences and the corresponding respective “other-language” professional human translations thereof are input to a “Statistical Language Construction Engine”, which through the implementation of probability theory will thereby continually update and improve the accuracy and relevance “Statistical Language Pairs”, as well as that of the respective “Context Specific Domains”. 
         [0024]    As an additional service to the subscriber, all Original Speaker Text, of each “Auto-Translate Telephone Call” conversation participant, as well as the respective textual translations thereof are generated and stored by the Command and Control module (see: below) as conversation transcripts. Said transcripts of each conversation made by the subscriber are thus automatically stored for subsequent viewing by the subscriber. The subscriber can subsequently view said conversation transcripts via the subscriber&#39;s own “Internet Subscriber&#39;s Interface Module”. 
         [0025]    For each “Auto-Translate Telephone Call” conversation, statistics will be automatically calculated based on said conversation transcripts detailing the “Translation Work Performed” for each of the subscriber&#39;s conversations. Said statistics will be made available to the subscriber for viewing through said subscriber&#39;s own “Internet Subscriber&#39;s Interface Module”. 
         [0026]    Said statistics of “Translation Work Performed” for each of the subscribers conversations, will also be used to generate CDR a (Call Data Record) for the purpose of customer billing for “Translation Work Performed” for each subscriber-initiated conversation, in addition to connect time and number of participants. 
         [0027]    Finally, the system will have the capability to be configured using a variety of “Calling Modes”. Calling Modes dramatically increases the flexibility of how the system can be used, specifically when, how and where the benefits of the system can be derived. The different Calling Modes and the respective uses each of said Calling Modes are described in the hereunder “Detailed Description of the Invention” section. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS  
         [0028]      FIG. 1  is a schematic diagram of the architecture and flow of the Internet Subscriber Interface Module. 
           [0029]      FIG. 2  is a schematic diagram of the architecture and flow of the Command and Control Module. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION  
       [0030]    The Software programs required for the system will be comprised of two basic modules, first, an “Internet Subscriber Interface module”, and second, a “Command &amp; Control module”, both of which are described hereunder. 
         [0031]    1. Internet Subscriber Interface Module 
         [0032]    The Voice “Auto-Translation” of Multi-Lingual Telephone call system” Internet User Interface Module is a multi-functional module that is central to the system. The module will be part of the subscriber account specific functionality within a communications provider&#39;s Web Site. A Mobile Device Internet version will be developed so that subscribers on the go will have access to the module through their Internet enabled mobile phones or other mobile Internet enabled devices. 
         [0033]    The module will:
       a) Be part of a Communication Provider&#39;s subscriber registration process for the “Auto-Translate Telephone Call” service.   b) Require the subscriber to define the subscriber&#39;s telephone number(s) for which the service will be enabled, the subscribers name or nick name (that will be used by the system), the subscriber&#39;s communication language of choice, e-mail address, as well as the subscriber&#39;s gender. The gender indication (which will be optional) will dictate to the voice synthesis module whether to use a male or female voice when vocalizing the translation(s) of the subscriber&#39;s speech to each respective “Auto-Translate Telephone Call” participant(s) in said participant&#39;s respective language of choice.   c) Enable the subscriber to pre-define both individual (one to one) as well as group conference “Auto-Translate Telephone calls” with participant information that will be stored in an “Address Book”, similar to Address Book facility widely used in e-mail programs. The required Address Book information for each of the subscriber specified participants will be name and/or nick name, telephone number, country code (or geographic location), communication language of choice, e-mail address and gender (optional). Conference calls can then be defined by giving each conference call a unique name, and specifying specific participants in the particular conference call by selecting individual participants from the Address Book. Defined conference calls can also be saved in the Address Book using their unique name.   d) E-mails will be automatically sent to newly defined participants, written in each newly defined participant&#39;s language of choice, identifying the subscriber who defined the specific individual in their “Auto-Translate Telephone Call” address book, and explaining the conference “Auto-Translate Telephone call” service.   e) The user will schedule and initiate a call through the Internet User Interface Module. The subscriber can choose an individual participant from the system Address Book or a predefined Conference Call by selecting either the Name (or the nick name) of the call as predefined in the Address Book. In the case of a predefined Conference Call, the user will have the opportunity to add and/or delete participants from the list of predefined participants displayed. Alternately, the subscriber can create a Conference Call on the fly by selecting a list of participants from the Internet User Interface Module Address Book.       
 
         [0039]    At any time, the user can select the “Initiate Call” option, and the “Auto-Translate Telephone call Telephony Conference Bridge Server will initiate the call by automatically telephoning both the Subscriber and the Participant(s). Pre-Scheduled calls can be automatically scheduled in the same manner at the specified date and time. 
         [0040]    For prescheduled calls, the Internet User Interface Module will automatically send e-mail RSVP invitations to all specified participants, and acceptance responses will be automatically indicated and viewed in the Internet User Interface Module call definition next to the name or nick name of each participant. 
         [0041]    The Internet Subscriber Interface Module is accessed through the Internet, and therefore can be accessed by the subscriber through the use of any stationary or mobile Internet enabled device, including, but not limited to, a PC computer, Laptop computer or Internet enabled Mobile Phone. 
         [0042]    The subscriber will also be able to initiate an “Auto-Translate Telephone call” from “any telephone”, including landline, mobile, as well as a VOIP service to dial a specified telephone bridge number (toll-free recommended). 
         [0043]    The user will specify a PIN number using the telephone keypad and then subsequently simply verbally say the name or nick-name of the “Auto-Translate Telephone call”, individual(s) or Conference Call name, as predefined in the subscribers Address Book. 
         [0044]    The subscriber will then be able to issue voice commands to “Add” and/or “Delete” participants. To initiate the “Auto-Translate Telephone call”, the subscriber will then issue a Voice Command, such as “Initiate Call”. 
         [0045]    Alternatively, specified telephone keypad buttons can be pressed and detected by DSP (Digital Signal Processing) to indicate required commands in any situation in which the use of voice recognition (as described above) is not preferable. 
         [0046]    1.1. Transcript Storage and Access 
         [0047]    Text transcripts of each “Auto-Translate Telephone Call” conversation made by a subscriber will be automatically generated in electronic text format by the “Command and Control Module” (see below). 
         [0048]    The transcripts of every call made by a subscriber are then stored in the subscriber&#39;s call history database that is connected to and accessible from the Communication Provider&#39;s Internet subscriber account web portal (i.e., Internet User Interface Module). As a result, transcripts of all “Auto-Translate Telephone Calls” that the subscriber has made are made available for viewing through their own Internet subscriber account web portal. 
         [0049]    The text that is generated by the voice recognition for the original language speech of each participant (i.e., prior to translation), as well as the text of the translations of said original language speech prepared for each respective “auto-translate conversation” participant in their respective different languages, will be saved in the subscriber&#39;s call history database. As a result, the subscriber can view a complete record of each call, including original speech, and respective translations. 
         [0050]    There will be two types of viewing options that the subscriber can select. These viewing options are either “Vertical” or “Horizontal” “Vertical Viewing” is a view of the conversation transcripts in the subscribers own language of choice, which will consist of all original speaker dialogue spoken in the subscribers language of choice, as well as respective translations of “other language” original speakers dialogue (spoken by a conversation participant in a language other than the subscribers “language of choice”), displayed in the precise order in which the respective participants spoke during the Auto-Translate Conversation. 
         [0051]    “Horizontal Viewing” of conversation transcripts will consist of each participant&#39;s respective dialogue in their own native language, as well as the respective translations of said speaker&#39;s dialogue as translated into the respective languages of all other conversation participants”), displayed in the precise order in which the respective participants spoke during the Auto-Translate Conversation. 
         [0052]    1.2. Call Statistics and CDR (Call Data Record) 
         [0053]    For each “Auto-Translate Telephone Call” conversation, statistics will be automatically calculated from said conversation transcripts detailing the “Translation Work Performed” for each of the subscriber&#39;s conversations. Said statistics will be made available to the subscriber for viewing through said subscriber&#39;s own “Internet Subscriber&#39;s Interface Module”. 
         [0054]    Said statistics of “Translation Work Performed” for each of the subscribers conversations, will also be used to generate CDR a (Call Data Record) for the purpose of customer billing for “Translation Work Performed” for each subscriber-initiated conversation, in addition to connect time and number of participants. 
         [0055]    It is anticipated that potential customers throughout the world will want to become “Auto-Translate Telephone Call” subscribers. In regions of the United States where incumbent Communication Providers do not provide the Auto-Translate Telephone Call service, and in foreign countries where other carriers provide voice wireline and mobile service, and such foreign carriers do not provide the Auto-Translate Telephone Call service, a method will be provided to enable said people and companies to subscribe to and use the Auto-Translate Telephone Call service without the active cooperation of the local incumbent Communication provider, as follows: 
         [0056]    Regardless of where potential subscribers are in the world or which Communications Carriers are the incumbent providers, said potential subscribers can register for the service directly through the Web Site of the technology vendor. In this manner, the “technology vendor” that develops and provides the service to Communication Providers to sell to subscribers in their respective regions, can also sell directly to subscribers in regions where the service is not provided by a local incumbent Communication provider. 
         [0057]    In such cases, the potential customer can register for the service directly through the Web Site of said technology vender. The Internet User Interface Module will have the capability to accept major credit cards as well as process prepaid business. This type of customer will call a specified telephone number (local toll free number is recommended) using the local carrier&#39;s network, and the call will be connected to the technology vendor&#39;s own Auto-Translate Telephony Server which will provide “Auto-Translate Telephone call” service for this type of “direct subscriber”. Billing for the service can be based on connect time, locations of the call participants, number of participants, as well as statistics relating to “Translation Work Performed” for each Auto-Translate telephone call. Said information will be used to automatically create a Call Data Record (CDR) relating to each call for the purpose of subscriber billing. 
         [0058]    2. Command &amp; Control Module 
         [0059]    The Command &amp; Control Module receives from the Internet Subscriber Interface Module all the information required to initiate a subscriber specified individual or conference “Auto-Translate Telephone Call” call. Alternately, a copy of the above mentioned information can be located on the Network Telephony Server. The above mentioned information, which is received from the Internet Subscriber Interface Module for each participant in the “Auto-Translate Telephone Call” includes:
       1. Participant&#39;s Phone number (including Country Code &amp; City Code)   2. Participant&#39;s Name OR Participant&#39;s “Nick Name”   3. Participant&#39;s Communication Language of Choice   4. Participant&#39;s email Address   5. Participant&#39;s Gender (Optional—To be used for Voice Synthesis)       
 
         [0065]    Utilizing a Telephony Network Server conference bridge or Internet VOIP conference bridge software, or other conference bridging technique known to those skilled in the art, and the following software:
       1. Voice Recognition Software (Voice-To-Text)   2. Machine Translation Software (Text-To-Text)   3. TTS Voice Synthesis Software (Text-To-Speech)       
 
         [0069]    The Module will:
       1) Telephone each participant and inform the participant in his/her respective language that he/she is receiving an “Auto-Translate Telephone Call”. In the case that one or more of the participant(s) does not answer, or chooses not to accept the telephone call, the initiating subscriber will then be informed of that by the system, and be given the choice whether to continue with the call or not. The initiating subscriber will then inform the system, through voice command or DPS telephone keypad signal, to either proceed or discontinue the “Auto-Translate Telephone Call”. In the case that the initiating subscriber chooses to discontinue the call, all other participants will be informed by the system, in their respective languages, which participant(s) are not available, and that the initiating subscriber has decided not to continue with the “Auto-Translate Telephone Call”.    Alternately, each party can call a specified Conference Bridge telephone number, and identify themselves via keying in a Conference Code, which was supplied to the participant either by the subscriber, or automatically e-mailed (RSVP) to the participant when the call was scheduled by the subscriber.    Transcript information detailing the above will be recorded in the initiating subscribers “Auto-Translate Telephone Call” Transcript database, and will be available for viewing in the initiating subscriber&#39;s Internet Subscriber Interface Module transcript viewing section.   2) In the case that all participants are present, or the initiating subscriber has chosen not to terminate the call, then the “Auto-Translate Telephone Call” will continue as follows: The subscriber who initiated the “Auto-Translate Telephone Call” will be given the first turn to speak. When the initiating subscriber finishes speaking, he/she will then either pause for a few seconds (e.g., five seconds) or he/she will press a specified keypad key, such as the pound or star key, in order to indicate to the system that the translation process should begin. All participants are then taken “Off the Conference Bridge” and informed by the system, in each respective participant&#39;s language of choice, that “the participant “John&#39;s” speech is now being translated. By the time this notification has finished, the translation process should be complete, and said translation is then heard by each participant (utilizing Voice Synthesis), in each participant&#39;s respective language of choice.    The translation process steps are as follows:
           a) Voice Recognition automatically transforms the talking participant&#39;s speech into text.   b) This text is then automatically translated by Machine Translation into the languages of each “Auto-Translate Telephone Call” participant&#39;s respective Language of Choice.   c) All participants are taken “Off the Conference Bridge” and each participant is informed in his/her respective language of choice that the previous speaker&#39;s words are being translated.   d) While all participants are “Off the Conference Bridge”, the resulting translation texts, one translation text in the respective language of each participant, is then read by the system separately to each participant in their chosen respective language of choice using Voice Synthesis technology.   e) After all participants have heard the respective translation of the previous speaker&#39;s words, all participants are then brought back “On the Conference Bridge”.   f) Control is then returned to the “Command and Control” module to continue managing the “Auto-Translate Telephone Call” conversation.   
               
 
         [0078]    The question of “Who talks next” is essential to “Auto-Translate Telephone Call” conversation management, and a predefined “Call Management Scenario” can be specified by the subscriber through the “Internet Subscriber Interface Module. Possible Call Management Scenarios may include, but are not limited to the following: 
         [0079]    Scenario One: “Requesting to Talk” 
         [0080]    In this scenario, to get a turn to talk you must say your name. In the case that multiple participants want to talk at the same time, several people say their name. You are allowed to say your name multiple times, and the last participant to say their name, followed by a pause of few seconds (e.g., five seconds) is then given the turn to speak. Of course, this scenario has the inherent assumption that at some point, other participants who want to speak will eventually give in, and stop saying their name. This can be solved by the subscriber who initiated the “Auto-Translate Telephone Call”. The initiator of the call can decide who will talk next by simply saying the name of the participant that the subscriber who initiated the “Auto-Translate Telephone Call” wants to give the right to talk next. The system will automatically grant the right to talk to the participant whose name was specified by the initiating subscriber. 
         [0081]    Scenario Two: “Talking in Turn” 
         [0082]    In this scenario, each participant is only allowed to talk in turn. The system will call out the name of the next participant allowed to talk by name. The participant, can then either begin talking, or give a voice command to “Pass”, spoken in the participant&#39;s respective language. The above-described process can also be implemented through the use of Digital Signal Processing (DSP) by having participants depress (hit) a telephone keypad button, which has been predefined for specific functionality. 
         [0083]    2.1. Create and Store Conversation Transcripts: 
         [0084]    Since both the Voice Recognition software as well as the Machine Translation software both generate text in electronic format, it is a relatively straight forward matter to create electronic text transcripts of all “Auto-Translate Telephone Calls”, both in each participant speaker&#39;s language of choice as well as the respective translations thereof. 
         [0085]    The transcripts of every call made by a subscriber are then stored in the subscriber&#39;s call history database, which is connected to and accessible from the subscriber&#39;s own Internet web portal (i.e., Internet User Interface Module). As a result, transcripts of all “Auto-Translate Telephone Calls” that the subscriber has made are made available for viewing through the subscribers own their own Internet subscriber account web portal. 
         [0086]    The text that is generated by the voice recognition for the original language speech of each participant (i.e., prior to translation), as well as the text of the translations of said original language speech prepared for each respective “auto-translate conversation” participant in their respective different languages, will be saved in the subscriber&#39;s call history database. As a result, the subscriber can view a complete record of each call, including original speech, and respective translations. 
         [0087]    2.2. Statistics &amp; Billing: 
         [0088]    For each “Auto-Translate Telephone Call” conversation, statistics will be automatically calculated from said conversation transcripts detailing the “Translation Work Performed” for each of the subscriber&#39;s conversations. 
         [0089]    These statistics will be generated from the text transcripts of each Auto-Translate Telephone Call made by each subscriber, and will be stored with the subscribers account activity information. Statistics saved and stored will include standard billing information, such as time, date, duration, number of participants, as well as Translation Work performed by the system, such as the number of translated words for each participant. In addition to normal CDR (Call Data Record) information, translation work performed statistical information will be included in said CDR may also be used for billing purposes and can be incorporated in an automatically generated Auto-Translate call CDR for each call. Furthermore, these statistics will be made available for viewing through each subscribers own Internet subscriber account web portal by means of the “Internet Subscriber Interface Module” (see above). 
         [0090]    2.3. Calling Modes 
         [0091]    Finally, the system will have the capability to be configured using a variety of “Calling Modes”. Calling Modes dramatically increase the flexibility of use of the system, specifically when, how and where the benefits of the system can be derived. The different Calling Modes and the respective uses each of said Calling Modes are described as follows. 
         [0092]    The “Conference Call Mode” 
         [0093]    In this mode, telephone calls are scheduled and initiated through the Internet Subscriber Interface Module. The Internet Subscriber Interface Module is accessed through the Internet, and therefore can be accessed by the subscriber through the use of any stationary or mobile Internet enabled device, including, but not limited to, a PC computer, Laptop computer or Internet enabled Mobile Phone. The functionality of this “Conference Call Mode” is detailed hereinabove. 
         [0094]    The “Non-Scheduled Subscriber Initiated Mode” 
         [0095]    This mode enables the subscriber to initiate an “Auto-Translate Telephone call” from “any telephone”, including landline, mobile, as well as a VOIP service to dial a specified telephone bridge number. 
         [0096]    This mode is intended for Ad-Hoc Auto-Translate calls in cases where an Internet Enabled device is not available. Using “any-telephone”, the subscriber will call a telephone number. It is recommended that a toll free number be available to use for this calling mode. 
         [0097]    The subscriber will be requested to enter an identifying PIN number. The subscriber will be requested to state clearly the name of the specific party, or the specific conference call name, consisting of multiple parties, as defined in the subscriber&#39;s “address book” within the subscriber&#39;s “Internet Subscriber Interface Module. As a result, the system will know the name(s) and telephone number(s) of the party or parties to be called. The subscriber will then be requested by the system to state subject of the call (i.e., what the subscriber wants to talk about), which will be recorded. At this point the call will be initiated. 
         [0098]    For example, the system will automatically telephone Mr. Wong in China and when Mr. Wong picks up the receiver he will be informed in Chinese that he is receiving an Auto-Translate telephone call from “the name of the subscriber” and then Mr. Wong will hear a verbalized Chinese translation of “what the subscriber wants to talk about”. Mr. Wong will then be informed in Chinese that the call is at the expense of the subscriber, and asked if he wishes to accept the Call. In the case that Mr. Wong responds “Yes”, he will be brought “On the Bridge”, and the conversation will proceed and be managed as described above. 
         [0099]    The “Receiving Party Initiated Mode” is somewhat different, and is intended for use by third parties, such as Police, Fire or Medical emergency services, or a commercial entity&#39;s Customer Service department, who may receive telephone calls in languages that they do not understand. Using this mode there is no conference call bridge telephone number to call, but instead, a telephony server at the receiving party&#39;s location is employed. The party receiving the telephone call will select a language, and the system installed in the telephony server will be attached to a “conference-bridge” (e.g., a telephony card) located within the receiving party&#39;s telephony server will prompt the caller in the above mentioned selected language, step by step, as to how to use the system. 
         [0100]    US Patent Document Reference Cited: 
         [0101]    1. USPTO Patent Application 20080177528 (Serial No. 008082, Series Code: 12), Filed: Jan. 8, 2008 “Method of enabling any-directional translation of selected languages” 
         [0102]    Other References Cited:
       1. Article entitled “Made in IBM Labs: Speech Translation Technology Breaks through Language Barrier for U.S. Forces in Iraq”, Date: Oct. 12, 2006, Source: Market Wire.   2. Article entitled “SRI International Delivers Speech-To-Speech Translators to U.S. Military in Iraq”, Date: Jul. 12, 2006, Source: InDEFENSE.   3. Article entitled “Language Weaver Announces Strategic Investment and Contract from In-Q-Tel; First Commercial Products Using Statistical Machine Translation Methodology Released.