Abstract:
A data communication terminal, such as a cellular telephone, capable of synthesizing speech. The data communication terminal can establish a communication session with a base station over a transmission facility implementing a voice channel and a data channel. The data communication terminal includes a speech synthesizer engine that receives from the remote entity a signal transmitted over the data channel and that conveys the vocal tract characteristics of the message to be delivered as a spoken announcement. The base station generates the signal containing the vocal tract characteristics from a text-based signal of the message to be synthesized. The invention also extends to a base station that can convert the text based message to be synthesized into a signal containing vocal tract characteristics and that sends the signal to a remote terminal over the data channel.

Description:
FIELD OF THE INVENTION  
         [0001]    The present invention relates to the field of synthesizing speech and in particular to a method and to an apparatus in which the speech synthesis function is distributed between two components that communicate with one another over a transmission facility. The invention finds practical applications in digital cellular telephony where it is desirable to deliver messages to the subscriber as spoken announcements. The invention also extends to a digital cellular terminal featuring speech synthesis capability.  
         BACKGROUND OF THE INVENTION  
         [0002]    Currently, the short message service (SMS) feature is used to send short text-based messages to the digital cellular terminal to display various messages, including the number/name of the called party, message headers of pending messages, and various alert messages. In a situation where the user&#39;s eyes are busy, for example, while driving or while performing tasks requiring visual attention, the user cannot read these messages. Spoken announcements synthesized at the terminal would alleviate his problem.  
           [0003]    One possibility to overcome this problem is to perform complete speech synthesis at the terminal. This could be achieved by transmitting the text of the message to the terminal where a speech synthesis unit will generate audible speech. However, this possibility is not practical because the terminal would necessitate a significant amount of computing power and memory, which are not available at terminals found today in the marketplace.  
           [0004]    Against this background it clearly appears that there is a need to improve the existing functionality of remote terminals as it relates to their ability to synthesize speech. In particular, a need exists in the industry to develop remote terminals having the ability to deliver speech synthesis functions to the user without necessitating significant increases in computing and memory resources.  
         SUMMARY OF THE INVENTION  
         [0005]    In one aspect, the present invention provides a communication terminal that is capable of establishing a communication session with a remote entity over a transmission facility implementing two different channels. The first channel, so-called voice channel is used for transporting a speech signal between the terminal and the remote entity. The second channel, so-called data channel is used for sending short messages to the terminal. The voice channel is characterized by a larger bandwidth capacity than the data channel.  
           [0006]    The terminal includes a speech synthesizer engine that receives vocal tract information sent from the remote entity over the data channel such as to create a spoken announcement of the message.  
           [0007]    Under one specific example of implementation, the communication terminal is a digital cellular terminal hat can be either mobile or fixed. Under this example, the remote entity is the base station of the network with which the terminal communicates. When a message is to be delivered to the terminal as a spoken announcement, the base station processes the text of the message to generate the vocal tract information and transmits the vocal tract information over the data channel. This approach transfers at least some of the processing to effect the speech synthesis to the base station that has significant computing resources. The vocal tract information that is sent to the terminal over the data channel is a low bit rate signal that can be converted into a spoken announcement with minimal computation. This function can be implemented easily at a terminal.  
           [0008]    In a different aspect, the invention also provides a base station for use in a digital cellular network. The base station can establish a communication session with a remote terminal over a transmission facility featuring a data channel and a voice channel. The base station has an input for receiving a textual message that is to be delivered as a spoken announcements at the remote terminal. The base station has a speech synthesis preprocessing unit that receives the signal conveying the textual message to generate the corresponding vocal tract information. The base station transmits of the vocal tract information to the remote terminal over the data channel. The remote terminal can then use the vocal tract information to generate the audio representation of the textual message.  
           [0009]    The invention also extends to a communication terminal that can notify the remote entity with which it establishes a communication, of the kind a resident speech synthesizer it is currently implementing. Under one possible form of implementation, the notification sent to the remote entity causes the remote entity to upload to the terminal an updated version or a different version of the speech synthesizer engine in the case where the resident speech synthesizer engine is not suitable for the operation or needs updating or changing. A different possibility is to provide at the base station a pool of speech synthesis pre-processing units and to use the notification issued by the remote terminal to select the particular speech synthesis pre-processing unit that matches the speech synthesizer engine implemented at the terminal.  
           [0010]    The invention also extends to a method for performing speech synthesis at a communication terminal and also to a method for performing speech synthesis pre-processing at a base station of a digital cellular network. The invention also provides a method for upgrading or altering a speech synthesizer engine in a communication terminal through interaction with a remote entity with which the terminal communicates. Finally, the invention relates to a method for performing a speech synthesis pre-processing unit selection at a base station of the digital network based on the type of the speech synthesizer engine residing at the remote terminal with which the base station communicates.  
           [0011]    Other aspects and features of the present invention will become apparent to those ordinarily skilled in the art upon review of the following description of specific embodiments of the invention in conjunction with the accompanying figures. 
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0012]    [0012]FIG. 1 is a block diagram illustrating a mobile-to-mobile digital cellular system connection through the Public Switched Telephone Network (PSTN);  
         [0013]    [0013]FIG. 2 is a block diagram of a text-to-speech synthesis unit having a distributed configuration, where one part of the speech synthesis unit is located in the base station of the network while another part of the speech synthesis unit is found in the terminal;  
         [0014]    [0014]FIG. 3 is a block diagram of the base station of the network featuring a pool of speech synthesis pre-processing units that can be selectively enabled to process the text based signal from which synthetic speech is to be generated;  
         [0015]    [0015]FIG. 4 is a block diagram of a variant of the base station depicted in FIG. 3;  
         [0016]    [0016]FIG. 5 is a block diagram of a generic computing apparatus on which the functionality of the remote terminal and the base station in accordance with the present invention can be implemented with software. 
     
    
     DETAILED DESCRIPTION  
       [0017]    [0017]FIG. 1 is a block diagram representation of a portion of a cellular wireless telecommunications network. In this figure, Mobile Terminals (MT) are on the move in the hexagonal areas defined as cells. Fixed wireless terminals (FWT) are also included in the areas defined as cells. Each cell covers a predetermined geographical area and has a Base Transceiver Station (BTS), which communicates through radio channels with the MTs and FWTs. A typical communication protocol between the BTSs and the MTs and FWTs may be a Time division multiple access (TDMA) protocol. Alternatively, the communication protocol could be a code division multiple access (CDMA) or groupe station mobile GSM protocol, among others. For purposes of illustration, assume hereinafter that a TDMA protocol is in effect. A number of these BTSs (i.e. cells) may be connected by land line or microwave link  150  to one Base Station Controller  100 ,  105  (BSC), referred in this specification as the base station, which controls handoff functions, speech synthesis pre-processing functions, among others, and routes the signal as requested. Each BSC  100 ,  105  is connected to a landline network  130 . The landline network  130  may include, among others, the PSTN, the Integrated Services Digital Network and the Internet. Land terminals  140  (LT) connected to the landline network  130  are also shown for completeness.  
         [0018]    When the base station  100  communicates with a remote terminal, the communication is effected over a transmission facility that implements a voice channel and a data channel. In this particular example, the transmission facility is the air interface. Other possibilities include physical conductors such as cable, optical transmission medium, amongst other suitable conductors. The voice channel is the primary link between the base station and the remote terminal. The voice channel is used to carry the speech sound information. The data channel is used to convey short text based messages and, possibly, control signals as well. It is not deemed necessary to further describe the structure of the transmission facility since this element is not part of the invention and its operation is well understood in he art.  
         [0019]    [0019]FIG. 2 illustrates the structure of the text to speech synthesizer unit embodying the principles of the present invention. The text to speech synthesizer unit comprehensively designated by the reference numeral  200  comprises a speech synthesis pre-processing unit  202  that is located at the base station of the network, say the base station  100  for the sake of this example. The purpose of the speech synthesis pre-processing unit  202  is to receive the input signal conveying in textual form the message to be audibly synthesized and to generate through proper signal processing techniques vocal tract information. The vocal tract information is contained in a signal that basically conveys how the synthetic utterance will be pronounced. In contrast to the textual only information received by the speech synthesis pre-processing unit  202 , the vocal tract information defines or characterizes how the message is to be uttered. More particularly, the speech synthesis pre-processing unit  202  comprises a text analyzer  204  that receives at its input the input signal conveying the message to be synthesized in a textual form. In a specific example of implementation, the input signal is an ASCII encoded message. By using a text to phoneme conversion algorithm implemented by the grammatical rules unit  206 , the text analyzer  204  will convert the incoming text into a phonetic representation. More specifically, the output of the text analyzer  204  is a succession of symbols of sounds that basically define how the text message is to be pronounced. Similarity, a pronunciation dictionary algorithm implemented by the pronunciation dictionary  208  will convert the incoming text into a prosodic representation. The signal conveying the prosodic representation is output by the text analyzer  204  concurrently with the phonetic representation.  
         [0020]    The phonetic representation of the message is passed to a phonetic control unit  210  that generates a signal conveying the global spectral shape that reflects vocal tract characteristics. The phonetic control unit  210  communicates during the processing operation with a synthesis unit speech data  212 . Similarly, the prosodic representation of the message is passed to a prosodic control unit  214  that generates a signal conveying information regarding the segmental duration, fundamental frequency and amplitude. This signal is generated by the prosodic control units  214  on the basis of prosodic rules stored in a unit  216 .  
         [0021]    The output of the phonetic control  210  and the output of the prosodic control  214  are combined into a single signal that provides the vocal tract information. The vocal tract information signal is sent over the data channel in the transmission facility linking the terminal to the base station. As mentioned earlier, in addition to the data channel the transmission facility also has a voice channel over which speech data is exchanged with the subscriber with whom a call is established. The bandwidth of the data channel is smaller than the bandwidth of the voice channel.  
         [0022]    In a specific example of implementation, the voice tract information conveyed to the terminal over the data channel is equivalent to linear prediction coefficients (LPC) encoded speech. The output of the phonetic control  210  basically generates the coefficients of a speech frame while the output of the prosodic control  216  generates some additional parameters that are necessary to properly generate the synthetic utterance.  
         [0023]    The part of the text to speech synthesizer unit  200  that resides in the terminal is the speech synthesizer engine  218 . Continuing with the example of implementation described above, the synthesizer engine  218  is an LPC decoder that receives the vocal tract information transported on the data channel and converts this information into PCM samples. Next, the PCM samples are passed through a D/A converter that generates an analog signal. This analog signal is amplified and supplied to a transducer  219  that converts the electrical energy into audible sound. A loudspeaker is an example of such a transducer.  
         [0024]    It is not necessary to describe in detail the structure and operation of the text to speech synthesis unit  200  since the functionality of such devices is well-known to those skilled in the art. For additional information the reader is invited to refer to Y. Sagisake, Speech Synthesis from Text, IEEE Communications Magazine, January 1990 pp. 35-41 and to T. Dutoit, An Introduction to text-to-speech Synthesis, Kluwer Academic Publishers, 1997. The contents of these documents are hereby incorporated by reference.  
         [0025]    The example of implementation of the invention Illustrated in FIG. 2 assumes that the synthesizer engine  218  and the speech synthesizer pre-processing unit  202  are compatible. Many algorithms exist today for performing text to speech synthesis, including LPC analysis (the example provided earlier is based on this algorithm), and hybrid harmonic/stochastic synthesis, and time domain algorithms. In a practical situation a base station implementing the principles of this invention will establish a communication with a plurality of terminals where the terminals may be implementing different speech synthesis algorithms. In order to establish compatibility between the speech synthesis pre-processing unit in the base station  100  and the terminals two distinct possibilities can be considered. The first possibility is illustrated in FIG. 3. The base station  100  is provided with a plurality of speech synthesis pre-processing units  202 , each unit being designed to operate according to a different algorithm. A control logic functional unit  203  receives the input signal containing the textual information to be synthesized and routes the signal to a selected one of the speech synthesis pre-processing unit  202 .  
         [0026]    The terminal is designed to transfer to the base station an identifier that will uniquely identify the type of speech synthesizer engine  218  that presently resides in the terminal. This identifier can be sent at different times but it is preferred to send it over the data channel during call setup. When the control logic functional unit  203  receives this identifier it can then identify which ones of the speech synthesis pre-processing units  202  can interoperate with the resident speech synthesizer engine  218 . Accordingly, the control logic functional unit  203  will route the input signal containing the textual information to the proper speech synthesis pre-processing unit  202 .  
         [0027]    The second possibility is to update or simply change the speech synthesis engine  218  to suit the speech synthesis pre-processing, unit  202  in the base station  100 . This possibility is illustrated in FIG. 4 of the drawings. In a specific example of implementation, during call setup, the terminal transmits to the base station the identifier that will uniquely identify the type of speech synthesizer engine  218  present in the terminal. The base station  100  receives this information and the control logic functional unit  203  compares it against the speech synthesis pre-processing unit  202  currently installed. If a match exists, call setup proceeds normally. Otherwise, the control logic functional unit  203  sends a control signal to a program element uploading functional unit  205  that sends to the terminal, over the data channel, the program element to replace the resident speech synthesizer engine  218  with a new program element operative to inter-operate with the base station  100 . Under this mode of operation the speech synthesizer unit  218  is updated at regular intervals which allows to bring about improvements to the speech synthesis functionality of the terminal without the necessity for the user to acquire a new terminal.  
         [0028]    The speech synthesis pre-processing unit  202  and the speech synthesizer engine  218  are implemented in software that is executed on any suitable computing platform. More specifically, since the speech synthesis pre-processing unit  202  and the speech synthesizer engine  218  run in independently from one another, they are implemented on two separate computing platforms, namely the base station and the terminal. The structure of such computing platform is illustrated in FIG. 4. The computing platform includes a central processing unit  300 , a memory  302  connected to the central processing unit over a bus  204 . In addition to these two components, the computing platform also includes a number of interfaces  306  that allow the central processing unit  300  to exchange signals with the external world. It is not deemed necessary to provide a detailed discussion of such computing platform since it&#39;s structure and operation are well-known to those skilled in the art.  
         [0029]    The memory  302  is divided in two sections, one section being used for holding the program instructions that implement the functionality of the speech synthesis pre-processing unit  202  or of the speech synthesizer engine  218 . The other section of the memory holds the data on which the program instructions operate. In particular, the input signal or any intermediate data generated during computations would be held in the second portion of the memory.  
         [0030]    The speech synthesis pre-processing unit  202  and the speech synthesizer engine  218  can exist externally of the computing platform as a set of program instructions recorded or stored on a machine readable storage medium  308 . Such machine readable storage medium can be a floppy disk, a CD-ROM or any other suitable nonvolatile storage medium that can be read by a computing platform to extract the program instructions and then execute them in order to implement the desired functionality.  
         [0031]    Although the present invention has been described in considerable detail with reference to certain preferred embodiments thereof, variations and refinements are possible without departing from the spirit of the invention. Therefore, the scope of the invention should be limited only by the appended claims and their equivalents.