Source: http://www.google.com/patents/US5293448?dq=7,157,879
Timestamp: 2016-07-30 15:30:52
Document Index: 15525530

Matched Legal Cases: ['art 2', 'art 2', 'art 2', 'art 4', 'art 4', 'art 4', 'art 32', 'art 33', 'art 2', 'art 38', 'art 32', 'art 32', 'art 35', 'art 36', 'art 38', 'art 38', 'art 4', 'art 38', 'art 35', 'art 34', 'art 34', 'art 35', 'art 36', 'art 38', 'art 32', 'art 34', 'art 34', 'art 35', 'art 35', 'art 36', 'art 38', 'art 38', 'art 38', 'art 38', 'art 4', 'art 7', 'art 6', 'art 8', 'art 6', 'art 4', 'art 4', 'art 8', 'art 6', 'art 6', 'art 6', 'art 38', 'art 8', 'art 6', 'art 7', 'art 8', 'art 39', 'art 39', 'art 39', 'art 39', 'art 39', 'art 39', 'art 39', 'art 39', 'art 40', 'art 41', 'art 42', 'art 43', 'art 11', 'art 11', 'art 11', 'art 44', 'art 45', 'art 39', 'art 40', 'art 45', 'art 47', 'art 48', 'art 49', 'art 13', 'art 15', 'art 19', 'art 20', 'art 13', 'art 2', 'art 6', 'art 21', 'art 21', 'art 22', 'art 23', 'art 25', 'art 8', 'art 9', 'art 50', 'art 51', 'art 52', 'art 53', 'art 54', 'art 50', 'art 6', 'art 4', 'art 30']

Patent US5293448 - Speech analysis-synthesis method and apparatus therefor - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsAn impulse sequence of a pitch frequency is detected from a phase-equalized prediction residual of an input speech signal, and a quasi-periodic impulse sequence is obtained by processing the impulse sequence so that a fluctuation in its pitch frequency is within an allowed limit range. The magnitudes...http://www.google.com/patents/US5293448?utm_source=gb-gplus-sharePatent US5293448 - Speech analysis-synthesis method and apparatus thereforAdvanced Patent SearchPublication numberUS5293448 APublication typeGrantApplication numberUS 07/939,049Publication dateMar 8, 1994Filing dateSep 3, 1992Priority dateOct 2, 1989Fee statusLapsedAlso published asUS5495556Publication number07939049, 939049, US 5293448 A, US 5293448A, US-A-5293448, US5293448 A, US5293448AInventorsMasaaki HondaOriginal AssigneeNippon Telegraph And Telephone CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (6), Referenced by (94), Classifications (8), Legal Events (5) External Links: USPTO, USPTO Assignment, EspacenetSpeech analysis-synthesis method and apparatus therefor
US 5293448 AAbstract
1. A speech analyzing apparatus comprising:linear predictive analysis means for performing a linear predictive analysis of an input speech signal for each analysis window of a fixed length to obtain prediction coefficients, said linear predictive analysis means including means for determining whether said input speech signal in an analysis window of fixed length is voiced or unvoiced and for providing a voiced/unvoiced decision signal; inverse filter means controlled by said prediction coefficients, for deriving a prediction residual from said input speech signal; speech phase equalizing filter means for rendering the phase of said input speech signal into a zero phase to obtain a phase-equalized speech signal; prediction residual phase equalizing filter means for rendering the phase of said prediction residual into a zero phase to obtain a phase-equalized prediction residual signal; reference time point gathering means for detecting impulses of magnitudes larger than a predetermined threshold value in said phase-equalized prediction residual signal and for outputting the positions of said impulses as reference time points; impulse position generating means responsive to said reference time points and said voiced/unvoiced decision signal for producing, based on said reference time points when said decision signal indicates that said speech signal is a voiced sound, differences between successive intervals of said reference time points for comparing the differences with a predetermined limit range, and for determining positions of impulses such that when the differences are within said predetermined limit range, said reference time points are determined as impulse positions, and when said difference are in excess of said predetermined limit range, impulse positions are determined by adding a time point to said reference time points or by omission of one of said reference time points or by shift of one of said reference time points so that the differences between the successive intervals of the processed reference time points are held within said limit range, said impulse positions thus determined being one of the parameters representing the excitation signal as a result of the speech analysis; impulse sequence generating means for receiving said impulse positions from said impulse position generating means and generating impulses at said impulse positions; all-pole filter means controlled by said prediction coefficients and excited by said generated impulse sequence to generate a synthesized speech; and impulse magnitude calculating means for determining magnitude values of said impulses generated by said impulse sequence generating means which minimize an error between a waveform of a synthesized speech obtainable by exciting said all-pole filter means with said impulse sequence and a waveform of said phase-equalized speech supplied from said speech phase equalizing filter means, and means for outputting said impulse magnitudes for use as another one of the parameters representing the excitation signal as a result of the speech analysis by said speech analyzing apparatus. 2. The apparatus according to claim 1 further comprising:zero filter means for providing said impulse sequence with features of the waveform of said phase-equalized prediction residual signal and supplying the output thereof to said all-pole filter means as the excitation signal; and zero filter coefficient calculating means for establishing the coefficients of said zero filter means which minimize an error between a waveform of a synthesized speech obtained by exciting said all-pole filter means with the output of said zero filter means and a waveform of said phase-equalized speech. 3. The apparatus of claim 1 or 2, wherein said apparatus further includes random pattern generating means for generating a random pattern which minimizes an error between a waveform of a synthesized speech obtained by exciting said all-pole filter means with one of a plurality of predetermined random patterns and a waveform of said phase-equalized speech in a window during which said decision signal is unvoiced.
5. A method for analyzing a speech to generate parameters representing an input speech waveform including parameters of an excitation signal for exciting a linear filter representing a speech spectral envelope characteristic, comprising the steps of:producing a phase-equalized prediction residual of the input speech waveform; determining reference time points where levels of said phase-equalized prediction residual exceed a predetermined threshold; determining whether the input speech waveform in each of a plurality of successive analysis windows, each of which is of fixed time length, is voiced or unvoiced sound; obtaining the difference between intervals of successive ones of said reference time points in each analysis window; when the input speech waveform is voiced sound, selecting impulse positions based on said reference time points such that when the difference between the intervals of the successive reference time points in each analysis window is within a predetermined range, the reference time points are selected as impulse positions, and when the difference between the intervals of the successive reference time points exceeds the predetermined range, impulse positions are selected by moving or deleting the reference time points or inserting reference time points to define a sequence of quasi-periodic impulses so that the differences between successive reference time points are within said predetermined range the positions of said quasi-periodic impulse sequence being one of the parameters representing said excitation signal; and so selecting magnitudes of the respective impulses of the quasi-periodic sequence in each analysis window as to minimize an error between the phase-equalized speech waveform and a synthesized speech waveform obtained by exciting said linear filter with said quasi-periodic impulse sequence, the magnitudes of the quasi-periodic impulses being another of the parameters representing said excitation signal. 6. The method of claim 5 wherein, before being applied to said linear filter, said quasi-periodic impulses are processed by a zero filter, said method including the step of selecting coefficients of said zero filter which minimize an error between said phase-equalized speech waveform and a synthesized speech waveform obtained by exciting said linear filter with the output of said zero filter, whereby said processing of said quasi-periodic impulses by said zero filter gives the sequence of said quasi-periodic impulses features of the waveform of said phase-equalized prediction residual signal, and using said coefficients of said zero filter as one of said parameters representing said excitation signal.
FIG. 1 i.e., FIGS. 1A and 1B illustrates in block form the constitution of the speech analysis-synthesis system of the present invention. A sampled digital speech signal s(t) is input via an input terminal 1. In a linear predictive analyzing part 2 samples of N speech signals are first stored in a data buffer for each analysis window and then these samples are subjected to a linear predictive analysis by a known linear predictive coding method to calculate a set of prediction coefficients ai (where i=1, 2, . . . , p). In the linear predictive analyzing part 2 a prediction residual signal e(t) of the input speech signal s(t) is obtained by an inverse filter (not shown) which uses the set of prediction coefficients as its filter coefficients. Based on the decision of the level for a maximum value of an auto-correlation function of the prediction residual signal, it is determined whether the speech is voiced (V) or unvoiced (U) and a decision signal VU is output accordingly. This processing is described in detail in the aforementioned literature by Saito, et al. The set of prediction coefficients ai obtained in the linear predictive analyzing part 2 is provided to a phase equalizing-analyzing part 4 and, at the same time, it is quantized by a quantizer 3.
In the phase equalizing-analyzing part 4 coefficients of a phase equalizing filter for rendering the phase characteristic of the speech into a zero phase and reference time points of phase equalization are computed. FIG. 2 shows in detail the constitution of the phase equalizing-analyzing part 4. The speech signal s(t) is applied to an inverse filter 31 to obtain the prediction residual e(t). The prediction residual e(t) is provided to a maximum magnitude position detecting part 32 and a phase equalizing filter 37. A switch control part 33C monitors the decision signal VU fed from the linear predictive analyzing part 2 and normally connects a switch 33 to the output side of a magnitude comparing part 38, but when the current window is of a voiced sound V and the immediately preceding frame is of an unvoiced sound U, the switch 33 is connected to the output side of the maximum magnitude position detecting part 32. In this instance, the maximum magnitude position detecting part 32 detects and outputs a sample time point t'p at which the magnitude of the prediction residual e(t) is maximum.
Let it be assumed that smoothed phase-equalizing filter coefficients ht'.sbsb.i (k) have been obtained for the currently determined reference time point t'i at a coefficient smoothing part 35. The coefficients ht'.sbsb.i (k) are supplied from the filter coefficient holding part 36 to the phase equalizing filter 37. The precipitation residual e(t), which is the output of the inverse filter 31, is phase-equalized by the phase equalizing filter 37 and output therefrom as phase-equalized prediction residual ep (t). It is well known that when the input speech signal s(t) is a voiced sound signal, the prediction residual e(t) of the speech signal has a waveform having impulses at the pitch intervals of the voiced sound. The phase equalizing filter 37 produces an effect of emphasizing the magnitudes of impulses of such pitch intervals.
The magnitude comparing part 38 compares levels of the phase-equalized prediction residual ep (t) with a predetermined threshold value, determines, as an impulse position, each sample time point where the sample value exceeds the threshold value, and outputs the impulse position as the next reference time point t'i+1 on the condition that an allowable minimum value of the impulse intervals is Lmin, and the next reference time point t'i+1 is searched for sample points spaced more than the value Lmin apart from the time point t'i.
When the frame is an unvoiced sound frame, the phase-equalized residual ep (t) during the unvoiced sound frame is composed of substantially random components (or white noise) which are considerably lower than the threshold value mentioned above, and the magnitude comparing part 38 does not produce, as an output of the phase equalizing-analyzing part 4, the next reference time point t'i+1. Rather, the magnitude comparing part 38 determines a dummy reference time point t'i+1 at, for example, the last sample point of the frame (but not limited thereto) so as to be used for determination of smoothed filter coefficients at the smoothing part 35 as will be explained later.
In response to the next reference time point t'i+1 thus obtained in the voiced sound frame, a filter coefficient calculating part 34 calculates (2M+1) filter coefficients h*(k) of the phase equalizing filter 37 in accordance with the following equation: ##EQU1## where k=-M, -(M-1), . . . , 0, 1, . . . , M. On the other hand, when the frame is of an unvoiced sound frame, the filter coefficient calculating part 34 calculates the filter coefficients h*(k) of the phase equalizing filter 37 by the following equation: ##EQU2## where k=-M, . . . , M. The characteristic of the phase-equalizing filter 37 expressed by Eq. (2) represents such a characteristic that the input signal thereto is passed therethrough intact.
The filter coefficients h*(k) thus calculated for the next reference time point t'i+1 are smoothed by the coefficient smoothing part 35 as will be described later to obtain smoothed phase equalizing filter coefficients ht'.sbsb.i+1 (k), which are held by the coefficient holding part 36 and supplied as updated coefficients ht'.sbsb.i (k) to the phase equalizing filter 37. The phase equalizing filter 37 having its coefficients thus updated phase-equalizes the prediction residual e(t) again, and based on its output, the next impulse position, i.e., a new next reference time point t'i+1 is determined by the magnitude comparing part 38. In this way, a next reference time point t'i+1 is determined based on the phase-equalized residual ep (t) output from the phase equalizing filter 37 whose coefficients have been set to ht'.sbsb.i (k) and, thereafter, new smoothed filter coefficients ht'.sbsb.i+1 (k) are calculated for the reference time point t'i+1. By repeating these processes using the reference time point t'i+1 and the smoothed filter coefficients ht'.sbsb.i+1 (k) as new t'i and ht'.sbsb.i (k), reference time points in each frame and the smoothed filter coefficients ht'.sbsb.i (k) for these reference time points are determined in a sequential order.
To solve this problem, in the FIG. 2 embodiment, when the input speech signal analysis window changes from an unvoiced sound frame to a voiced sound frame as mentioned above, the maximum magnitude position detecting part 32 detects the maximum magnitude position t'p of the prediction residual e(t) in the voiced sound frame and provides it via the switch 33 to the filter coefficient calculating part 34 and, at the same time, outputs it as a reference time point. The filter coefficient calculating part 34 calculates the filter coefficients h*(k), using the reference time point t'p in place of t'i+1 in Eq. (2).
Next, a description will be given of the smoothing process of the phase equalizing filter coefficients h*(k) by the coefficient smoothing part 35. The filter coefficients h*(k) determined for the next reference time point t'i+1 and supplied to the smoothing part 35 are smoothed temporarily by a filtering process of first order expressed by, for example, the following recurrence formula:
ht (k)=bht-1 (k)+(1-b)h*(k)                      (3)
where: t'i <t≦t'i+1.
The coefficient b is set to a value of about 0.97. In Eq. (3), ht-1 (k) represents smoothed filter coefficients at an arbitrary sample point (t-1) in the time interval between the current reference time point t'i and the next reference time point t'i+1, and ht (k) represents the smoothed filter coefficients at the next sample point. This smoothing takes place for every sample point from a sample point next to the current reference time point t'i, for which the smoothed filter coefficients have already been obtained, to the next reference time point t'i+1 for which the smoothed filter coefficients are to be obtained next. The filter coefficient holding part 36 holds those of the thus sequentially smoothed filter coefficients ht (k) which were obtained for the last sample point which is the next reference time point, that is, ht'.sbsb.i+1 (k), and supplies them as updated filter coefficients ht'.sbsb.i+1 (k) to the phase equalizing filter 37 for further determination of a subsequent next reference time point.
The phase equalizing filter 37 is supplied with the prediction residual e(t) and calculates the phase-equalized prediction residual ep (t) by the following equation: ##EQU3## The calculation of Eq. (4) needs only to be performed until the next impulse position is detected by the magnitude comparing part 38 after the reference time point t'i at which the above-said smoothed filter coefficients were obtained. In the magnitude comparing part 38 the magnitude level of the phase-equalized prediction residual ep (t) is compared with a threshold value, and the sample point where the former exceeds the latter is detected as the next reference time point t'i+1 in the current frame. Incidentally, in the case where no magnitude exceeds the threshold value within a predetermined period after the latest impulse position (reference time point) t'i, processing is performed by which the time point where the phase-equalized prediction residual ep (t) takes the maximum magnitude until then is detected as the next reference time point t'i+1.
The procedure for obtaining the reference time point t'i and the smoothed filter coefficients ht'.sbsb.i (k) at that point as described above may be briefly summarized in the following outline.
Step 1: At first, the phase-equalized prediction residual ep (t) is calculated by Eq. (4) using the filter coefficients ht'.sbsb.i (k) set in the phase equalizing filter 37 until then, that is, the smoothed filter coefficients obtained for the last impulse position in the preceding frame, and the prediction residual ep (t) of the given frame. This calculation needs only to be performed until the detection of the next impulse after the preceding impulse position.
Step 2: The magnitude of the phase-equalized prediction residual is compared with a threshold value in the magnitude comparing part 38, the sample point at which the residual exceeds the threshold value is detected as an impulse position, and the first impulse position ti+1 (i =0, that is, t1) in the current frame is obtained as the next reference time point.
Step 3: The coefficients h*(k) of the phase equalizing filter at the reference time point t1 is calculated substituting the time point t1 for t'i+1 in Eq. (1).
Step 4: The filter coefficients h*(k) for the first reference time t1 is substituted into Eq. (3), and the smoothed filter coefficients ht (k) at each of sample points after the preceding impulse position (the last impulse position t0 in the preceding frame) are calculated by Eq. (3) until the time point of the impulse position t1. The smoothed filter coefficients at the reference time point t1 obtained as a result is represented by ht.sbsb.1 (k).
Step 5; The phase-equalized prediction residual ep (t) is calculated substituting the smoothed filter coefficients ht.sbsb.1 (k) for the reference time point t1 into Eq. (4). This calculation is performed for a period from the reference time point t1 to the detection of the next impulse position (reference time point) t2.
Step 6: The second impulse position t2 of the phase-equalized prediction residual thus calculated is determined in the magnitude comparing part 38.
Step 7: The second impulse position t2 is substituted for the reference time point t'i+1 in Eq. (1) and the phase equalizing filter coefficients h*(k) for the impulse position t2 are calculated.
Step 8: The filter coefficients for the second impulse position t2 is substituted into Eq. (4) and the smoothed filter coefficients at respective sample points are sequentially calculated starting at a sample point next to the first impulse position t1 and ending at the second impulse position t2. As a result of this, the smoothed filter coefficients ht.sbsb.2 (k) at the second impulse position t2 are obtained.
Thereafter, steps 5 through 8, for example, are repeatedly performed in the same manner as mentioned above, by which the smoothed filter coefficients ht'.sbsb.i (k) at all impulse positions in the frame can be obtained.
As shown in FIG. 1A, the smoothed filter coefficients ht (k) obtained in the phase equalizing-analyzing part 4 are used to control the phase equalizing filter 5. By inputting the speech signal s(t) into the phase equalizing filter 5, the processing expressed by the following equation is performed to obtain a phase-equalized speech signal Sp(t). ##EQU4##
The impulse sequence generating part 7 generates such a quasi-periodic impulse sequence as shown in FIG. 3 in which the impulse position ti and the magnitude mi of each impulse are specified. The temporal position (the impulse position) ti and the magnitude mi of each impulse in the quasi-periodic impulse sequence are represented as parameters. The impulse position ti is produced by an impulse position generating part 6 based on the reference time point t'i, and the impulse magnitude mi is controlled by an impulse magnitude calculating part 8.
In the impulse position generating part 6 the interval between the reference time points (representing the positions of impulses of the pitch frequency in the phase-equalized prediction residual) determined in the phase equalizing-analyzing part 4 is controlled to be quasi-periodic so as to reduce fluctuations in the impulse position and hence reduce the amount of information necessary for representing the impulse position. That is, the interval, Ti =ti -ti-1, between impulses to be generated, shown in FIG. 3, is limited so that a difference in the interval between successive impulses is equal to or smaller than a fixed allowable value J as expressed by the following equation:
&#916;Ti =|Ti -Ti-1 |&#8806;J (6)
Step S1 : When all the reference time points t'i (where i =1, 2, . . . ) in the current frame are input from the phase equalizing-analyzing part 4, the process proceeds to the next step S2 if the preceding frame is a voiced sound frame (the current frame being also a voiced sound frame).
Step S2 : A calculation is made of a difference, ΔT1 =Ti -Ti-1, between two successive intervals Ti =t'i -ti-1 and Ti-1 =ti-1 -ti-2 of the first reference time point ti (where i=1) and the two impulse positions ti-1 and ti-2 (already determined by the processing in FIG. 4 for the last two reference time points ti-2 and ti-1 in the preceding frame).
Step S3 : The absolute value of the difference ΔT1 is compared with the predetermined value J. When the former is equal to or smaller than the latter, it is determined that the input reference time point t'i is within a predetermined variation range, and the process proceeds to step S4. When the former is greater than the latter, it is determined that the reference time point t'i varies in excess of the predetermined limit, and the process proceeds to step S6.
Step S4 : Since the reference time point t'i is within the predetermined variation range, this reference time point is determined as the impulse position ti.
Step S5 : It is determined whether or not processing has been completed for all the reference time points t'i in the frame, and if not, the process goes back to step S2, starting processing for the next reference time point ti+1. If the processing for all the reference time points has been completed, then the process proceeds to step S17.
Step S6 : A calculation is made of a difference, ΔT2 =(t'i -ti-1)/2-(ti-1 -ti-2), between half of the interval Ti between the impulse position ti-1 and the reference time point t'i and the already determined interval Ti-1.
Step S7 : The absolute value of the above-mentioned difference ΔT2 is compared with the value J, and if the former is equal to or smaller than the latter, the interval Ti is about twice larger than the decided interval Ti-1 as shown in FIG. 5A; in this case, the process proceeds to step S8.
Step S8 : An impulse position tc is set at about the midpoint between the reference time point t'i and the preceding impulse position ti-1 , and the reference time point t'i is set at the impulse position Ti+1 and then the process proceeds to step S5.
Step S9 : When the condition in step S7 is not satisfied, a calculation is made of a difference, ΔT3, between the interval from the next reference time point t'i+1 to the impulse position ti-1 and the decided interval from the impulse position ti-1 to ti-2.
Step S10 : The absolute value of the above-mentioned difference ΔT3 is compared with the value J. When the former is equal to or smaller than the latter, the reference time point t'i+1 is within an expected range of the impulse position ti next to the decided impulse position ti-1 and the reference time point t'i is outside the range and in between t'i+1 and ti-1. The process proceeds to step S11.
Step S11 : The excess reference time point t'i shown in FIG. 5B is discarded, but instead the reference time point t'i+1 is set at the impulse position ti and the process proceeds to step S5.
Step S12 : Where the condition in step S10 is not satisfied, a calculation is made of a difference ΔT4 between half of the interval between the reference time point t'i+1 and the impulse position ti-1 and the above-mentioned decided interval Ti-1.
Step S13 : The absolute value of the difference ΔT4 is compared with the value J. When the former is equal to or smaller than the latter, it means that the reference time point t'i+1 is within an expected range of the impulse position ti+1 next to that ti as shown in FIG. 5C and that the reference time point t'i is either one of two reference time points t'i shown in FIG. 5C and is outside an expected range of the impulse position ti. In this instance, the process proceeds to step S14.
Step S14 : The reference time point t'i+1 is set as the impulse position ti+1, and at the same time, the reference time point t'i is shifted to the midpoint between t'i+1 and ti-1 and set as the impulse position ti, that is, ti =(t'i+1 +ti-1)/2. The process proceeds to step S5.
Step S15 : Where the condition in step S14 is not satisfied, the reference time point t'i is set as the impulse position ti without taking any step for its inappropriateness as a pitch position. The process proceeds to step S5.
Step S16 : Where the preceding frame is an unvoiced sound frame in step S1, all the reference time points t'i in the current frame are set to the impulse positions ti.
Step S17 : The number of impulse positions is compared with a predetermined maximum permissible number of impulses Np, and if the former is equal to or smaller than the latter, then the entire processing is terminated. The number Np is a fixed integer ranging from 5 to 6, for example, and this is the number of impulses present in a 15 msec frame in the case where the upper limit of the pitch frequency of a speech is regarded as ranging from about 350 to 400 Hz at the highest.
Step S18 : Where the condition in step S17 is not satisfied, the number of impulse positions is greater than the number Np; so that magnitudes of impulses are calculated for the respective impulse positions by the impulse magnitude calculating part 8 in FIG. 1 as described later.
Step S19 : An impulse position selecting part 6A in FIG. 1 chooses Np impulse positions in the order of magnitude and indicates the chosen impulses to the impulse position generating part 6, with which the process is terminated.
According to the processed described above in respect of FIG. 4, even if the impulse position of the phase-equalized prediction residual which is detected as the reference time point t'i undergoes a substantial change, a fluctuation of the impulse position ti which is generated by the impulse position generating part 6 is limited within a certain range. Thus, the amount of information necessary for representing the impulse position can be reduced. Moreover, even in the case where the impulse magnitude at the pitch position in the phase-equalized prediction residual happens to be smaller than a threshold value and cannot be detected by the magnitude comparing part 38 in FIG. 2, an impulse signal is inserted by steps S7 and S8 in FIG. 4; so that the quality of the synthesized speech is not essentially impaired in spite of a failure in impulse detection.
In the impulse magnitude calculating part 8 the impulse magnitude at each impulse position ti generated by the impulse position generating part 6 is selected so that a frequency-weighted mean square error between a synthesized speech waveform Sp'(t) produced by exciting such an all-pole filter 18 with the impulse sequence created by the impulse sequence generating part 7 and an input speech waveform Sp(t) phase-equalized by a phase equalizing filter 5 may be eventually minimized. FIG. 6 shows the internal construction of the impulse magnitude calculating part 8. The phase-equalized input speech waveform Sp(t) is supplied to a frequency weighting filter processing part 39. The frequency weighting filter processing part 39 acts to expands the band width of the resonance frequency components of a speech spectrum and its transfer characteristic is expressed as follows: ##EQU5## where ai are the linear prediction coefficients and z-1 is a sampling delay. γ is a parameter which controls the degree of suppression and is in the range of 0<γ≦1, and the degree of suppression increases as the value of γ decreases. Usually, γ is in the range of 0.7 to 0.9.
The frequency weighting filter processing part 39 has such a construction as shown in FIG. 6A. The linear prediction coefficients ai are provided to a frequency weighting filter coefficient calculating part 39A, in which coefficients γi ai of a filter having a transfer characteristic A(z/γ) are calculated. A frequency weighting filter 39B calculates coefficients of a filter having a transfer characteristic Hw(z)=A(z)/A(z/γ), from the linear prediction coefficients ai and the frequency-weighted coefficients γi ai and at the same time, the phase-equalized speech Sp(t) is passed through the filter of that transfer characteristic to obtain a signal S'w(t).
A zero input response calculating part 39C uses, as an initial value, a synthesized speech S(t).sup.(n-1) obtained as the output of an all-pole filter 18A (see FIG. 1) of a transfer characteristic 1/A(z/γ) in the preceding frame and outputs an initial response when the all-pole filter 18A is excited by a zero input.
A target signal calculating part 39D subtracts the output of the zero input response calculating part 39C from the output S'w(t) of the frequency weighting filter 39B to obtain a frequency-weighted signal Sw(t). On the other hand, the output γi ai of the frequency weighting filter coefficient processing part 39A is supplied to an impulse response calculating part 40 in FIG. 6, in which an impulse response f(t) of a filter having the transfer characterized 1/A(z/γ) is calculated.
A correlation calculating part 41 calculates, for each impulse position ti, a cross correlation ψ(i) between the impulse response f(t-ti) and the frequency-weighted signal Sw(t) as follows: ##EQU6## where i=1, 2, . . . , np, np being the number of impulses in the frame and N the number of samples in the frame.
Another correlation calculating part 42 calculates a covariance φ(i, j) of the impulse response for a set of impulse positions ti, ti as follows: ##EQU7##
An impulse magnitude calculating part 43 obtains impulse magnitudes mi from ψ(t) and φ(i, j) by solving the following simultaneous equations, which equivalently minimize a mean square error between a synthesized speech waveform obtainable by exciting the all-pole filter 18 with the impulse sequence thus determined and the phase-equalized speech waveform Sp(t). ##EQU8## The impulse magnitudes mi are quantized by the quantizer 9 in FIG. 1 for each frame. This is carried out by, for example, a scalar quantization or vector quantization method. In the case of employing the vector u=quantization technique, a vector (a magnitude pattern) using respective impulse magnitudes mi as its elements is compared with a plurality of predetermined standard impulse magnitude patterns and is quantized to that one of them which minimizes the distance between the patterns. A measure of the distance between the magnitude patterns corresponds essentially to a mean square error between the speech waveform Sp'(t) synthesized, without using the zero filter, from the standard impulse magnitude pattern selected in the quantizer 9 and the phase-equalized input speech waveform Sp(t). For example, letting the magnitude pattern vector obtained by solving Eq. (11) be represented by m=(m1, m2, . . . , mnp) and letting standard pattern vectors stored as a table in the quantizer 9 be represented by mci (i=1, 2, . . . , Nc), the mean square error is given by the following equation:
d(m, mc)=(m-mci)t &#934;(m-mci)         (12)
where t represents the transposition of a matrix and Φ is a matrix using, as its elements, the auto-covariance φ(i, j) of the impulse response. In this case, the quantized value m of the above-mentioned magnitude pattern is expressed by the following equation, as a standard pattern which minimizes the mean square error d(m, mc) in Eq, (12) in the aforementioned plurality of standard pattern vectors mci. ##EQU9##
The zero filter 10 is to provide an input impulse sequence with a feature of the phase-equalized prediction residual waveform, and the coefficients of this filter are produced by a zero filter coefficient calculating part 11. FIG. 7A shows an example of the phase-equalized prediction residual waveform ep (t) and FIG. 7B an example of an impulse response waveform of the zero filter 10 for the input impulse thereto. The phase-equalized prediction residual ep (t) has a flat spectral envelope characteristic and a phase close to zero, and hence is impulsive and large in magnitude at impulse positions ti, ti+1, . . . but relatively small at other positions. The waveform is substantially symmetric with respect to each impulse position and each midpoint between adjacent impulse positions, respectively. In many cases, the magnitude at the midpoint is relatively larger than at other positions (except for impulse positions) as will be seen from FIG. 7A, and this tendency increases for a speech of a long pitch frequency, in particular. The zero filter 10 is set so that its impulse response assume values at successive q sample points on either side of the impulse position ti and at successive r sample points on either side of the midpoint between the adjacent impulse positions ti and ti+1, as depicted in FIG. 7B. In this instance, the transfer characteristic of the zero filter 10 is expressed as follows: ##EQU10##
In the zero filter coefficient calculating part 11, for an impulse sequence of given impulse positions and impulse magnitudes, filter coefficients vk are determined such that a frequency-weighted mean square error between the synthesized speech waveform Sp'(t) and the phase-equalized input speech waveform Sp(t) may be minimum. FIG. 8 illustrates the construction of the filter coefficient calculating part 11. A frequency weighting filter processing part 44 and an impulse response calculating part 45 are identical in construction with the frequency weighting filter processing part 39 and the impulse response calculating part 40 in FIG. 6, respectively. An adder 46 adds the output impulse response f(t) of the impulse response calculating part 45 in accordance with the following equation: ##EQU11## where l=q+r+1.
A correlation calculating part 47 calculates the cross-covariance φ(i) between the signals Sw(t) and ui (t), and another correlation calculating part 48 calculates the auto-covariance φ(i, j) between the signals ui (t) and uj (t). A filter coefficient calculating part 49 calculates coefficients vi of the zero filter 10 from the above-said cross correlation φ(i) and covariance φ(i, j) by solving the following simultaneous equations: ##EQU12## These solutions eventually minimize a mean square error between a synthesized speech waveform obtainable by exciting the all-pole filter 18 with the output of the zero filter 10 and the phase-equalized speech waveform Sp(t).
The filter coefficient vi is quantized by a quantizer 12 in FIG. 1. This is performed by use of a scalar quantization or vector quantization technique, for example. In the case of employing the vector quantization technique, a vector (a coefficient pattern) using the filter coefficients vi as its elements is compared with a plurality of predetermined standard coefficient patterns and is quantized to a standard pattern which minimizes the distance between patterns. If a measure essentially corresponding to the mean square error between the synthesized speech waveform Sp'(t) and the phase-equalized input speech waveform Sp(t) is used as the measure of distance as in the case of the vector quantization of the impulse magnitude by the aforementioned quantizer 9, the quantized value v of the filter coefficients is obtained by the following equation: ##EQU13## where v is a vector using, as its elements, coefficients v-q, v-q+1, . . . , vq+2r+1 obtained by solving Eq. (16), and vci is a standard pattern vector of the filter coefficients. Further, Φ is a matrix using as its elements the covariance φ(i, j) of the impulse response ui (t).
To sum up, in the voiced sound frame the speech signal Sp'(t) is synthesized by exciting an all-pole filter featuring the speech spectrum envelope characteristic, with a quasi-periodic impulse sequence which is determined by impulse positions based on the phase-equalized residual ep (t) and impulse magnitudes determined so that an error of the synthesized speech is minimum. Of the excitation parameters, the impulse magnitudes mi and the coefficients vi of the zero filter are set to optimum values which minimize the matching error between the synthesized speech waveform Sp'(t) and the phase-equalized speech waveform Sp(t).
Next, excitation in the unvoiced sound frame will be described. In the unvoiced sound frame a random pattern is used as an excitation signal as in the case of code excited linear predictive coding (Schroeder, et al., "Code excited linear prediction (CELP)", IEEE Int. On ASSP, pp 937-940, 1985). A random pattern generating part 13 in FIG. 1 has stored therein a plurality of patterns each composed of a plurality of normal random numbers with a mean 0 and a variance 1. A gain calculating part 15 calculates, for each random pattern, a gain gi which makes equal the power of the synthesized speech Sp'(t) by the output random pattern and the power of the phase-equalized speech Sp(t), and a scalar-quantized gain gi by a quantizer 16 is used to control an amplifier 14. Next, a matching error between a synthesized speech waveform Sp'(t) obtained by applying each of all the random patterns to the all-pole filter 18 and the phase-equalized speech Sp'(t) is obtained by the waveform matching error calculating part 19. The errors thus obtained are decided by the error deciding part 20 and the random pattern generating part 13 searches for an optimum random pattern which minimizes the waveform matching error. In this embodiment one frame is composed of three successive random patterns. This random pattern sequence is applied as the excitation signal to the all-pole filter 18 via the amplifier 14.
Following the above procedure, the speech signal is represented by the linear prediction coefficients ai and the voiced/unvoiced sound parameter VU; the voiced sound is represented by the impulse positions ti, the impulse magnitudes mi and zero filter coefficients vi, and the unvoiced sound is represented by the random number code pattern (number) ci and the gain gi. These parameters ai and VU produced by the linear predictive analyzing part 2, ti produced by the impulse position generating part 6, mi produced by the quantizer 9, vi produced by the quantizer 12, ci produced by the random pattern generator 13, and gi produced by the quantizer 16 are supplied to the coding part 21, as represented by the connections shown at the bottom of FIG. 1A and the top of FIG. 1B. These speech parameters are coded by the coding part 21 and then transmitted or stored. In a speech synthesizing part the speech parameters are decoded by a decoding part 22. In the case of the voiced sound, an impulse sequence composed of the impulse positions ti and the impulse magnitudes mi is produced in an impulse sequence generating part 23 and is applied to a zero filter 24 to create an excitation signal. In the case of the unvoiced sound, a random pattern is selectively generated by a random pattern generating part 25 using the random number code (signal) ci and is applied to an amplifier 26 which is controlled by the gain gi and in which it is magnitude-controlled to produce an excitation signal. Either one of the excitation signals thus produced is selected by a switch 27 which is controlled by the voiced/unvoiced parameter VU and the excitation signal thus selected is applied to an all-pole filter 28 to excite it, providing a synthesized speech at its output end 29. The filter coefficients of the zero filter 24 are controlled by vi and the filter coefficients of the all-pole filter 28 are controlled by ai.
In a third modified form, processing by the impulse magnitude calculating part 8 and processing by the vector quantizing part 9 in FIG. 1 are integrated for calculating a quantized value of the impulse magnitudes. FIG. 9 shows the construction of this modified form. A frequency weighting filter processing part 50, an impulse response calculating part 51, a correlation calculating part 52 and another correlation calculating part 53 are identical in construction with those in FIG. 6. In an impulse magnitude (vector) quantizing part 54, for each impulse standard pattern mci (where i=1, 2, . . . , Nc) from a PTN codebook 55, a mean square error between a speech waveform synthesized using the magnitude standard pattern and the phase-equalized input speech waveform Sp(t) is calculated, and an impulse magnitude standard pattern is obtained which minimizes the error. A distance calculation is performed by the following equation:
d=mci t &#934;mci -2mci t &#968;,
where Φ is a matrix using the covariance φ(i, j) of the impulse response f(t) as matrix elements and ψ is a column vector using, as its elements, the cross correlation ψ(i) (where i=1, 2, . . . , np) of the impulse response and the output Sw(t) of the frequency weighting filter processing part 50.
It is also possible to calculate quantized values of coefficients by integrating the calculation of the coefficients vi of the zero filter 10 and the vector quantization by the quantizer 12 in the same manner as mentioned above with respect to FIG. 9.
In a fourth modified form of the FIG. 1 embodiment, the impulse position generating part 6 is not provided, and consequently, processing shown in FIG. 4 is not involved, but instead all the reference time points t'i provided from the phase equalizing-analyzing part 4 are used as impulse positions ti. This somewhat increases the amount of information necessary for coding the impulse positions but simplifies the structure and speeds up the processing. Yet, the throughput for enhancing the quality of the synthesized speech by the use of the zero filter 10 may also be assigned for the reduction of the impulse position information at the expense of the speech quality.
To evaluate the effect of the speech analysis-synthesis method according to the present invention, experiments were conducted using the following conditions. After sampling a speech in a 0 to 4 kHz band at a sampling frequency 8 kHz, the speech signal is multiplied by a Hamming window of an analysis window 30 ms long and a linear predictive analysis by an auto-correlation method is performed with the degree of analysis set to 12, by which 12 prediction coefficients ai and the voiced/unvoiced sound parameter are obtained. The processing of the excitation parameter analyzing part 30 is performed for each frame 15 ms (120 speech samples) equal to half of the analysis window. The prediction coefficients are quantized by a differential multiple stage vector quantizing method. As a distance criterion in the vector quantization, a frequency weighted cepstrum distance was used. When the bit rate is 4.8 kb/s, the number of bits per frame is 72 bits and details are as follows:
______________________________________                  Number ofParameters             bits/Frame______________________________________Prediction coefficients                  24Voiced/unvoiced sound parameter                   1Excitation source (for voiced sound)Impulse positions      29Impulse magnitudes      8Zero filter coefficients                  10Excitation source (for unvoiced sound)Random patterns        27 (9 � 3)Gains                  18 ((5 + 1) � 3)______________________________________
The constant J representing the allowed limit of fluctuations in the impulse frequency in the impulse source, the allowed maximum number of impulses per frame, Np, and the allowed minimum value of impulse intervals, Lmin, are dependent on the number of bits assigned for coding of the impulse positions. In the case of coding the impulse positions at the rate of 29 bits/frame, it is preferable, for example, that the difference between adjacent impulse intervals, ΔT, be equal to or smaller than 5 samples, the maximum number of impulses, Np, be equal to or smaller than 6 samples, and the allowed minimum impulse interval Lmin be equal to or greater than 13 samples. A filter of degree 7 (q=r=1) was used as the zero filter 10. The random pattern vector ci is composed of 40 samples (5 ms) and is selected from 512 kinds of patterns (9-bit). The gain gi is scalar-quantized using 6 bits including a sign bit.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4771465 *Sep 11, 1986Sep 13, 1988American Telephone And Telegraph Company, At&T Bell LaboratoriesDigital speech sinusoidal vocoder with transmission of only subset of harmonicsUS4850022 *Oct 11, 1988Jul 18, 1989Nippon Telegraph And Telephone Public CorporationSpeech signal processing systemUS4868867 *Apr 6, 1987Sep 19, 1989Voicecraft Inc.Vector excitation speech or audio coder for transmission or storageUS4944013 *Apr 1, 1986Jul 24, 1990British Telecommunications Public Limited CompanyMulti-pulse speech coderUS4989250 *Feb 15, 1989Jan 29, 1991Sanyo Electric Co., Ltd.Speech synthesizing apparatus and methodUS5001759 *Sep 27, 1989Mar 19, 1991Nec CorporationMethod and apparatus for speech coding* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS5495556 *Jan 14, 1994Feb 27, 1996Nippon Telegraph And Telephone CorporationSpeech synthesizing method and apparatus thereforUS5522012 *Feb 28, 1994May 28, 1996Rutgers UniversitySpeaker identification and verification systemUS5553192 *Oct 12, 1993Sep 3, 1996Nec CorporationApparatus for noise removal during the silence periods in the discontinuous transmission of speech signals to a mobile unitUS5684920 *Mar 13, 1995Nov 4, 1997Nippon Telegraph And TelephoneAcoustic signal transform coding method and decoding method having a high efficiency envelope flattening method thereinUS5724480 *Oct 26, 1995Mar 3, 1998Mitsubishi Denki Kabushiki KaishaSpeech coding apparatus, speech decoding apparatus, speech coding and decoding method and a phase amplitude characteristic extracting apparatus for carrying out the methodUS5749065 *Aug 23, 1995May 5, 1998Sony CorporationSpeech encoding method, speech decoding method and speech encoding/decoding methodUS5920832 *Feb 12, 1997Jul 6, 1999U.S. Philips CorporationCELP coding with two-stage search over displaced segments of a one-dimensional codebookUS5940791 *May 9, 1997Aug 17, 1999Washington UniversityMethod and apparatus for speech analysis and synthesis using lattice ladder notch filtersUS5963897 *Feb 27, 1998Oct 5, 1999Lernout & Hauspie Speech Products N.V.Apparatus and method for hybrid excited linear prediction speech encodingUS5963898 *Jan 3, 1996Oct 5, 1999Matra CommunicationsAnalysis-by-synthesis speech coding method with truncation of the impulse response of a perceptual weighting filterUS5966690 *Jun 7, 1996Oct 12, 1999Sony CorporationSpeech recognition and synthesis systems which distinguish speech phonemes from noiseUS5978756 *Mar 28, 1996Nov 2, 1999Intel CorporationEncoding audio signals using precomputed silenceUS5978759 *Sep 21, 1998Nov 2, 1999Matsushita Electric Industrial Co., Ltd.Apparatus for expanding narrowband speech to wideband speech by codebook correspondence of linear mapping functionsUS6111181 *May 4, 1998Aug 29, 2000Texas Instruments IncorporatedSynthesis of percussion musical instrument soundsUS6256609May 11, 1998Jul 3, 2001Washington UniversityMethod and apparatus for speaker recognition using lattice-ladder filtersUS6304843 *Jan 5, 1999Oct 16, 2001Motorola, Inc.Method and apparatus for reconstructing a linear prediction filter excitation signalUS6603832 *Jan 16, 2001Aug 5, 2003Koninklijke Philips Electronics N.V.CELP coding with two-stage search over displaced segments of a one-dimensional codebookUS6871176Jul 26, 2001Mar 22, 2005Freescale Semiconductor, Inc.Phase excited linear prediction encoderUS7224747 *Jan 5, 2001May 29, 2007Koninklijke Philips Electronics N. V.Generating coefficients for a prediction filter in an encoderUS7233898Jun 4, 2002Jun 19, 2007Washington UniversityMethod and apparatus for speaker verification using a tunable high-resolution spectral estimatorUS7912711 *Sep 21, 2007Mar 22, 2011Sony CorporationMethod and apparatus for speech dataUS8064770 *Nov 22, 2011Tyco Electronics Subsea Communications LlcSystem and method for spectral loading an optical transmission systemUS8548804 *Oct 19, 2007Oct 1, 2013Psytechnics LimitedGenerating sample error coefficientsUS8583418Sep 29, 2008Nov 12, 2013Apple Inc.Systems and methods of detecting language and natural language strings for text to speech synthesisUS8595001 *Nov 7, 2011Nov 26, 2013At&T Intellectual Property Ii, L.P.System for bandwidth extension of narrow-band speechUS8600743Jan 6, 2010Dec 3, 2013Apple Inc.Noise profile determination for voice-related featureUS8614431Nov 5, 2009Dec 24, 2013Apple Inc.Automated response to and sensing of user activity in portable devicesUS8620662Nov 20, 2007Dec 31, 2013Apple Inc.Context-aware unit selectionUS8645137Jun 11, 2007Feb 4, 2014Apple Inc.Fast, language-independent method for user authentication by voiceUS8660849Dec 21, 2012Feb 25, 2014Apple Inc.Prioritizing selection criteria by automated assistantUS8670979Dec 21, 2012Mar 11, 2014Apple Inc.Active input elicitation by intelligent automated assistantUS8670985Sep 13, 2012Mar 11, 2014Apple Inc.Devices and methods for identifying a prompt corresponding to a voice input in a sequence of promptsUS8676904Oct 2, 2008Mar 18, 2014Apple Inc.Electronic devices with voice command and contextual data processing capabilitiesUS8677377Sep 8, 2006Mar 18, 2014Apple Inc.Method and apparatus for building an intelligent automated assistantUS8682649Nov 12, 2009Mar 25, 2014Apple Inc.Sentiment prediction from textual dataUS8682667Feb 25, 2010Mar 25, 2014Apple Inc.User profiling for selecting user specific voice input processing informationUS8688446Nov 18, 2011Apr 1, 2014Apple Inc.Providing text input using speech data and non-speech dataUS8706472Aug 11, 2011Apr 22, 2014Apple Inc.Method for disambiguating multiple readings in language conversionUS8706503Dec 21, 2012Apr 22, 2014Apple Inc.Intent deduction based on previous user interactions with voice assistantUS8712776Sep 29, 2008Apr 29, 2014Apple Inc.Systems and methods for selective text to speech synthesisUS8713021Jul 7, 2010Apr 29, 2014Apple Inc.Unsupervised document clustering using latent semantic density analysisUS8713119Sep 13, 2012Apr 29, 2014Apple Inc.Electronic devices with voice command and contextual data processing capabilitiesUS8718047Dec 28, 2012May 6, 2014Apple Inc.Text to speech conversion of text messages from mobile communication devicesUS8719006Aug 27, 2010May 6, 2014Apple Inc.Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesisUS8719014Sep 27, 2010May 6, 2014Apple Inc.Electronic device with text error correction based on voice recognition dataUS8731942Mar 4, 2013May 20, 2014Apple Inc.Maintaining context information between user interactions with a voice assistantUS8751238Feb 15, 2013Jun 10, 2014Apple Inc.Systems and methods for determining the language to use for speech generated by a text to speech engineUS8762156Sep 28, 2011Jun 24, 2014Apple Inc.Speech recognition repair using contextual informationUS8762469Sep 5, 2012Jun 24, 2014Apple Inc.Electronic devices with voice command and contextual data processing capabilitiesUS8768702Sep 5, 2008Jul 1, 2014Apple Inc.Multi-tiered voice feedback in an electronic deviceUS8775442May 15, 2012Jul 8, 2014Apple Inc.Semantic search using a single-source semantic modelUS8781836Feb 22, 2011Jul 15, 2014Apple Inc.Hearing assistance system for providing consistent human speechUS8799000Dec 21, 2012Aug 5, 2014Apple Inc.Disambiguation based on active input elicitation by intelligent automated assistantUS8812294Jun 21, 2011Aug 19, 2014Apple Inc.Translating phrases from one language into another using an order-based set of declarative rulesUS8862252Jan 30, 2009Oct 14, 2014Apple Inc.Audio user interface for displayless electronic deviceUS8892446Dec 21, 2012Nov 18, 2014Apple Inc.Service orchestration for intelligent automated assistantUS8898568Sep 9, 2008Nov 25, 2014Apple Inc.Audio user interfaceUS8903716Dec 21, 2012Dec 2, 2014Apple Inc.Personalized vocabulary for digital assistantUS8930191Mar 4, 2013Jan 6, 2015Apple Inc.Paraphrasing of user requests and results by automated digital assistantUS8935167Sep 25, 2012Jan 13, 2015Apple Inc.Exemplar-based latent perceptual modeling for automatic speech recognitionUS8942986Dec 21, 2012Jan 27, 2015Apple Inc.Determining user intent based on ontologies of domainsUS8977255Apr 3, 2007Mar 10, 2015Apple Inc.Method and system for operating a multi-function portable electronic device using voice-activationUS8977584Jan 25, 2011Mar 10, 2015Newvaluexchange Global Ai LlpApparatuses, methods and systems for a digital conversation management platformUS8996376Apr 5, 2008Mar 31, 2015Apple Inc.Intelligent text-to-speech conversionUS9053089Oct 2, 2007Jun 9, 2015Apple Inc.Part-of-speech tagging using latent analogyUS9075783Jul 22, 2013Jul 7, 2015Apple Inc.Electronic device with text error correction based on voice recognition dataUS9117447Dec 21, 2012Aug 25, 2015Apple Inc.Using event alert text as input to an automated assistantUS9190062Mar 4, 2014Nov 17, 2015Apple Inc.User profiling for voice input processingUS9262612Mar 21, 2011Feb 16, 2016Apple Inc.Device access using voice authenticationUS9280610Mar 15, 2013Mar 8, 2016Apple Inc.Crowd sourcing information to fulfill user requestsUS9300784Jun 13, 2014Mar 29, 2016Apple Inc.System and method for emergency calls initiated by voice commandUS9311043Feb 15, 2013Apr 12, 2016Apple Inc.Adaptive audio feedback system and methodUS9318108Jan 10, 2011Apr 19, 2016Apple Inc.Intelligent automated assistantUS9330720Apr 2, 2008May 3, 2016Apple Inc.Methods and apparatus for altering audio output signalsUS9338493Sep 26, 2014May 10, 2016Apple Inc.Intelligent automated assistant for TV user interactionsUS9361886Oct 17, 2013Jun 7, 2016Apple Inc.Providing text input using speech data and non-speech dataUS9368114Mar 6, 2014Jun 14, 2016Apple Inc.Context-sensitive handling of interruptionsUS9389729Dec 20, 2013Jul 12, 2016Apple Inc.Automated response to and sensing of user activity in portable devicesUS20010033616 *Jan 5, 2001Oct 25, 2001Rijnberg Adriaan JohannesGenerating coefficients for a prediction filter in an encoderUS20010044719 *May 21, 2001Nov 22, 2001Mitsubishi Electric Research Laboratories, Inc.Method and system for recognizing, indexing, and searching acoustic signalsUS20020116189 *Jun 19, 2001Aug 22, 2002Winbond Electronics Corp.Method for identifying authorized users using a spectrogram and apparatus of the sameUS20030055630 *Jun 4, 2002Mar 20, 2003Washington UniversityMethod and apparatus for a tunable high-resolution spectral estimatorUS20030074191 *Jun 4, 2002Apr 17, 2003Washington University, A Corporation Of The State Of MissouriMethod and apparatus for a tunable high-resolution spectral estimatorUS20030074192 *Jul 26, 2001Apr 17, 2003Hung-Bun ChoiPhase excited linear prediction encoderUS20040049380 *Nov 30, 2001Mar 11, 2004Hiroyuki EharaAudio decoder and audio decoding methodUS20060051093 *Aug 11, 2005Mar 9, 2006Massimo MannaSystem and method for spectral loading an optical transmission systemUS20080027720 *Sep 21, 2007Jan 31, 2008Tetsujiro KondoMethod and apparatus for speech dataUS20080106249 *Oct 19, 2007May 8, 2008Psytechnics LimitedGenerating sample error coefficientsUS20080129520 *Dec 1, 2006Jun 5, 2008Apple Computer, Inc.Electronic device with enhanced audio feedbackUS20090164441 *Dec 22, 2008Jun 25, 2009Adam CheyerMethod and apparatus for searching using an active ontologyUS20100312547 *Jun 5, 2009Dec 9, 2010Apple Inc.Contextual voice commandsUS20120116769 *May 10, 2012At&T Intellectual Property Ii, L.P.System for bandwidth extension of narrow-band speechUS20120309363 *Sep 30, 2011Dec 6, 2012Apple Inc.Triggering notifications associated with tasks items that represent tasks to performEP0998740A1 *May 11, 1998May 10, 2000Washington UniversityMethod and apparatus for speech analysis and synthesis using lattice-ladder filters* Cited by examinerClassifications U.S. Classification704/208, 704/219, 704/211, 704/E19.026International ClassificationG01L9/18, G10L19/08Cooperative ClassificationG10L19/08European ClassificationG10L19/08Legal EventsDateCodeEventDescriptionApr 22, 1997FPAYFee paymentYear of fee payment: 4Aug 30, 2001FPAYFee paymentYear of fee payment: 8Sep 21, 2005REMIMaintenance fee reminder mailedMar 8, 2006LAPSLapse for failure to pay maintenance feesMay 2, 2006FPExpired due to failure to pay maintenance feeEffective date: 20060308RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services