Abstract:
Stereo echo cancellation is necessary to overcome the objections observed by, for example, teleconferencing, voice controlled video/audio apparatuses, etc. To improve the existing filters, an adaptive filter is used along with a signal processing device which obtain the coefficient updates in the transformed domain, reducing the required calculation complexity. Further, the filter includes circuitry for reducing the correlation between the input signals on the coefficient updates.

Description:
BACKGROUND OF THE INVENTION 
   1. Field of the Invention 
   The invention relates to a filter comprising at least two inputs for receiving at least two signals, and an output for supplying an output signal. 
   The invention further relates to a signal processing device comprising such a filter. 
   The invention further relates to a teleconferencing system, a voice-controlled electronic device, and a noise cancellation system. 
   The invention further relates to a method for filtering at least two signals and for supplying an output signal. 
   Recent developments in audio and video systems require the use of multiple channel processing and reproduction with acoustic echo cancellers (AEC) and noise cancellers. For example in mini-group video conferencing systems, multiple channel transmission leads to a better “localization” of the diverse people in the room. This enhances the intelligibility and naturalness of the speech. 
   Further, multiple channel echo cancellation is needed in voice-controlled stereo audio and video equipment, such as television receivers, radio receivers, CD players, etc. 
   A multiple channel AEC can, in general, not be created by a simple combination of multiple single channel AEC&#39;s. 
   2. Description of the Related Art 
   U.S. Pat. No. 5,828,756 discloses a stereophonic communication system, such as a teleconferencing system, which involves selectively reducing the correlation between the individual channel signals of the stereophonic system. Herein, non-linearities are added to the input signals to reduce the correlation. However by adding these non-linearities, audible artifacts in the output signals are introduced. These non-linearities can (sometimes) be accepted in teleconferencing systems but are certainly not acceptable in other applications, such as supplying music, etc. 
   SUMMARY OF THE INVENTION 
   It is, inter alia, an object of the invention to provide a filter, which overcomes the objections of the prior art. To this end a first aspect of the invention provides a filter described in the opening paragraph, characterized in that the coefficient updates are determined in a transformed domain, and the filter comprises means for reducing the effect of correlation between the input signals on the coefficient updates. 
   Herewith, the performance of the adaptive filters is improved without a huge increase in computational complexity. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
     The invention and additional features, which may be optionally used to implement the invention to advantage, will be apparent from and elucidated with references to the examples described below, hereinafter and shown in the accompanying drawings, in which: 
       FIG. 1  schematically shows the multiple input adaptive FIR filter, according to the invention; 
       FIG. 2  schematically shows the calculation of the output of the FIR filter, according to the invention; 
       FIG. 3  schematically shows the calculation of Y in the Multiple Input Partitioned Frequency Domain adaptive filter, according to the invention for the case with direct inverse power estimation; 
       FIG. 4  schematically shows the calculation of the coefficient vectors  w   i  according to the invention; 
       FIG. 5  shows a schematic example of a stereo echo cancellation in a teleconferencing system according to the invention, 
       FIG. 6  shows a more detailed schematic example of a teleconferencing system according to the invention; 
       FIG. 7  shows a schematic example of a voice controlled device according to the invention; 
       FIG. 8  shows a schematic example of a noise canceller according to the invention; and 
       FIG. 9  schematically shows the determining of the input channel&#39;s power matrix. 
   

   DESCRIPTION OF THE PREFERRED EMBODIMENTS 
   In the description, the equations, matrices, etc., are shown as described below. Signals are denoted by lower case characters, constants by upper case. Underlining is used for vectors, lower case for time domain, and upper case for frequency domain. Matrices are denoted by bold face upper case, e.g., I. The dimension is put in superscript (e.g., the B×Q matrix X is given by X B,Q , for a square matrix the second dimension is omitted). Diagonal matrices are denoted by a double underline, e.g.,  P , with its diagonal denoted as  P =diag { P }. A subscript i, e.g., w i , denotes the i&#39;th version. The k&#39;th element of  w  is given by ( w ) k . Finally, appending [k] denotes the time index, (.) t  denotes the transpose, (.)* denotes the complex conjugate, and (.) h  denotes the Hermitain transpose (complex conjugate transpose). 
   A general multiple input adaptive FIR filter, depicted in  FIG. 1 , uses the S signals x 0  [k] to x s−1 [k] to remove unwanted components correlated with these signals in the signal e[k]. The signals x 0  [k] to x s−1 [k] are input to S FIR-filters W 0  to W s−1 , with outputs ê 0 [k] to ê s−1 [k]. The goal of the update algorithm is to adapt the coefficients of the FIR filters in such a way that the correlation between r[k] and the input signals x 0  [k] and x s−1 [k] is removed. 
   For S&gt;a≧0, the FIR filter W a  performs the convolution of the signal x a [k] and the coefficients w a,0 [k] . . . w a,N−1 [k] of that filter. The output signal ê a [k] of such a filter can be described as follows 
                             e   ^     a     ⁡     [   k   ]       =       ∑     i   =   0       N   -   1       ⁢           ⁢         x   a     ⁡     [     k   -   i     ]       ·       w     a   ,   i       ⁡     [   k   ]                       =         (         x   _     a   N     ⁡     [   k   ]       )     t     ·         w   _     a   N     ⁡     [   k   ]                       (   1   )               
With, for S&gt;a≧0,
 
   
     
       
         
           
             
               
                 
                   
                     
                       x 
                       _ 
                     
                     a 
                     N 
                   
                   ⁡ 
                   
                     [ 
                     k 
                     ] 
                   
                 
                 = 
                 
                   ( 
                   
                     
                       
                         
                           
                             x 
                             a 
                           
                           ⁡ 
                           
                             [ 
                             
                               k 
                               - 
                               N 
                               + 
                               1 
                             
                             ] 
                           
                         
                       
                     
                     
                       
                         ⋮ 
                       
                     
                     
                       
                         
                           
                             x 
                             a 
                           
                           ⁡ 
                           
                             [ 
                             
                               k 
                               - 
                               1 
                             
                             ] 
                           
                         
                       
                     
                     
                       
                         
                           
                             x 
                             a 
                           
                           ⁡ 
                           
                             [ 
                             k 
                             ] 
                           
                         
                       
                     
                   
                   ) 
                 
               
             
             
               
                 ( 
                 2 
                 ) 
               
             
           
           
             
               
                 
                   
                     
                       w 
                       _ 
                     
                     a 
                     N 
                   
                   ⁡ 
                   
                     [ 
                     k 
                     ] 
                   
                 
                 = 
                 
                   
                     ( 
                     
                       
                         
                           
                             
                               w 
                               
                                 a 
                                 , 
                                 
                                   N 
                                   - 
                                   1 
                                 
                               
                             
                             ⁡ 
                             
                               [ 
                               k 
                               ] 
                             
                           
                         
                       
                       
                         
                           ⋮ 
                         
                       
                       
                         
                           
                             
                               w 
                               
                                 a 
                                 , 
                                 1 
                               
                             
                             ⁡ 
                             
                               [ 
                               k 
                               ] 
                             
                           
                         
                       
                       
                         
                           
                             
                               w 
                               
                                 a 
                                 , 
                                 0 
                               
                             
                             ⁡ 
                             
                               [ 
                               k 
                               ] 
                             
                           
                         
                       
                     
                     ) 
                   
                   . 
                 
               
             
             
               
                 ( 
                 3 
                 ) 
               
             
           
         
       
     
   
   The output of the multiple input adaptive filter is given by 
   
     
       
         
           
             
               
                 
                   r 
                   ⁡ 
                   
                     [ 
                     k 
                     ] 
                   
                 
                 = 
                 
                   
                     e 
                     ⁡ 
                     
                       [ 
                       k 
                       ] 
                     
                   
                   - 
                   
                     
                       ∑ 
                       
                         a 
                         = 
                         0 
                       
                       
                         S 
                         - 
                         1 
                       
                     
                     ⁢ 
                     
                         
                     
                     ⁢ 
                     
                       
                         
                           
                             e 
                             ^ 
                           
                           a 
                         
                         ⁡ 
                         
                           [ 
                           k 
                           ] 
                         
                       
                       . 
                     
                   
                 
               
             
             
               
                 ( 
                 4 
                 ) 
               
             
           
         
       
     
   
   These filter parts of the separate (adaptive) filters W 0  until W S−1  can be implemented efficiently in frequency domain with help of partitioning, block processing and Discrete Fourier Transforms (DFTs). A reduction in computational complexity is obtained since the convolutions per sample in the time domain transform to element-wise multiplications per block in the frequency domain. We use block processing with block length B and DFTs of length M, with M≧N+B−1. The transformation of the input signals can be described for S&gt;a≧0 by 
                         X   _     a   M     ⁡     [     k   ⁢           ⁢   B     ]       =       F   M     ·     (             x   a     ⁡     [       k   ⁢           ⁢   B     -   M   +   1     ]               ⋮               x   a     ⁡     [     k   ⁢           ⁢   B     ]             )         ,           (   5   )               
where F M  is the M×M Fourier matrix. The (a,b)&#39;th element (for 0≦a&lt;M,0≦b&lt;M) of the Fourier matrix is given by
 
                     (     F   M     )       a   ,   b       =     ⅇ   ⁢         -   j2π     ⁢           ⁢   a   ⁢           ⁢   b     M               (   6   )               
where j=√{square root over (−1)}.
 
   The filter can then be computed in the frequency domain, by 
                             e   ^     _     ⁡     [     k   ⁢           ⁢   B     ]       =       (     0   ⁢           ⁢     I   B       )     ⁢       ∑     a   =   0       S   -   1       ⁢           ⁢             X   _     _     a   M     ⁡     [     k   ⁢           ⁢   B     ]       ⁢         W   _     a   M     ⁡     [     k   ⁢           ⁢   B     ]                         =       (             e   ^     ⁡     [       k   ⁢           ⁢   B     -   B   +   1     ]               ⋮               e   ^     ⁡     [     k   ⁢           ⁢   B     ]             )     .                   (   7   )               
Note that the frequency domain filter coefficients are related to the time domain coefficients, for all S&gt;a≧0 this can be denoted by
 
   
     
       
         
           
             
               
                 
                   
                     
                       W 
                       _ 
                     
                     a 
                     M 
                   
                   ⁡ 
                   
                     [ 
                     l 
                     ] 
                   
                 
                 = 
                 
                   
                     F 
                     M 
                   
                   · 
                   
                     
                       ( 
                       
                         
                           
                             
                               
                                 w 
                                 a 
                               
                               , 
                               
                                 0 
                                 ⁡ 
                                 
                                   [ 
                                   l 
                                   ] 
                                 
                               
                             
                           
                         
                         
                           
                             
                               
                                 w 
                                 a 
                               
                               , 
                               
                                 1 
                                 ⁡ 
                                 
                                   [ 
                                   l 
                                   ] 
                                 
                               
                             
                           
                         
                         
                           
                             ⋮ 
                           
                         
                         
                           
                             
                               
                                 w 
                                 
                                   a 
                                   , 
                                   
                                     N 
                                     - 
                                     1 
                                   
                                 
                               
                               ⁡ 
                               
                                 [ 
                                 l 
                                 ] 
                               
                             
                           
                         
                         
                           
                             
                               0 
                               _ 
                             
                           
                         
                       
                       ) 
                     
                     . 
                   
                 
               
             
             
               
                 ( 
                 8 
                 ) 
               
             
           
         
       
     
   
   To obtain an efficient implementation, the block length B must be chosen in the same order as the filter length N, which results a large processing delay. 
   To reduce the processing delay, the filter can be partitioned into smaller pieces of length B, and with g=┌N/B┐, we get the implementation of  FIG. 2 , that can be described by 
   
     
       
         
           
             
               
                 
                   
                     
                       
                         
                           
                             e 
                             ^ 
                           
                           _ 
                         
                         ⁡ 
                         
                           [ 
                           
                             k 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             B 
                           
                           ] 
                         
                       
                       = 
                         
                       ⁢ 
                       
                         
                           ( 
                           
                             0 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               I 
                               B 
                             
                           
                           ) 
                         
                         ⁢ 
                         
                           
                             ∑ 
                             
                               a 
                               = 
                               0 
                             
                             
                               S 
                               - 
                               1 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 1 
                               
                               g 
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               
                                 
                                   
                                     
                                       X 
                                       _ 
                                     
                                     _ 
                                   
                                   a 
                                   M 
                                 
                                 ⁡ 
                                 
                                   [ 
                                   
                                     
                                       ( 
                                       
                                         k 
                                         - 
                                         i 
                                       
                                       ) 
                                     
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     B 
                                   
                                   ] 
                                 
                               
                               ⁢ 
                               
                                 
                                   
                                     W 
                                     _ 
                                   
                                   
                                     a 
                                     , 
                                     i 
                                   
                                   M 
                                 
                                 ⁡ 
                                 
                                   [ 
                                   
                                     k 
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     B 
                                   
                                   ] 
                                 
                               
                             
                           
                         
                       
                     
                   
                 
                 
                   
                     
                       
                         with 
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           
                             
                               W 
                               _ 
                             
                             
                               a 
                               , 
                               i 
                             
                             M 
                           
                           ⁡ 
                           
                             [ 
                             l 
                             ] 
                           
                         
                       
                       = 
                         
                       ⁢ 
                       
                         
                           F 
                           M 
                         
                         · 
                         
                           
                             ( 
                             
                               
                                 
                                   
                                     
                                       w 
                                       
                                         a 
                                         , 
                                         
                                           i 
                                           ⁢ 
                                           
                                               
                                           
                                           ⁢ 
                                           B 
                                         
                                       
                                     
                                     ⁡ 
                                     
                                       [ 
                                       l 
                                       ] 
                                     
                                   
                                 
                               
                               
                                 
                                   
                                     
                                       w 
                                       
                                         a 
                                         , 
                                         
                                           
                                             i 
                                             ⁢ 
                                             
                                                 
                                             
                                             ⁢ 
                                             B 
                                           
                                           + 
                                           1 
                                         
                                       
                                     
                                     ⁡ 
                                     
                                       [ 
                                       l 
                                       ] 
                                     
                                   
                                 
                               
                               
                                 
                                   ⋮ 
                                 
                               
                               
                                 
                                   
                                     
                                       w 
                                       
                                         a 
                                         , 
                                         
                                           
                                             i 
                                             ⁢ 
                                             
                                                 
                                             
                                             ⁢ 
                                             B 
                                           
                                           + 
                                           B 
                                           - 
                                           1 
                                         
                                       
                                     
                                     ⁡ 
                                     
                                       [ 
                                       l 
                                       ] 
                                     
                                   
                                 
                               
                               
                                 
                                   
                                     0 
                                     _ 
                                   
                                 
                               
                             
                             ) 
                           
                           . 
                         
                       
                     
                   
                 
               
             
             
               
                 ( 
                 9 
                 ) 
               
             
           
         
       
     
   
   For the update part of the filter, one can use S separate update algorithms to improve convergence behavior the input signals can be decorrelated separately in the time domain by using RLS like algorithms, leading to a huge computational complexity. Complexity reduction can be obtained by implementation in the frequency domain with (partitioned) Block Frequency Domain Adaptive Filters, as described in G. P. M. Egelmeers,  Real time realization of large adaptive filters , Ph.D. thesis, Eindhoven University of Technology, Eindhoven (The Netherlands), November 1995. When there is correlation between the input signals of the filters, this might still lead to very bad convergence behavior, due to the non-uniqueness problem. 
   In this application, it is proposed to use a partitioned algorithm in the frequency domain that reduces the effect of the cross-correlation between the input signals on the algorithm&#39;s convergence behavior. To reduce complexity, block processing, with block length A to compute the sum of A consecutive updates with each iteration, is used. For S&gt;a≧0, the coefficient vectors  w   a   N [lA] are partitioned into g u  parts of length Z with g u =┌N/Z┐ such that, for S&gt;j≧0 
                 w   _     j   N     ⁡     [     l   ⁢           ⁢   A     ]       =     (               w   _       j   ,       g   ⁢           ⁢   u     -   1       Z     ⁡     [     l   ⁢           ⁢   A     ]               ⋮                 w   _       j   ,   1     Z     ⁡     [     l   ⁢           ⁢   A     ]                     w   _       j   ,   0     Z     ⁡     [     l   ⁢           ⁢   A     ]             )           
with for S&gt;j≧0 and g u &gt;i≧0
 
                 w   _       j   ,   i     Z     ⁡     [   lA   ]       =       (           ⁢             w     j   ,     iZ   +   Z   -   1         ⁡     [   lA   ]               ⋮               w     j   ,     iZ   +   1         ⁡     [   lA   ]                   w     j   ,   iZ       ⁡     [   lA   ]             ⁢           )     .           
A Fourier transform length L is used with L≧Z+A−1, we define the input signal Fourier transforms for S&gt;a≧0 as
 
                 X   _     a   L     ⁡     [   lA   ]       =         F   L     ·         x   _     a   L     ⁡     [   lA   ]         =         F   L     (           ⁢             x   a     ⁡     [     lA   -   L   +   1     ]               ⋮               x   a     ⁡     [     lA   -   1     ]                   x   a     ⁡     [   lA   ]             ⁢           )     .             
The diagonal matrices  X   a   L [lA] contain the vector  X   a   L [lA] as main diagonal, so for S&gt;a≧0
     X     a   L   [lA ]=diag{   X     a   L   [lA]}.    
An overlap-save method is used to compute the correlation involved in the adaptation process in the frequency domain, the frequency domain transform of the residual signal vector equals
 
                 R   _     L     ⁡     [   lA   ]       =       F   L     ·       (             0   _       L   -   A                     r   _     A     ⁡     [   lA   ]             )     .             
The set of update equations for the filter coefficients in the MFDAF (Multiple Input Frequency Domain Adaptive Filter) algorithm can now be defined for g u &gt;i≧0 by
 
             (           ⁢               w   _         S   -   1     ,   i     Z     ⁡     [       (     l   +   1     )     ⁢   A     ]               ⋮                 w   _       1   ,   i     Z     ⁡     [       (     l   +   1     )     ⁢   A     ]                     w   _       0   ,   i     Z     ⁡     [       (     l   +   1     )     ⁢   A     ]             ⁢           )     =       (           ⁢               w   _         S   -   1     ,   i     Z     ⁡     [   lA   ]               ⋮                 w   _       1   ,   i     Z     ⁡     [   lA   ]                     w   _       0   ,   i     Z     ⁡     [   lA   ]             ⁢           )     +       G       S   .   Z     ,     S   .   L         ·     (           ⁢             (           Y   _     _       S   -   1     L     ⁡     [     (     lA   -   iZ     )     ]       )     *             ⋮               (           Y   _     _     1   L     ⁡     [     (     lA   -   iZ     )     ]       )     *                 (           Y   _     _     0   L     ⁡     [     (     lA   -   iZ     )     ]       )     *           ⁢           )     ·         R   _     L     ⁡     [   lA   ]                 
with
 
             (           ⁢             (           Y   _     _       S   -   1     L     ⁡     [   lA   ]       )     *             ⋮               (           Y   _     _     1   L     ⁡     [   lA   ]       )     *                 (           Y   _     _     0   L     ⁡     [   lA   ]       )     *           ⁢           )     =     2   ⁢         α   ⁡     (       P     S   .   L       ⁡     [   lA   ]       )         -   1       ·     (           ⁢             (           X   _     _       S   -   1     L     ⁡     [   lA   ]       )     *             ⋮               (           X   _     _     1   L     ⁡     [   lA   ]       )     *                 (           X   _     _     0   L     ⁡     [   lA   ]       )     *           ⁢           )               
and the transformation matrix G S.Z,S.L  is given by
 
             G       S   .   Z     ,     S   .   L         (           ⁢           G     Z   ,   L             0     Z   ,   L           ⋯         0     Z   ,   L                 0     Z   ,   L           ⋱       ⋱       ⋮           ⋮       ⋱       ⋱         0     Z   ,   L                 0     Z   ,   L           ⋯         0     Z   ,   L             G     Z   ,   L             ⁢           )         
with
   G   Z,L =( J   Z 0 Z,L-Z )( F   L ) −1 . 
The input channel&#39;s power matrix P S.L  [lA] is defined by
 
                     P     S   .   L       ⁡     [   lA   ]       =       ⁢       1   L     ⁢     {       (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     *     .       (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     t         }                   =       ⁢       1   L     ⁢     (           ⁢           ɛ   ⁢     {       (           X   _     _       S   -   1     L     ⁡     [   lA   ]       )     *           X   _     _       S   -   1     L     ⁡     [   lA   ]         }           ⋯         ɛ   ⁢     {       (           X   _     _       S   -   1     L     ⁡     [   lA   ]       )     *           X   _     _     0   L     ⁡     [   lA   ]         }               ⋮       ⋰       ⋮             ɛ   ⁢     {       (           X   _     _     0   L     ⁡     [   lA   ]       )     *           X   _     _       S   -   1     L     ⁡     [   lA   ]         }           ⋯         ɛ   ⁢     {       (           X   _     _     0   L     ⁡     [   lA   ]       )     *           X   _     _     0   L     ⁡     [   lA   ]         }             ⁢           )                   
where
 
               X       S   .   L     ,   L       ⁡     [   lA   ]       =       (           ⁢                 X   _     _       S   -   1     L     ⁡     [   lA   ]               ⋮                   X   _     _     1   L     ⁡     [   lA   ]                       X   _     _     0   L     ⁡     [   lA   ]             ⁢           )     .           
The expectation operator ε { } of the above equation has to be replaced by an estimation routine.
 
   The power matrix P S.L  [lA] can be estimated by 
   
     
       
         
           
             
               
                 
                   
                     P 
                     
                       S 
                       . 
                       L 
                     
                   
                   ⁡ 
                   
                     [ 
                     lA 
                     ] 
                   
                 
                 = 
                 
                   
                     
                       ( 
                       
                         1 
                         - 
                         γ 
                       
                       ) 
                     
                     ⁢ 
                     
                       
                         P 
                         
                           S 
                           . 
                           L 
                         
                       
                       ⁡ 
                       
                         [ 
                         
                           
                             ( 
                             
                               l 
                               - 
                               1 
                             
                             ) 
                           
                           ⁢ 
                           A 
                         
                         ] 
                       
                     
                   
                   + 
                   
                     
                       γ 
                       L 
                     
                     ⁢ 
                     
                       
                         
                           ( 
                           
                             
                               X 
                               
                                 
                                   S 
                                   . 
                                   L 
                                 
                                 , 
                                 L 
                               
                             
                             ⁡ 
                             
                               [ 
                               lA 
                               ] 
                             
                           
                           ) 
                         
                         * 
                       
                       · 
                       
                         
                           ( 
                           
                             
                               X 
                               
                                 
                                   S 
                                   . 
                                   L 
                                 
                                 , 
                                 L 
                               
                             
                             ⁡ 
                             
                               [ 
                               lA 
                               ] 
                             
                           
                           ) 
                         
                         t 
                       
                     
                   
                 
               
             
             
               
                 ( 
                 10 
                 ) 
               
             
           
         
       
     
   
   To reduce the number of multiplications, the step-size parameter α of equation is incorporated in the above power estimation routine by defining 
                     P   α     S   .   L       ⁡     [   lA   ]       =       1     2   ⁢   α       ⁢       P     S   .   L       ⁡     [   lA   ]                 (   11   )               
so
 2 a ( P   SL [lA]) −1 =( P   a   SL [lA]) −1   (12) 
Estimation of the power matrix P a   S.L [lA] can then be done by
 
                     P   α     S   .   L       ⁡     [   lA   ]       =         (     1   -   γ     )     ·       P   α     S   .   L       ⁡     [       (     l   -   1     )     ⁢   A     ]         +       γ     2   ⁢   α   ⁢           ⁢   L       ·       (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     *     ·         (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     t     .                 (   13   )               
Direct application of this algorithm leads to stability problems. When the input signal power in a certain frequency bin is very small, the power in that bin will decrease to a (very) small value. The inverse of the matrix will then have large values and will be inaccurate (due to numerical and estimation errors) In the ideal case, the eigenvalues of the power matrix estimate cancel the eigenvalues of the input signal power matrix. Due to estimation errors, this goal is only approximated, and the mismatch introduces a deviation from the ideal convergence behavior and might even lead to instability. Especially when some of the eigenvalues of the estimate of the inverse power matrix get large, and do not (exactly) cancel a (small) eigenvalue of the input signal power matrix, instability might occur. A lower limit to the eigenvalues of the estimate of the power matrix can solve this problem. In the single channel case (or when we forget the cross-terms), we can solve this problem by applying a lower limit to the lower values. We can do this because the eigenvalues of a diagonal matrix are equal to the elements of the diagonal, so we actually limit the eigenvalues. In the multiple channel case we also have to limit the eigenvalues to assure stability, but these no longer equal the elements on the diagonal.
 
   We know, however, that all eigenvalues of the power matrix are positive. We can now create a lower limit on the eigenvalues by shifting them by the suggested minimum. We know that for all eigenvalues λ of a matrix A, the determinant of A+(P min −λ′)·I must be zero. So for all λ′, eigenvalue of A+P min ·I, there must be a λ, eigenvalue of A, such that λ′=λ+P min  (and the other way around). This means that by adding a constant P min  to the main diagonal of a matrix, all eigenvalues of that matrix are shifted by P min ). So we define: 
               P     α   ,   lim       S   .   L       ⁡     [   lA   ]       =         P   α     S   .   L       ⁡     [   lA   ]       ⁢         P   min       2   ⁢   α       ·     I     S   .   L                 
which results in
 
               P     α   ,   lim       S   .   L       ⁡     [   lA   ]       =         (     1   -   γ     )     ·       P     α   ,   lim       S   .   L       ⁡     [       (     l   -   1     )     ⁢   A     ]         +     γ   ·     
     ⁢       (         1     2   ⁢   α   ⁢           ⁢   L       ·       (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     *     ·       (       X       S   .   L     ,   L       ⁡     [   lA   ]       )     t       +         P   min       2   ⁢   α       ·     I     S   .   L           )     .               
This is shown in  FIG. 9  of the drawings.
 
   The effect of this shifting of the eigenvalues on the (theoretical ideal) convergence behavior of the algorithm will be very small, and in practice the algorithm is much more stable. 
   Although P a,lim   S.L [lA] is a sparse matrix, computing its inverse would still require L inversions of S×S matrices, which takes on the order of L·S 3  operations. As we, however, do not need the inverse itself, but only its matrix-vector product with the input signals, we can also look at it as solving the system 
                 P     α   ,   lim       S   .   L       ⁡     [   lA   ]       ·     (           ⁢                   Y   _     _       S   -   1     L     ⁡     [   lA   ]       *             ⋮                     Y   _     _     1   L     ⁡     [   lA   ]       *                       Y   _     _     0   L     ⁡     [   lA   ]       *           ⁢           )       =       (           ⁢                   X   _     _       S   -   1     L     ⁡     [   lA   ]       *             ⋮                     X   _     _     1   L     ⁡     [   lA   ]       *                       X   _     _     0   L     ⁡     [   lA   ]       *           ⁢           )     .           
which requires on the order of L·S 2  operations. Another option is to estimate the inverse of P S.L [lA] directly, which also results in a number of operations proportional to L·S 2 . However, also in this case, we have to limit the eigenvalues to assure stability.
 
   A simple algorithm is given by: 
               (       P     S   ·   L       ⁡     [   lA   ]       )       -   1       =         (     1   +   γ     )     ·       (       P     S   ·   L       ⁡     [       (     l   -   1     )     ⁢   A     ]       )       -   1         -       γ   L     ⁢         Q       S   ·   L     ,   L       ⁡     [   lA   ]       ·       (       Q       S   ·   L     ,   L       ⁡     [   lA   ]       )     h                 
with
 
   
     
       
         
           
             
               
                 
                   
                     Q 
                     
                       
                         S 
                         · 
                         L 
                       
                       , 
                       L 
                     
                   
                   ⁡ 
                   
                     [ 
                     lA 
                     ] 
                   
                 
                 = 
                 
                   
                     
                       
                         ( 
                         
                           
                             P 
                             
                               S 
                               · 
                               L 
                             
                           
                           ⁡ 
                           
                             [ 
                             
                               l 
                               - 
                               
                                 1 
                                 ⁢ 
                                 A 
                               
                             
                             ] 
                           
                         
                         ) 
                       
                       
                         - 
                         1 
                       
                     
                     ⁢ 
                     
                       ( 
                       
                         
                           
                             
                               
                                 
                                   
                                     
                                       X 
                                       _ 
                                     
                                     _ 
                                   
                                   
                                     S 
                                     - 
                                     1 
                                   
                                   L 
                                 
                                 ⁡ 
                                 
                                   [ 
                                   lA 
                                   ] 
                                 
                               
                               * 
                             
                           
                         
                         
                           
                             ⋮ 
                           
                         
                         
                           
                             
                               
                                 
                                   
                                     
                                       X 
                                       _ 
                                     
                                     _ 
                                   
                                   1 
                                   L 
                                 
                                 ⁡ 
                                 
                                   [ 
                                   lA 
                                   ] 
                                 
                               
                               * 
                             
                           
                         
                         
                           
                             
                               
                                 
                                   
                                     
                                       
                                         X 
                                         _ 
                                       
                                       _ 
                                     
                                     0 
                                     L 
                                   
                                   ⁡ 
                                   
                                     [ 
                                     lA 
                                     ] 
                                   
                                 
                                 * 
                               
                               ⁢ 
                               
                                   
                               
                             
                           
                         
                       
                       ) 
                     
                   
                   = 
                   
                     
                       
                         ( 
                         
                           
                             P 
                             
                               S 
                               · 
                               L 
                             
                           
                           ⁡ 
                           
                             [ 
                             
                               l 
                               - 
                               A 
                             
                             ] 
                           
                         
                         ) 
                       
                       
                         - 
                         1 
                       
                     
                     · 
                     
                       
                         ( 
                         
                           
                             X 
                             
                               
                                 S 
                                 · 
                                 L 
                               
                               , 
                               L 
                             
                           
                           ⁡ 
                           
                             [ 
                             lA 
                             ] 
                           
                         
                         ) 
                       
                       * 
                     
                   
                 
               
             
             
               
                 ( 
                 14 
                 ) 
               
             
           
         
       
     
   
   We can incorporate α, which results in 
   
     
       
         
           
             
               ( 
               
                 
                   P 
                   α 
                   
                     S 
                     · 
                     L 
                   
                 
                 ⁡ 
                 
                   [ 
                   lA 
                   ] 
                 
               
               ) 
             
             
               - 
               1 
             
           
           = 
           
             
               
                 ( 
                 
                   1 
                   + 
                   γ 
                 
                 ) 
               
               · 
               
                 
                   ( 
                   
                     
                       P 
                       α 
                       
                         S 
                         · 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       
                         
                           ( 
                           
                             l 
                             - 
                             1 
                           
                           ) 
                         
                         ⁢ 
                         A 
                       
                       ] 
                     
                   
                   ) 
                 
                 
                   - 
                   1 
                 
               
             
             - 
             
               
                 γ 
                 
                   2 
                   ⁢ 
                   
                       
                   
                   ⁢ 
                   α 
                   ⁢ 
                   
                       
                   
                   ⁢ 
                   L 
                 
               
               ⁢ 
               
                 
                   
                     Q 
                     
                       
                         S 
                         · 
                         L 
                       
                       , 
                       L 
                     
                   
                   ⁡ 
                   
                     [ 
                     lA 
                     ] 
                   
                 
                 · 
                 
                   
                     
                       ( 
                       
                         
                           Q 
                           
                             
                               S 
                               · 
                               L 
                             
                             , 
                             L 
                           
                         
                         ⁡ 
                         
                           [ 
                           lA 
                           ] 
                         
                       
                       ) 
                     
                     h 
                   
                   . 
                 
               
             
           
         
       
     
   
   The above algorithm does not guarantee a matrix (P a   S·L [lA]) −1  with positive eigenvalues, and, therefore, introduces a lot of stability problems. In the single channel case, we are able to stabilize the algorithm by using a lower limit on the estimate, which automatically results in positive eigenvalues because the matrix is diagonal, but that is not possible in the multiple channel case. 
   Positive Eigenvalues 
   An exact transformation of an algorithm for estimating P a   S·L [lA] with positive eigenvalues will lead to an estimation algorithm for the inverse with positive eigenvalues. This can be done by using the matrix inversion lemma. When there is matrix A such that
 
 A=B+C·D·E   (15)
 
then the inverse matrix (A) −1  of A can be expressed by
 
( A ) −1 =( B ) −1 −( B ) −1   ·C ·(( D ) −1   +E ·( B ) −1   ·C ) −1   ·E ·( B ) −1 .  (16)
 
By choosing
 
                   A   =       P   α     S   ·   L       ⁡     [   lA   ]         ⁢     
     ⁢     B   =       (     1   -   γ     )     ·       P   α     S   ·   L       ⁡     [       (     l   -   1     )     ⁢   A     ]           ⁢     
     ⁢     C   =       (       X       S   ·   L     ,   L       ⁡     [   lA   ]       )     *       ⁢     
     ⁢     D   =       γ     2   ⁢   α   ⁢           ⁢   L       ·     I   L         ⁢     
     ⁢     E   =       C   h     =       (       X       S   ·   L     ,   L       ⁡     [   lA   ]       )     t                 (   17   )               
and
 
                       Q   =         (   B   )       -   1       ·   C                 =     E   ·       (   B   )       -   1                     =       1     1   -   γ       ·       (       P   α     S   ·   L       ⁡     [       (     l   -   1     )     ⁢   A     ]       )       -   1       ·       (       X       S   ·   L     ,   L       ⁡     [   lA   ]       )     *                     (   18   )               
we obtain by using Equation (14)
 
                     (       P   α     S   ·   L       ⁡     [   lA   ]       )       -   1       =         1     1   -   γ       ⁢         P   α     S   ·   L       ⁡     [       (     l   -   1     )     ⁢   A     ]         -   1         -         Q       S   ·   L     ,   L       ⁡     [   lA   ]       ·       (           D   _     _     L     ⁡     [   lA   ]       )       -   1       ·       (       Q       S   ·   L     ,   L       ⁡     [   lA   ]       )     h                 (   19   )               
with
 
   
     
       
         
           
             
               
                 
                   
                     
                       
                         D 
                         _ 
                       
                       _ 
                     
                     L 
                   
                   ⁡ 
                   
                     [ 
                     lA 
                     ] 
                   
                 
                 = 
                 
                   
                     
                       
                         2 
                         ⁢ 
                         α 
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         L 
                       
                       γ 
                     
                     ⁢ 
                     
                       I 
                       L 
                     
                   
                   + 
                   
                     
                       
                         ( 
                         
                           
                             X 
                             
                               
                                 S 
                                 · 
                                 L 
                               
                               , 
                               L 
                             
                           
                           ⁡ 
                           
                             [ 
                             lA 
                             ] 
                           
                         
                         ) 
                       
                       t 
                     
                     · 
                     
                       
                         
                           Q 
                           
                             
                               S 
                               · 
                               L 
                             
                             , 
                             L 
                           
                         
                         ⁡ 
                         
                           [ 
                           lA 
                           ] 
                         
                       
                       . 
                     
                   
                 
               
             
             
               
                 ( 
                 20 
                 ) 
               
             
           
         
       
     
   
   Equation (19) involves no matrix inversion, and only L/2+1 divisions, as the matrix  D   L [lA] of Equation (20) is a real valued diagonal matrix. 
   Limits on the Eigenvalues 
   An operation on the inverse power matrix that is equivalent to adding a constant to the diagonal of the (non-inverse) power matrix, would solve the problem. Adding a full (S·L)×(S·L) identity matrix and trying to find an equivalent operation on the inverse power matrix with the matrix inversion lemma, results in an algorithm that requires the matrix inversion we would like to avoid, so we try 
                     P     α   ,   lim       S   ·   L       ⁡     [   lA   ]       =         (     1   -   γ     )     ·       P     α   ,   lim       S   ·   L       ⁡     [       (     l   -   1     )     ⁢   A     ]         +       γ     2   ⁢           ⁢   α   ⁢           ⁢   L       ·       (       X   lim       S   ·   L     ,   L       ⁡     [   lA   ]       )     *     ·       (       X   lim       S   ·   L     ,   L       ⁡     [   lA   ]       )     t                 (   21   )               
with
 ( X   lim   S·L,L   [lA ])*·( X   lim   S·L,L   [lA ]) t =( X   S·L,L   [lA ])*·( X   S·L,L   [lA ]) t   +P   min ·2 αL·I   S·L .  (22) 
   As the matrix I has rank S·L and the product matrices (X lim   S·L.L [lA])*·(X lim   S·L,L [lA]) t  and (X S·L,L [lA])*·(X S·L,L [lA]) t  both have a rank of (at most) L, this is not possible for S&gt;1. As we need the average of (X S·L,L [lA])*·(X S·L,L [lA]) t , we can find a solution by taking the average over S consecutive updates. We will try to find X lim   S·L,L [lA] such that 
                 ɛ   ⁢     {         ∑     a   =   0       S   -   1       ⁢           ⁢     (           X   lim       S   ·   L     ,   L       [       (     l   +   a     ]     ⁢   A     )     *     ·       (         X   lim       S   ·   L     ,   L       ⁡     [     (     l   +   a     )     ]       ⁢   A     )     t       }       ⁢     
     =     ɛ   ⁢     {         ∑     a   =   0       S   -   1       ⁢           ⁢         (       X       S   ·   L     ,   L       ⁡     [       (     l   +   a     )     ⁢   A     ]       )     *     ·     (         X       S   ·   L     ,   L       ⁡     [       (     l   +   a     )     ⁢   A     ]       t     }         +     
     ⁢         P   min     ·   2     ⁢   α   ⁢           ⁢     LS   ·     I     S   ·   L                             (   23   )               
with for i=l mod S
 
                           X   lim       S   ·   L     ,   L       ⁡     [   lA   ]       =       (                 X   _     _       S   -   1     L     ⁡     [   lA   ]               ⋮                   X   _     _     1   L     ⁡     [   lA   ]                         X   _     _     0   L     ⁡     [   lA   ]       ⁢                   )     +     (             u       S   -   1     ,   i       ·     I   L               ⋮               u     1   ,   i       ·     I   L                   u     0   ,   i       ·     I   L             )                   =         X       S   ·   L     ,   L       ⁡     [   lA   ]       +       (             u       S   -   1     ,   i       ·     I   L               ⋮               u     1   ,   i       ·     I   L                   u     0   ,   i       ·     I   L             )     .                     (   24   )               
with
 
   
     
       
         
           
             
               
                 
                   U 
                   S 
                 
                 = 
                 
                   
                     ( 
                     
                       
                         
                           
                             u 
                             
                               
                                 S 
                                 - 
                                 1 
                               
                               , 
                               
                                 S 
                                 - 
                                 1 
                               
                             
                           
                         
                         
                           ⋯ 
                         
                         
                           
                             u 
                             
                               
                                 S 
                                 - 
                                 1 
                               
                               , 
                               1 
                             
                           
                         
                         
                           
                             u 
                             
                               
                                 S 
                                 - 
                                 1 
                               
                               , 
                               0 
                             
                           
                         
                       
                       
                         
                           ⋮ 
                         
                         
                           
                               
                           
                         
                         
                           ⋮ 
                         
                         
                           ⋮ 
                         
                       
                       
                         
                           
                             u 
                             
                               1 
                               , 
                               
                                 S 
                                 - 
                                 1 
                               
                             
                           
                         
                         
                           ⋯ 
                         
                         
                           
                             u 
                             
                               1 
                               , 
                               1 
                             
                           
                         
                         
                           
                             u 
                             
                               1 
                               , 
                               0 
                             
                           
                         
                       
                       
                         
                           
                             u 
                             
                               0 
                               , 
                               
                                 S 
                                 - 
                                 1 
                               
                             
                           
                         
                         
                           ⋯ 
                         
                         
                           
                             u 
                             
                               0 
                               , 
                               1 
                             
                           
                         
                         
                           
                             u 
                             
                               0 
                               , 
                               0 
                             
                           
                         
                       
                     
                     ) 
                   
                   . 
                 
               
             
             
               
                 ( 
                 25 
                 ) 
               
             
           
         
       
     
   
   For S=1, we get
 
 U   1   =√{square root over (P     min     ·2αL)}   (26)
 
   For S&gt;1, there are an infinite number of solutions. If we try to keep the maximum distortion (the largest matrix element) as small as possible, we have to choose, for all S&gt;j≧0 and S&gt;i≧0
 
 u   j,i   =±√{square root over (P     min     ·2αL·)}   (27)
 
If there is a real symmetric matrix U L  for S=L, then a real symmetric matrix U 2L  for S=2L is given by
 
   
     
       
         
           
             
               
                 
                   U 
                   
                     2 
                     ⁢ 
                     L 
                   
                 
                 = 
                 
                   
                     ( 
                     
                       
                         
                           
                             U 
                             L 
                           
                         
                         
                           
                             U 
                             L 
                           
                         
                       
                       
                         
                           
                             U 
                             L 
                           
                         
                         
                           
                             - 
                             
                               U 
                               L 
                             
                           
                         
                       
                     
                     ) 
                   
                   . 
                 
               
             
             
               
                 ( 
                 28 
                 ) 
               
             
           
         
       
     
   
   Using the above equation, we can construct all U 2i  with i&gt;0. If S+1 is not a power of two, then we will use the matrix U 2i  where 2 i &gt;S+1&gt;2 i−1 , and use the last S rows. In Table 1, the power matrix estimation algorithm using a direct inverse estimation with limits on the eigenvalues is summarized. 
   Initialization 
   1. S u =2 ┌log     2     S+1 ┐ 
 
 U   1   =√{square root over (P     min     )} ·2 αL  
 
   for i=1 to log 2 (S u )do 
   2. begin 
   
     
       
         
           
             U 
             
               2 
               i 
             
           
           = 
           
             ( 
             
               
                 
                   
                     U 
                     
                       2 
                       
                         i 
                         - 
                         1 
                       
                     
                   
                 
                 
                   
                     U 
                     
                       2 
                       
                         i 
                         - 
                         1 
                       
                     
                   
                 
               
               
                 
                   
                     U 
                     
                       2 
                       
                         i 
                         - 
                         1 
                       
                     
                   
                 
                 
                   
                     - 
                     
                       U 
                       
                         2 
                         
                           i 
                           - 
                           1 
                         
                       
                     
                   
                 
               
             
             ) 
           
         
       
     
   
   end 
   3. Initialize power matrix. 
   Iteration 
   
     
       
         
           
             1. 
             ⁢ 
             
                 
             
             ⁢ 
             
               
                 X 
                 lim 
                 
                   
                     S 
                     · 
                     L 
                   
                   , 
                   L 
                 
               
               ⁡ 
               
                 [ 
                 lA 
                 ] 
               
             
           
           = 
           
             
               ( 
               
                 
                   
                     
                       
                         
                           
                             X 
                             _ 
                           
                           _ 
                         
                         
                           S 
                           - 
                           1 
                         
                         L 
                       
                       ⁡ 
                       
                         [ 
                         lA 
                         ] 
                       
                     
                   
                 
                 
                   
                     ⋮ 
                   
                 
                 
                   
                     
                       
                         
                           
                             X 
                             _ 
                           
                           _ 
                         
                         1 
                         L 
                       
                       ⁡ 
                       
                         [ 
                         lA 
                         ] 
                       
                     
                   
                 
                 
                   
                     
                       
                         
                           
                             
                               X 
                               _ 
                             
                             _ 
                           
                           0 
                           L 
                         
                         ⁡ 
                         
                           [ 
                           lA 
                           ] 
                         
                       
                       ⁢ 
                       
                           
                       
                     
                   
                 
               
               ) 
             
             + 
             
               ( 
               
                 
                   
                     
                       
                         u 
                         
                           
                             
                               S 
                               u 
                             
                             - 
                             1 
                           
                           , 
                           
                             l 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             mod 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               S 
                               u 
                             
                           
                         
                       
                       · 
                       
                         I 
                         L 
                       
                     
                   
                 
                 
                   
                     ⋮ 
                   
                 
                 
                   
                     
                       
                         u 
                         
                           
                             
                               S 
                               u 
                             
                             - 
                             S 
                             + 
                             1 
                           
                           , 
                           
                             l 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             mod 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               S 
                               u 
                             
                           
                         
                       
                       · 
                       
                         I 
                         L 
                       
                     
                   
                 
                 
                   
                     
                       
                         u 
                         
                           
                             
                               S 
                               u 
                             
                             - 
                             S 
                           
                           , 
                           
                             l 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             mod 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               S 
                               u 
                             
                           
                         
                       
                       · 
                       
                         I 
                         L 
                       
                     
                   
                 
               
               ) 
             
           
         
       
     
     
       
         
           
             
               2. 
               ⁢ 
               
                   
               
               ⁢ 
               
                 
                   Q 
                   
                     
                       S 
                       · 
                       L 
                     
                     , 
                     L 
                   
                 
                 ⁡ 
                 
                   [ 
                   lA 
                   ] 
                 
               
             
             = 
             
               
                 1 
                 
                   1 
                   - 
                   γ 
                 
               
               · 
               
                 
                   ( 
                   
                     
                       P 
                       
                         α 
                         , 
                         lim 
                       
                       
                         S 
                         · 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       
                         
                           ( 
                           
                             l 
                             - 
                             1 
                           
                           ) 
                         
                         ⁢ 
                         A 
                       
                       ] 
                     
                   
                   ) 
                 
                 
                   - 
                   1 
                 
               
               · 
               
                 
                   ( 
                   
                     
                       X 
                       lim 
                       
                         
                           S 
                           · 
                           L 
                         
                         , 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       lA 
                       ] 
                     
                   
                   ) 
                 
                 * 
               
             
           
           ⁢ 
           
             
 
           
         
       
     
     
       
         
           
             3. 
             ⁢ 
             
                 
             
             ⁢ 
             
               
                 
                   
                     D 
                     _ 
                   
                   _ 
                 
                 L 
               
               ⁡ 
               
                 [ 
                 lA 
                 ] 
               
             
           
           = 
           
             
               
                 
                   2 
                   ⁢ 
                   
                       
                   
                   ⁢ 
                   α 
                   ⁢ 
                   
                       
                   
                   ⁢ 
                   L 
                 
                 γ 
               
               ⁢ 
               
                 I 
                 L 
               
             
             + 
             
               
                 
                   ( 
                   
                     
                       X 
                       lim 
                       
                         
                           S 
                           · 
                           L 
                         
                         , 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       lA 
                       ] 
                     
                   
                   ) 
                 
                 t 
               
               · 
               
                 
                   Q 
                   
                     
                       S 
                       · 
                       L 
                     
                     , 
                     L 
                   
                 
                 ⁡ 
                 
                   [ 
                   lA 
                   ] 
                 
               
             
           
         
       
     
   
   4. Calculate ( D   L [lA]) −1   
   
     
       
         
           
             5. 
             ⁢ 
             
                 
             
             ⁢ 
             
               
                 ( 
                 
                   
                     P 
                     
                       α 
                       , 
                       lim 
                     
                     
                       S 
                       · 
                       L 
                     
                   
                   ⁡ 
                   
                     [ 
                     lA 
                     ] 
                   
                 
                 ) 
               
               
                 - 
                 1 
               
             
           
           = 
           
             
               
                 1 
                 
                   1 
                   - 
                   γ 
                 
               
               ⁢ 
               
                 
                   ( 
                   
                     
                       P 
                       
                         α 
                         , 
                         lim 
                       
                       
                         S 
                         · 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       
                         
                           ( 
                           
                             l 
                             - 
                             1 
                           
                           ) 
                         
                         ⁢ 
                         A 
                       
                       ] 
                     
                   
                   ) 
                 
                 
                   - 
                   1 
                 
               
             
             - 
             
               
                 
                   Q 
                   
                     
                       S 
                       · 
                       L 
                     
                     , 
                     l 
                   
                 
                 ⁡ 
                 
                   [ 
                   lA 
                   ] 
                 
               
               · 
               
                 
                   ( 
                   
                     
                       
                         
                           D 
                           _ 
                         
                         _ 
                       
                       L 
                     
                     ⁡ 
                     
                       [ 
                       lA 
                       ] 
                     
                   
                   ) 
                 
                 
                   - 
                   1 
                 
               
               · 
               
                 
                   ( 
                   
                     
                       Q 
                       
                         
                           S 
                           · 
                           L 
                         
                         , 
                         L 
                       
                     
                     ⁡ 
                     
                       [ 
                       lA 
                       ] 
                     
                   
                   ) 
                 
                 h 
               
             
           
         
       
     
   
   Table 1: Direct inverse power update with limits. 
   Note that the inverse of P S·L  [lA] is also a sparse matrix with the same structure, and we define 
               (     P     α   ,   lim       S   ·   L       )       -   1       =     (                 T   _     _         S   -   1     ,     S   -   1         ⁡     [   lA   ]           …               T   _     _         S   -   1     ,   1       ⁡     [   lA   ]                   T   _     _     0   L     ⁡     [   lA   ]               ⋮       ⋰       ⋮       ⋮                   T   _     _       1   ,     S   -   1       L     ⁡     [   lA   ]           ⋯               T   _     _       1   ,   1     L     ⁡     [   lA   ]                   T   _     _       1   ,   0     L     ⁡     [   lA   ]                       T   _     _       0   ,     S   -   1       L     ⁡     [   lA   ]           ⋯               T   _     _       0   ,   1     L     ⁡     [   lA   ]                   T   _     _       0   ,   0     L     ⁡     [   lA   ]             )           
where for 0≦i&lt;S and 0≦j&lt;S
     T     i,j   L   [lA]=diag{ T     i,j   L   [lA]}.    
     FIG. 5  shows, schematically, an example of a teleconferencing system TS 5  using a stereo echo canceller SEC 5  with adaptive filters AF 5  (only one shown). The teleconferencing system comprises a far room FR 5  and a near room NR 5 . The adaptive filter AF 5  has to filter the stereo echo signals. 
     FIG. 6  shows an example of a stereo echo canceller SEC 6  used in a teleconferencing system TS 6 . The stereo echo canceling has to be performed between the near room NR 6  and the far room FR 6 . In this example, also programmable filters PF 61  and PF 62  are used to improve the performance of echo canceling. Programmable filters are described in U.S. Pat. No. 4,903,247. 
   Further, also the output of the programmable filters is supplied to a dynamic echo suppressor DES 6 , which is coupled with an output to the output of the stereo echo canceller. Dynamic echo suppressors are described in International Patent Application No. WO-97-45995, corresponding to U.S. Pat. No. 6,546,099. 
   A full stereo communication requires four stereo AECs, two on the near end side and two on the far end side. In  FIG. 6 , only one of these echo cancellers is depicted. Note that on each side we can combine the input signal delay-lines, the FFTs and the multiplication by the inverse power matrix of the two echo cancellers, which implies that the relative extra computational complexity for removing the cross-correlation is even further reduced. The performance of the AECs is further improved by adding Dynamic Echo Suppressors as shown. 
     FIG. 7  shows another application wherein a stereo echo canceller SEC 7  is used in a voice-controlled audio (and video) system VCS 7 . To be able to recognize the local speaker by a voice recognition engine, we have to cancel the sound emitted by the audio set through the loudspeakers. This is done by using the stereo echo canceller SEC 7 . To improve the stereo echo canceling, also, in this example, the programmable filters PF 71  and PF 72  are used, and the Dynamic Echo Suppresser DES 7  is used. The output of the Dynamic Echo Suppressor is coupled to a voice recognizer VR 7  for handling the filtered signal. 
     FIG. 8  shows an example of a noise canceller NC 8  for canceling the noise received on microphones in a room R 8  together with a speech signal sp 1  from a person in the room. In this example, the microphones supply signals to a beam former BF 8  which beam former supplies signals to the noise canceller NC 8  and to programmable filters PF 81 , PF 82  and PF 83 . Further the noise canceller comprises a dynamic echo suppressor DES 8 . The output of the Dynamic Echo Suppressor is coupled to the output of the noise suppressor to supply an estimate of the received speech sp 2 . 
   Also in the multiple input noise canceller, we can apply a DES (which is, in fact, not suppressing an echo, but is similar to the DES in the AEC&#39;s case) and programmable filters to improve performance, as shown in  FIG. 8 . An extra problem is that the inputs of the filters may contain some elements of the desired signal (“signal leakage”), because the beam former is not perfect. When the desired signal is speech signal, a speech detector can be used to improve the behavior of the MFDAF. 
   Above some examples of application of a stereo echo canceller and of a noise canceller are described. It is to be noted that the invention can be used in different applications and is not restricted to the described applications.