Abstract:
Interference in an audio signal is reduced by estimating a target signal using beam-forming in a direction of the signal source. A set of estimates of interference is determined by using a microphone array filtering matrix to block the target signal in the audio signal. A set of filters is optimized by minimizing an objective function measuring a mismatch between the set of estimates of interference and the estimate of the target signal. The minimizing uses a sparse regularization of coefficients of the set of filters. The set of estimates of interference are filtered using the set of filters after the optimizing. Then, the estimate of interference after the optimizing is subtracted from the target signal.

Description:
FIELD OF THE INVENTION 
       [0001]    This invention relates generally to processing audio signals, and more particularly to cancelling interference in speech signals acquired by an antenna array. 
       BACKGROUND OF THE INVENTION 
       [0002]    Speech-based command interfaces can be used in vehicles. Applications include automatic dialog system for hands-free phone calls, as well as more advanced features, such, as navigation systems. 
         [0003]    However, interference, such as speech from the codriver, rear-seat passengers, and noise, e.g., music or radio, engine and wind noise, can significantly degrade performance of an automatic speech recognition (ASR) system, which is crucial for those applications. This issue can be addressed with adaptive interference cancellation techniques, such as generalized sidelobe cancellation (GSC). 
         [0004]    Beamformers based on GSC are well known. Typically, the beamformer includes a presteering front end, a fixed beam former (FBF), a blocking matrix (BM) and an adaptive canceller. The presteering front end is composed of various time delays allowing the main lobe of the beamformer to be steered to a selected direction. The FBF is used to enhance a target signal from the selected direction. However, the BM, composed of adaptive blocking filters (ABF), rejects the target signal, so that the blocking matrix contains interference and noise. The adaptive canceller, composed of adaptive canceling filters (ACF), is able to adjust weights so that the interferences and noise can be subtracted from the fixed beamformer output. 
         [0005]    However, the conventional adaptive beamformer for GSC, like the simple Griffiths-Jim beamformer (GJBF), see U.S. Patent Applications 20100004929, 20070244698, 20060195324 and 20050049864 D. suffers from target signal cancellation due to steering-vector errors. The steering-vector errors are due to errors in microphone positions, microphone gains and real world recordings of, e.g., reverberation, noise and a moving target. Indeed, the beamformer is constrained to produce a dominant response toward the selected location of the source of the speech, while minimizing the response in all other directions. 
         [0006]    However, in reverberant environments a single direction of arrival cannot be determined because the desired signal and its reflection impinge on the microphone array from several directions. Thus, complete rejection of the target signal is almost impossible in the BM and a considerable portion of the desired speech is subject to interference cancellation, which results in target signal cancellation. 
         [0007]    In addition, the original formulation of the GJBF was based on the general use of beamforming, where the far-field assumption is often valid, such as in radio astronomy or geology. 
         [0008]    However, in a vehicle, the microphone array can span about one meter, meaning that the far field assumption is no longer valid. This change in the physics of the system also causes leakage in the conventional Griffiths-Jim BM because now the target signal is no longer received at each microphone with equal amplitude. 
         [0009]    Applying the GSC uniformly to an entire utterance, without considering the observed data, is not efficient. It is not necessary to process noise only and single speaker segments using the GSC if they can be accurately labeled. 
         [0010]    In particular, non-overlapping speech, and non-speech occur more often than overlapping speech, and each case needs to be handled differently 
         [0011]    GSC 
         [0012]      FIG. 1  shows a conventional GSC, which is a simplification of the well known Frost Algorithm. It is assumed that all input channels  101  have already been appropriately steered toward a point of interest. The GSC includes an upper branch  110 , often called the Fixed Beamformer (FBF), and a lower branch  120  including a Blocking Matrix (BM) outputting to normalized least mean square modules  140 , whose outputs are also summed  150 . 
         [0013]    The conventional Delay and Sum beamformer for FBF is to sum  130  the observed signals x m  from the microphone array as 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       
                         y 
                         FBF 
                       
                        
                       
                         ( 
                         t 
                         ) 
                       
                     
                     = 
                     
                       
                         1 
                         M 
                       
                        
                       
                         
                           ∑ 
                           
                             m 
                             = 
                             1 
                           
                           M 
                         
                          
                         
                           
                             x 
                             m 
                           
                            
                           
                             ( 
                             
                               t 
                               - 
                               
                                 τ 
                                 m 
                               
                             
                             ) 
                           
                         
                       
                     
                   
                   , 
                 
               
               
                 
                   ( 
                   1 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where τ m  is the delay for the m th  microphone, for a given steering direction. 
         [0014]    The lower branch utilizes an unconstrained adaptive process on a set of tracks that have passed through the BM, including of some process intended to eliminate the target signal from the incoming data in order to form a reference of the noise. The particular Griffiths-Jim BM takes pairwise differences of signals, which can be expressed for a four-microphone instance as 
         [0000]    
       
         
           
             
               
                 
                   
                     W 
                     b 
                   
                   = 
                   
                     ( 
                     
                       
                         
                           1 
                         
                         
                           
                             - 
                             1 
                           
                         
                         
                           0 
                         
                         
                           0 
                         
                       
                       
                         
                           0 
                         
                         
                           1 
                         
                         
                           
                             - 
                             1 
                           
                         
                         
                           0 
                         
                       
                       
                         
                           0 
                         
                         
                           0 
                         
                         
                           1 
                         
                         
                           
                             - 
                             1 
                           
                         
                       
                     
                     ) 
                   
                 
               
               
                 
                   ( 
                   2 
                   ) 
                 
               
             
           
         
       
     
         [0015]    For this W b  the BM output tracks are determined as the matrix product of the BM and matrix of current input data 
         [0000]        y   BM ( t )= W   b   X ( t )  (3)
 
         [0000]    where X(t)=[x 1 (t), x 2 (t), . . . , x M (t)]. The overall beamformer output y(t)  102 , is determined as the DSB signal minus  160  the sum  150  of the adaptively-filtered BM tracks 
         [0000]    
       
         
           
             
               
                 
                   
                     y 
                      
                     
                       ( 
                       t 
                       ) 
                     
                   
                   = 
                   
                     
                       
                         y 
                         FBF 
                       
                        
                       
                         ( 
                         t 
                         ) 
                       
                     
                     - 
                     
                       
                         ∑ 
                         
                           m 
                           = 
                           1 
                         
                         
                           M 
                           - 
                           1 
                         
                       
                        
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             
                               - 
                               
                                 K 
                                 L 
                               
                             
                           
                           
                             K 
                             R 
                           
                         
                          
                         
                           
                             
                               g 
                               
                                 m 
                                 , 
                                 i 
                               
                             
                              
                             
                               ( 
                               t 
                               ) 
                             
                           
                            
                           
                             
                               
                                 y 
                                 m 
                                 BM 
                               
                                
                               
                                 ( 
                                 
                                   t 
                                   - 
                                   i 
                                 
                                 ) 
                               
                             
                             . 
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   4 
                   ) 
                 
               
             
           
         
       
     
         [0016]    Define, for m=1, . . . , M−1 
         [0000]        x   m ( t )=( x   m ( t+K   L ), . . . ,  x   m ( t ), . . . , x   m ( t−K   R )), 
         [0000]      and 
         [0000]        g   m ( t )=( g   m,−K     L   ( t ), . . . , g   m,0 ( t ), . . . , g   m/K     R   ( t )), 
         [0000]    then the adaptive normalized multichannel least mean square (LMS) solution is 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       
                         
                           g 
                           m 
                         
                          
                         
                           ( 
                           
                             t 
                             + 
                             1 
                           
                           ) 
                         
                       
                       = 
                       
                         
                           
                             g 
                             m 
                           
                            
                           
                             ( 
                             t 
                             ) 
                           
                         
                         + 
                         
                           
                             μ 
                             
                               
                                 p 
                                 est 
                               
                                
                               
                                 ( 
                                 t 
                                 ) 
                               
                             
                           
                            
                           
                             
                               x 
                               m 
                             
                              
                             
                               ( 
                               t 
                               ) 
                             
                           
                            
                           
                             y 
                              
                             
                               ( 
                               t 
                               ) 
                             
                           
                         
                       
                     
                     ; 
                   
                    
                   
                     
 
                   
                    
                   
                     
                       m 
                       = 
                       1 
                     
                     , 
                     … 
                      
                     
                         
                     
                     , 
                     
                       M 
                       - 
                       1 
                     
                     , 
                     
                       
 
                     
                      
                     where 
                   
                 
               
               
                 
                   ( 
                   5 
                   ) 
                 
               
             
             
               
                 
                   
                     
                       p 
                       est 
                     
                      
                     
                       ( 
                       t 
                       ) 
                     
                   
                   = 
                   
                     
                       ∑ 
                       
                         m 
                         = 
                         1 
                       
                       M 
                     
                      
                     
                       
                         
                            
                           
                             
                               x 
                               m 
                             
                              
                             
                               ( 
                               t 
                               ) 
                             
                           
                            
                         
                         2 
                         2 
                       
                       . 
                     
                   
                 
               
               
                 
                   ( 
                   6 
                   ) 
                 
               
             
           
         
       
     
       SUMMARY OF THE INVENTION 
       [0017]    The embodiments of the invention provide a system and method for reducing interference and noise in audio signals including speech using generalized sidelobe cancellation (GSC). In the preferred embodiment, the GSC is embedded in a multi-stage system designed to distinguish noise only segments (NO), single speaker segments (SS), and overlapping speech segments (OS), and then apply different approaches to suppress diffuse noises and other interferences within different types of the segments. In the overlapping speech segments, speech other than from a target speaker is considered interference. 
         [0018]    A first stage is carried out by overlapping speech detection (OSD) and a voice activity detection, while the second stage is achieved by a blind speech separation (BSS) based speaker turn detection, direction of arrival estimation, sparse GSC and post-processing, i.e., log-spectral amplitude estimation. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWING 
         [0019]      FIG. 1  is a schematic of a prior art generalized sidelobe cancellation system; 
           [0020]      FIG. 2  are signal traces of recorded audio samples processed by embodiments of the invention; 
           [0021]      FIG. 3  and  FIG. 4  are graphs of an energy ratio of a ground truth and an energy ratio for detection in each time frame, respectively; 
           [0022]      FIG. 5  is a schematic of a generalized sidelobe cancellation system according to embodiments of the invention; 
           [0023]      FIG. 6  is a flow diagram of a method for cancelling sidelobes according to embodiments of the invention; and 
           [0024]      FIG. 7  is pseudo code for an overlapping speech detection process according to embodiments of the invention. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0025]    The embodiments of the invention provide a system and method for reducing interference and noise in audio signals including speech using generalized sidelobe cancellation (GSC). The embodiments are shown in  FIG. 5  and  FIG. 6 .  FIG. 5  shows the system, and  FIG. 6  the method. The method can be performed in a processor connected to a memory and input/output interfaces as known in the art. 
         [0026]    Voice Activity Detection 
         [0027]    In a first stage, a conventional voice activity detector (VAD)  610  can be used to determine when not to perform the GSC update, and instead directly suppress the noise, in noise only segments of speech. We use a modification to the discontinuity in the detection. Because VAD gives a 0/1 indicator, which signals speech muted and active, respectively. Both VAD errors and the speech activity&#39;s frequent changes would make the output speech discontinuous and uncomfortable if the detected non-speech parts are fully canceled by setting the non-speech parts to 0. However, long time non-speech parts can be fully cancelled without perceptual discomfort, while a short time non-speech part cannot. The voice activity detection is therefore followed by detecting  620  noise only segments. If there are a sufficient number of such segments  625  in a neighborhood of segments, the noise suppression  627  can be performed. Otherwise, proceed with overlapping speech (OS) detection  630 . 
         [0028]    Overlapping Speech Detection 
         [0029]    In automatic overlapping speech (OS) detection (ASD)  640 , there can be an array  501  of two or more microphones, and arbitrary number (N) of audio signal sources. The detection can be frame by frame on the observed data x i    501 , i=1,2 is the microphone index for any pair of microphones in the array. The observed data are obtained by audio signals acquired by the array of microphones. 
         [0030]    In particular, the audio signal includes speech from a target source, i.e., a driver. The audio signal can also include noise, e.g., music and radio, interfering speech, etc., speech from sources other than the target. 
         [0031]    The mixing model is x i (t)=Σ j=1   N h ij *s j (t), where t is time, h ij  is an impulse response from source s j  to microphone i, which is a linear convolution. If s k , kε{1, 2, . . . , N} in a frame D is the only active source, then it follows from the mixing model that 
         [0000]        h   2k   *x   1 ( t )− h   1k   *x   2 ( t )=0 for  tεD.  
 
         [0032]    The elimination by cross-channel cancellation is known in blind channel identification. Based on the observed data in D, a pair of sparse filters u i  (i=1,2) are used to minimize the energy of u 2 *x 1 −u 1 *x 2  in the region D. Ideally, u 1 ≈h 1k  and u 2 ≈h 2k . The sparseness of the finite impulse response filters regularizes the solution and improves the accuracy of the method. Filter sparseness is achieved by l 1 -norm regularization  530 . 
         [0033]    The resulting convex optimization problem for tεD is 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       
                         ( 
                         
                           
                             u 
                             1 
                             * 
                           
                           , 
                           
                             u 
                             2 
                             * 
                           
                         
                         ) 
                       
                       = 
                       
                         
                           arg 
                            
                           
                               
                           
                            
                           
                             
                               min 
                               
                                 ( 
                                 
                                   
                                     u 
                                     1 
                                   
                                   , 
                                   
                                     u 
                                     2 
                                   
                                 
                                 ) 
                               
                             
                              
                             
                               
                                 1 
                                 2 
                               
                                
                               
                                 
                                    
                                   
                                     
                                       
                                         u 
                                         2 
                                       
                                       * 
                                       
                                         x 
                                         1 
                                       
                                     
                                     - 
                                     
                                       
                                         u 
                                         1 
                                       
                                       * 
                                       
                                         x 
                                         2 
                                       
                                     
                                   
                                    
                                 
                                 2 
                                 2 
                               
                             
                           
                         
                         + 
                         
                           
                             
                               η 
                               2 
                             
                             2 
                           
                            
                           
                             
                               ( 
                               
                                 
                                   
                                     ∑ 
                                     
                                       i 
                                       = 
                                       1 
                                     
                                     2 
                                   
                                    
                                   
                                     
                                       μ 
                                       i 
                                     
                                      
                                     
                                       ( 
                                       1 
                                       ) 
                                     
                                   
                                 
                                 - 
                                 1 
                               
                               ) 
                             
                             2 
                           
                         
                         + 
                         
                           
                             μ 
                             ( 
                             
                               
                                 
                                    
                                   
                                     u 
                                     1 
                                   
                                    
                                 
                                 1 
                               
                                
                               
                                 u 
                                 2 
                               
                             
                              
                           
                           1 
                         
                       
                     
                     ) 
                   
                   , 
                 
               
               
                 
                   ( 
                   7 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where the second term 
         [0000]    
       
         
           
             
               
                 η 
                 2 
               
               2 
             
              
             
               
                 ( 
                 
                   
                     
                       ∑ 
                       
                         i 
                         = 
                         1 
                       
                       2 
                     
                      
                     
                       
                         μ 
                         i 
                       
                        
                       
                         ( 
                         1 
                         ) 
                       
                     
                   
                   - 
                   1 
                 
                 ) 
               
               2 
             
           
         
       
     
         [0000]    is to fix scaling and prevent zero (trivial) solution. 
         [0034]    Denote the length of D by L D  and that of u i  by L. The frame size of D can be set as short as 100 ms. As a result, this spatial difference based method solves the problem efficiently, in terms of the data usage, and is different from other OSD methods based on high order statistics of data. 
         [0035]    Because the solution u i  is l 1  regularized by solving Eq. 7, the filter length is effectively truncated to a size less than or equal to the length D supported by the data. In addition, sparseness forces the solution u i  to be able to resolve the major spikes of the channel impulse response filters which comprise the relative time delay. In this sense, it helps to be insensitive and accurate under reverberant conditions. In matrix form, the convex objective of Eq. 7 becomes 
         [0000]    
       
         
           
             
               
                 
                   
                     u 
                     * 
                   
                   = 
                   
                     
                       arg 
                        
                       
                           
                       
                        
                       
                         
                           min 
                           u 
                         
                          
                         
                           
                             1 
                             2 
                           
                            
                           
                             
                                
                               
                                 Au 
                                 - 
                                 f 
                               
                                
                             
                             2 
                             2 
                           
                         
                       
                     
                     + 
                     
                       μ 
                        
                       
                         
                            
                           u 
                            
                         
                         1 
                       
                     
                   
                 
               
               
                 
                   ( 
                   8 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where u is formed by stacking up u 1  and u 2 ; vector f=(0,0, . . . ,0,η) T  with length L D +1; and (L D +1)×2L matrix A (T is transpose) is 
         [0000]    
       
         
           
             A 
             = 
             
               
                 ( 
                 
                   
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           1 
                           ) 
                         
                       
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           2 
                           ) 
                         
                       
                     
                     
                       … 
                     
                     
                       … 
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           
                             
                               L 
                               D 
                             
                             - 
                             1 
                           
                           ) 
                         
                       
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           
                             L 
                             D 
                           
                           ) 
                         
                       
                     
                     
                       η 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           1 
                           ) 
                         
                       
                     
                     
                       … 
                     
                     
                       … 
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           
                             
                               L 
                               D 
                             
                             - 
                             2 
                           
                           ) 
                         
                       
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           
                             
                               L 
                               D 
                             
                             - 
                             1 
                           
                           ) 
                         
                       
                     
                     
                       0 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       ⋱ 
                     
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       ⋮ 
                     
                     
                       ⋮ 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           1 
                           ) 
                         
                       
                     
                     
                       … 
                     
                     
                       
                         
                           x 
                           1 
                         
                          
                         
                           ( 
                           
                             
                               L 
                               D 
                             
                             - 
                             L 
                             + 
                             1 
                           
                           ) 
                         
                       
                     
                     
                       0 
                     
                   
                   
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             1 
                             ) 
                           
                         
                       
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             2 
                             ) 
                           
                         
                       
                     
                     
                       … 
                     
                     
                       … 
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             
                               
                                 L 
                                 D 
                               
                               - 
                               1 
                             
                             ) 
                           
                         
                       
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             
                               L 
                               D 
                             
                             ) 
                           
                         
                       
                     
                     
                       η 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             1 
                             ) 
                           
                         
                       
                     
                     
                       … 
                     
                     
                       … 
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             
                               
                                 L 
                                 D 
                               
                               - 
                               2 
                             
                             ) 
                           
                         
                       
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             
                               
                                 L 
                                 D 
                               
                               - 
                               1 
                             
                             ) 
                           
                         
                       
                     
                     
                       0 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       ⋱ 
                     
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       ⋮ 
                     
                     
                       ⋮ 
                     
                   
                   
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       
                           
                       
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             1 
                             ) 
                           
                         
                       
                     
                     
                       … 
                     
                     
                       
                         - 
                         
                           
                             x 
                             2 
                           
                            
                           
                             ( 
                             
                               
                                 L 
                                 D 
                               
                               - 
                               L 
                               + 
                               1 
                             
                             ) 
                           
                         
                       
                     
                     
                       0 
                     
                   
                 
                 ) 
               
               T 
             
           
         
       
     
         [0000]    with the indices of x 1  and x 2  restricted in D. 
         [0036]    In each frame D, whether a SS frame or OS frame, we obtain an output signal ŝ D =u 2   D *x 1 −u 1   D *x 2 , where u i   D  i=1,2 are the optimal solution of Eq. 7 solved in D. Then for the whole utterance, x i  (i=1 or 2) and ŝ D  are normalized such that l 2  norm is 1. Finally the energy ratio restricted in D between normalized x i  and ŝ D  is calculated for detection as 
         [0000]    
       
         
           
             
               
                 
                   
                     R 
                     D 
                   
                   = 
                   
                     
                       
                         
                            
                           
                             
                               x 
                               i 
                             
                              
                             
                                
                               D 
                             
                           
                            
                         
                         2 
                         2 
                       
                       
                         
                            
                           
                             
                               
                                 s 
                                 ^ 
                               
                               D 
                             
                              
                             
                                
                               D 
                             
                           
                            
                         
                         2 
                         2 
                       
                     
                     . 
                   
                 
               
               
                 
                   ( 
                   9 
                   ) 
                 
               
             
           
         
       
     
         [0037]    The cross-channel cancellation does not work if the frame D contains multiple sources, i.e., ∥ŝ D | D ∥ 2  is not much smaller than ∥x i | D ∥ 2 . Hence, the significantly large values of this ratio resulting from the good performance of cross-channel cancellation indicate the non-overlapping speech frames. 
         [0038]    Usually, we select the frames with the ratio larger than r 0  as the SS frames, where r 0  is a threshold value. 
         [0039]      FIG. 2  shows OSD on recorded audio samples. Two microphones receive a mixed audio signal from four sources (s 1 , . . . , s 4 ). The four sources with the parts marked  201  are for single speaker speech. 
         [0040]      FIG. 3  and  FIG. 4  show the energy ratio of the ground truth, and the energy ratio for detection in each time frame, respectively. The ratio of ground truth in each frame is the energy ratio between the source with the largest energy, and the source with second largest energy. The threshold is selected as 50. 
         [0041]    The ratio of the ground truth indicates which frame contains only one active or a significantly dominant source, while the ratio of detection is the output of the process, which is used to determine whether a frame contains speech from a single speaker, or not. The detection ratios agree qualitatively with the ground truth. 
         [0042]      FIG. 7  shows pseudo code for our OSD process. The variables and equations are described in detail above. 
         [0043]    DOA Estimate 
         [0044]    The delay of arrival (DOA) estimation  645  between each of the considered channel and the reference channel is repeated for two purposes. On one hand, the DOA estimate for the single speaker (SS) segments helps to select a period of speech to estimate the spatial difference from a vehicle driver  670  to the microphones, which is used to steer the array before our sparse GSC  660 , and generate the BM as described below. 
         [0045]    On the other hand, the DOA estimate helps speaker turn detection, see below, to select all the segments where only the driver is speaking  670 . These segments are directly sent to the post-processing to surpress  675  interference, without being processed by our sparse GSC. 
         [0046]    As used herein, sparsity is not a relative term, but rather a term of art. In signal processing and numerical analysis, a sparse signal or sparse matrix is primarily populated with zeros. In particular, signals are sparse when the signals contain many coefficients close to or equal to zero. Sparsity corresponds to systems that are loosely coupled. When storing and manipulating sparse matrices, it is beneficial and often necessary to use specialized processes and data structures that take advantage of the sparse structure of the matrix, as described herein. 
         [0047]    To determine  645  the DOA between the reference channel and any other channel for any given segment, we estimate the DOA as the delay that causes the cross-correlation between the two signals segments to be a maximum. To improve accuracy in the case of reverberation, it is normal practice to use the Generalized Cross Correlation with Phase Transform (GCC-PHAT). 
         [0048]    Sparse GSC 
         [0049]    The signals discussed in this section ( 661 ) are all overlapping speech (OS), i.e., the target speech is interfered by other point audio sources. The observed signals from the microphone array is “steered” at the target using the FBF  510 . The FBF is used to enhance a target signal from a selected direction to a target, e.g., the vehicle driver. The direction of the target source, before steering, is typically the angle between the line extending from the center of the microphone array projected through the target source, and a line connecting the microphones. This direction is estimated by the short time average DOA of the single speaker segments, which in some applications can be assumed to be in a restricted angular range. For example, this range might be [20°, 50°], when the microphone array is suspended from the upper windshield area of the car, in front of the driver and passenger seats, and laterally centered along the midline of the car, and angles are measured such that positive angles indicate the driver&#39;s side and negative angles indicate the passenger side. Conventional beamforming methods  120  assume that the target signal propagates through a known direct path. However, in applications such as speech acquisition in adverse acoustic environments, e.g., vehicles, the source signal propagates along a direct path, and unknown multi-path, subject to reverberation effects. In such cases, the target signal is often cancelled to some extent by conventional adaptive beamforming methods. This problem is especially serious for microphone arrays in strong reverberant environments, such as vehicles. The performance significantly degrades due to the reverberation effects. 
         [0050]    Concerning the existence of reverberation effects, we use a novel channel model in the array processing. The spatial difference of the channel relating target source and two of the array elements is modeled as a pair of sparse filters to account for the reverberation effects. 
         [0051]    The blocking matrix (filter)  520  is used to suppress the target signal but enhance the interference and noise. In the reverberant environment, because the signal components at different frequency bins have different response characteristics, the conventional blocking filter cannot block the target signal efficiently. When the target signal leaks into the multi-channel adaptive filter, it results in target signal cancellation. 
         [0052]    Therefore, we modify the conventional BM  120  by including temporal information to block all the components of the target signal in our BM  520 . 
         [0053]    The GCC-PHAT is applied on the segments selected by the OSD, which confirms that these segments are due to a single point source. 
         [0054]    In the automotive environment, the driver&#39;s possible region is approximately [20°,50°]. Therefore, the segments with DOA in this range indicate the driver&#39;s speech. For the purpose of the computational efficiency, the OSD stops after the first driver only segment (denoted as D 0 ) is located. 
         [0055]    Microphone i, i=1, 2, . . . , M−1 is set as the reference channel, one by one, respectively. This optimization (Eq. 7) is called in D 0  for each pair of observed data x i  and x i+1 , to obtain a pair of sparse filters u i   i  and u i+1   i , where the superscript i indicates that ith reference channel is involved in the optimization problem and the subscript indicates the estimated channel index. Eventually, 
         [0000]    
       
         
           
             
               
                 
                   
                     y 
                     i 
                     BM 
                   
                   = 
                   
                     
                       
                         
                           
                             u 
                             i 
                             i 
                           
                           * 
                           
                             x 
                             
                               i 
                               + 
                               1 
                             
                           
                         
                         - 
                         
                           
                             u 
                             
                               i 
                               + 
                               1 
                             
                             i 
                           
                           * 
                           
                             x 
                             i 
                           
                         
                       
                       ≈ 
                       
                         
                           
                             h 
                             
                               i 
                               , 
                               
                                 k 
                                 0 
                               
                             
                           
                           * 
                           
                             x 
                             
                               i 
                               + 
                               1 
                             
                           
                         
                         - 
                         
                           
                             h 
                             
                               
                                 i 
                                 + 
                                 1 
                               
                               , 
                               
                                 k 
                                 0 
                               
                             
                           
                           * 
                           
                             x 
                             i 
                           
                         
                       
                     
                     = 
                     
                       
                         ∑ 
                         
                           j 
                           ≠ 
                           
                             k 
                             0 
                           
                         
                         
                             
                         
                       
                        
                       
                         
                           ( 
                           
                             
                               
                                 h 
                                 
                                   i 
                                   , 
                                   
                                     k 
                                     0 
                                   
                                 
                               
                               * 
                               
                                 h 
                                 
                                   
                                     i 
                                     + 
                                     1 
                                   
                                   , 
                                   j 
                                 
                               
                             
                             - 
                             
                               
                                 h 
                                 
                                   
                                     i 
                                     + 
                                     1 
                                   
                                   , 
                                   
                                     k 
                                     0 
                                   
                                 
                               
                               * 
                               
                                 h 
                                 
                                   i 
                                   , 
                                   j 
                                 
                               
                             
                           
                           ) 
                         
                         * 
                         
                           
                             s 
                             j 
                           
                           . 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   10 
                   ) 
                 
               
             
           
         
       
     
         [0056]    The source s k     0   , the only active source from driver in D 0 , is eliminated in the entire utterance, provided that the acoustic environment does not change so that estimation of real impulse response from target k 0  to microphone i and i+1 (h i,k     0    and h i+1,k     0   ) during D 0  is still valid for the whole utterance. 
         [0057]    The blocking filter W b    520  is constructed as 
         [0000]    
       
         
           
             
               
                 
                   
                     W 
                     b 
                   
                   = 
                   
                     
                       ( 
                       
                         
                           
                             
                               u 
                               2 
                               1 
                             
                           
                           
                             
                               - 
                               
                                 u 
                                 1 
                                 1 
                               
                             
                           
                           
                             0 
                           
                           
                             0 
                           
                         
                         
                           
                             0 
                           
                           
                             
                               u 
                               3 
                               2 
                             
                           
                           
                             
                               - 
                               
                                 u 
                                 2 
                                 2 
                               
                             
                           
                           
                             0 
                           
                         
                         
                           
                             0 
                           
                           
                             0 
                           
                           
                             
                               u 
                               4 
                               3 
                             
                           
                           
                             
                               - 
                               
                                 u 
                                 4 
                                 3 
                               
                             
                           
                         
                       
                       ) 
                     
                     . 
                   
                 
               
               
                 
                   ( 
                   11 
                   ) 
                 
               
             
           
         
       
     
         [0058]    The output signal y BM  of the blocking filter is 
         [0000]        y   BM   =W   b   *X.   (12),
 
         [0000]    where X=(x 1 ; x 2 ; . . . ;x M ) is the steered signals and * is a linear convolution. 
         [0059]    The output signal of the multichannel adaptive noise cancellation is 
         [0000]    
       
         
           
             
               
                 
                   
                     y 
                     = 
                     
                       
                         y 
                         FBF 
                       
                       - 
                       
                         
                           ∑ 
                           
                             m 
                             = 
                             1 
                           
                           
                             M 
                             - 
                             1 
                           
                         
                          
                         
                             
                         
                          
                         
                           
                             g 
                             m 
                           
                           * 
                           
                             y 
                             m 
                             BM 
                           
                         
                       
                     
                   
                   , 
                 
               
               
                 
                   ( 
                   13 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where y m   BM  is m-th output of BM, m=1, 2, . . . , M−1. 
         [0060]    There is a trade-off between sufficiently determining the filter g m  and the computation efficiency. A relatively long filter order, in which the number of coefficients in g m  is large, degrades the efficiency of the iteration by the least mean square (LMS), while a relatively short filter g m  that is less than the reverberation time of the vehicle (which may be 50 ms to 150 ms), cannot suppress all interference. With long filters of around 150 ms, sparse regularized convex optimization is incorporated and solved efficiently by the split Bregman method, see below. 
         [0061]    Sparse regularization can be used to improve the estimation of the filters as follows. The optimal solution g=(g 1 ; g 2 ; . . . ; g M−1 ) is obtained by minimizing the variance of beamforming output y with sparse regularization on the optimal solution g 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       g 
                       * 
                     
                     = 
                     
                       
                         
                           min 
                           g 
                         
                          
                         
                           
                              
                             
                               
                                 y 
                                 FBF 
                               
                               - 
                               
                                 
                                   ∑ 
                                   
                                     m 
                                     = 
                                     1 
                                   
                                   
                                     M 
                                     - 
                                     1 
                                   
                                 
                                  
                                 
                                     
                                 
                                  
                                 
                                   
                                     g 
                                     m 
                                   
                                   * 
                                   
                                     y 
                                     m 
                                     BM 
                                   
                                 
                               
                             
                              
                           
                           2 
                           2 
                         
                       
                       + 
                       
                         μ 
                          
                         
                           
                             ∑ 
                             
                               m 
                               = 
                               1 
                             
                             
                               M 
                               - 
                               1 
                             
                           
                            
                           
                               
                           
                            
                           
                             
                                
                               
                                 g 
                                 m 
                               
                                
                             
                             1 
                           
                         
                       
                     
                   
                   , 
                 
               
               
                 
                   ( 
                   14 
                   ) 
                 
               
             
           
         
       
     
         [0000]    which can be rewritten with matrix form as (Eqn. 8) and implemented by the split Bregman method. 
         [0062]    Furthermore, the output y of the sparse GSC corrects the reference of noise and interference y BM  at the BM stage. For each m, m=1, 2, . . . , M, cross cancellation is applied to y m   BM  and y by solving 
         [0000]    
       
         
           
             
               
                 
                   
                     ( 
                     
                       
                         u 
                         1 
                         * 
                       
                       , 
                       
                         u 
                         2 
                         * 
                       
                     
                     ) 
                   
                   = 
                   
                     
                       arg 
                        
                       
                         
                           min 
                           
                             ( 
                             
                               
                                 u 
                                 1 
                               
                               , 
                               
                                 u 
                                 2 
                               
                             
                             ) 
                           
                         
                          
                         
                           
                             1 
                             2 
                           
                            
                           
                             
                                
                               
                                 
                                   
                                     u 
                                     2 
                                   
                                   * 
                                   
                                     y 
                                     m 
                                     BM 
                                   
                                 
                                 - 
                                 
                                   
                                     u 
                                     1 
                                   
                                   * 
                                   y 
                                 
                               
                                
                             
                             2 
                             2 
                           
                         
                       
                     
                     + 
                     
                       
                         
                           η 
                           2 
                         
                         2 
                       
                        
                       
                         
                           ( 
                           
                             
                               
                                 ∑ 
                                 
                                   i 
                                   = 
                                   1 
                                 
                                 2 
                               
                                
                               
                                   
                               
                                
                               
                                 
                                   u 
                                   i 
                                 
                                  
                                 
                                   ( 
                                   1 
                                   ) 
                                 
                               
                             
                             - 
                             1 
                           
                           ) 
                         
                         2 
                       
                     
                     + 
                     
                       
                         μ 
                          
                         
                           ( 
                           
                             
                               
                                  
                                 
                                   u 
                                   1 
                                 
                                  
                               
                               1 
                             
                             + 
                             
                               
                                  
                                 
                                   u 
                                   2 
                                 
                                  
                               
                               1 
                             
                           
                           ) 
                         
                       
                       . 
                     
                   
                 
               
               
                 
                   ( 
                   15 
                   ) 
                 
               
             
           
         
       
     
         [0063]    The noise and interference reference y m   BM  is further updated by 
         [0000]        y   m   BM   ←u   2   *y   m   BM   −u   1   *y.   (16)
 
         [0064]    The sparse GSC is carried out by this loop updating y BM  and y. 
         [0065]      FIG. 5  shows our sparse GSC, which includes the FBF  510 , the block filters  520 , and the sparse regulizers  530 , for input  501 , and output  502 . 
         [0066]    It should be noted that the basic method can be performed iteratively until a termination condition is reached. In this embodiment, during each iteration, the filters are further optimized, and the interference and target signal are reestimated accordingly. The termination condition can be convergence of the filter parameters, or a fixed number of iterations. 
         [0067]    Speaker Turn Detection 
         [0068]    Speaker turn detection (STD)  650  is used on the observed speech data for which different point sources are active in turn. Distinguishing speakers by DOA estimation could be used. However, the difference of the DOAs in a vehicle is sometime not significant, especially when a radio or a music player is on, or a passenger in back seat behind the driver is speaking. 
         [0069]    In addition, the noise in the vehicle degrades the performance of the DOA estimation as well. Therefore, we use a more accurate method for STD, by an initial blind speech separation (BSS). 
         [0070]    Without loss of generality, M sources are active in turn in the observed data x m , m=1, 2, . . . , M. By calling the BSS method independent vector analysis (IVA), output z m , m=1, 2, . . . , M are generated as the estimate of each point source. 
         [0071]    We relax the criterion of convergence, and stopping iteration before sufficient convergence, to accelerate the processing. For each k, k=1, 2, . . . , M, we normalize z k  and Σ m≠k z m  respectively such that l 2  norm is 1. The energy ratio between z k  and Σ m≠k z m  (normalized) is calculated frame by frame (frame index j) as 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       R 
                       k 
                     
                      
                     
                       ( 
                       j 
                       ) 
                     
                   
                   = 
                   
                     
                       
                          
                         
                           
                             z 
                             k 
                           
                            
                           
                             | 
                             j 
                           
                         
                          
                       
                       2 
                       2 
                     
                     
                       
                          
                         
                           
                             
                               ∑ 
                               
                                 m 
                                 ≠ 
                                 k 
                               
                             
                              
                             
                                 
                             
                              
                             
                               z 
                               m 
                             
                           
                            
                           
                             | 
                             j 
                           
                         
                          
                       
                       2 
                       2 
                     
                   
                 
               
               
                 
                   ( 
                   17 
                   ) 
                 
               
             
           
         
       
     
         [0072]    Though the DOA estimation is not accurate enough to segment the speech by speakers. By labeling each frame, it can be used to label z m , m=1, 2, . . . , M as whose speech is dominant in z m . We need to locate the track k 0  where the driver&#39;s speech is dominant. Finally, the significantly large values in R k     0    indicate driver-only frames. The rest frames are replaced by 0&#39;s. 
         [0073]    Post-Filtering 
         [0074]    Signals sent to post-filtering  665  are further enhanced by an optimally-modified log-spectral amplitude (OM-LSA) speech estimator, which performs well for non-stationary noise environment, such as car. The spectral gain function, which minimizes the mean-square error of the log-spectra, is obtained as a weighted geometric mean of the hypothetical gains associated with the speech presence uncertainty. The noise estimate is an average of previous spectral power values, using a smoothing parameter that is adjusted by the speech presence probability in subbands. 
         [0075]    Implementation 
         [0076]    The split Bregman method is an efficient tool for solving optimization problems involving total variation, or l 1  regularizations. The method solves the unconstrained problem: 
         [0000]    
       
         
           
             
               
                 
                   min 
                   u 
                 
                  
                 
                   J 
                    
                   
                     ( 
                     
                       Φ 
                        
                       
                           
                       
                        
                       u 
                     
                     ) 
                   
                 
               
               + 
               
                 H 
                  
                 
                   ( 
                   u 
                   ) 
                 
               
             
             , 
           
         
       
     
         [0000]    where J is convex, but not necessarily differentiable such as the l 1  norm, H is convex and differentiable, and Φ is a linear operator. The idea of the split Bregman method is to introduce an auxiliary variable d=Φ u , and solve the constrained problem 
         [0000]    
       
         
           
             
               
                 
                   min 
                   
                     d 
                     , 
                     u 
                   
                 
                  
                 
                   J 
                    
                   
                     ( 
                     d 
                     ) 
                   
                 
               
               + 
               
                 H 
                  
                 
                   ( 
                   u 
                   ) 
                 
               
             
             , 
             
               
                 s 
                 . 
                 t 
                 . 
                 
                     
                 
                  
                 d 
               
               = 
               
                 Φ 
                  
                 
                     
                 
                  
                 
                   u 
                   . 
                 
               
             
           
         
       
     
         [0077]    This problem can be solved by the following iterations: 
         [0000]    
       
         
           
             
               ( 
               
                 
                   u 
                   
                     k 
                     + 
                     1 
                   
                 
                 , 
                 
                   d 
                   
                     k 
                     + 
                     1 
                   
                 
               
               ) 
             
             = 
             
               
                 arg 
                  
                 
                   
                     min 
                     
                       u 
                       , 
                       d 
                     
                   
                    
                   
                     J 
                      
                     
                       ( 
                       d 
                       ) 
                     
                   
                 
               
               + 
               
                 H 
                  
                 
                   ( 
                   u 
                   ) 
                 
               
               - 
               
                 〈 
                 
                   
                     p 
                     d 
                     k 
                   
                   , 
                   
                     d 
                     - 
                     
                       d 
                       k 
                     
                   
                 
                 〉 
               
               - 
               
                 〈 
                 
                   
                     p 
                     u 
                     k 
                   
                   , 
                   
                     u 
                     - 
                     
                       u 
                       k 
                     
                   
                 
                 〉 
               
               + 
               
                 
                   λ 
                   2 
                 
                  
                 
                   
                      
                     
                       d 
                       - 
                       
                         Φ 
                          
                         
                             
                         
                          
                         u 
                       
                     
                      
                   
                   2 
                   2 
                 
               
             
           
         
       
       
         
           
             
                 
             
              
             
               
                 p 
                 d 
                 
                   k 
                   + 
                   1 
                 
               
               = 
               
                 
                   p 
                   d 
                   k 
                 
                 - 
                 
                   λ 
                    
                   
                     ( 
                     
                       
                         d 
                         
                           k 
                           + 
                           1 
                         
                       
                       - 
                       
                         Φ 
                          
                         
                             
                         
                          
                         
                           u 
                           
                             k 
                             + 
                             1 
                           
                         
                       
                     
                     ) 
                   
                 
               
             
           
         
       
       
         
           
             
                 
             
              
             
               
                 
                   p 
                   u 
                   
                     k 
                     + 
                     1 
                   
                 
                 = 
                 
                   
                     p 
                     u 
                     k 
                   
                   - 
                   
                     
                       λΦ 
                       T 
                     
                      
                     
                       ( 
                       
                         
                           Φ 
                            
                           
                               
                           
                            
                           
                             u 
                             
                               k 
                               + 
                               1 
                             
                           
                         
                         - 
                         
                           d 
                           
                             k 
                             + 
                             1 
                           
                         
                       
                       ) 
                     
                   
                 
               
               , 
             
           
         
       
     
         [0000]    where          ·,·          is the inner product. For simplicity, we introduce a new variable b k =p d   k /λ, and note that p d   k =λb k  and p u   k =−λΦ T b k . Then d k+1  and u k+1  can be updated alternatively. 
         [0078]    The general split Bregman iteration is 
         [0000]    
       
         
           
             
               d 
               
                 k 
                 + 
                 1 
               
             
             = 
             
               
                 arg 
                  
                 
                   
                     min 
                     d 
                   
                    
                   
                     
                       1 
                       λ 
                     
                      
                     
                       J 
                        
                       
                         ( 
                         d 
                         ) 
                       
                     
                   
                 
               
               - 
               
                 〈 
                 
                   
                     b 
                     k 
                   
                   , 
                   
                     d 
                     - 
                     
                       d 
                       k 
                     
                   
                 
                 〉 
               
               + 
               
                 
                   1 
                   2 
                 
                  
                 
                   
                      
                     
                       d 
                       - 
                       
                         Φ 
                          
                         
                             
                         
                          
                         
                           u 
                           k 
                         
                       
                     
                      
                   
                   2 
                   2 
                 
               
             
           
         
       
       
         
           
             
               u 
               
                 k 
                 + 
                 1 
               
             
             = 
             
               
                 arg 
                  
                 
                   
                     min 
                     u 
                   
                    
                   
                     
                       1 
                       λ 
                     
                      
                     
                       H 
                        
                       
                         ( 
                         u 
                         ) 
                       
                     
                   
                 
               
               + 
               
                 〈 
                 
                   
                     b 
                     k 
                   
                   , 
                   
                     Φ 
                      
                     
                       ( 
                       
                         u 
                         - 
                         
                           u 
                           k 
                         
                       
                       ) 
                     
                   
                 
                 〉 
               
               + 
               
                 
                   1 
                   2 
                 
                  
                 
                   
                      
                     
                       
                         d 
                         
                           k 
                           + 
                           1 
                         
                       
                       - 
                       
                         Φ 
                          
                         
                             
                         
                          
                         u 
                       
                     
                      
                   
                   2 
                   2 
                 
               
             
           
         
       
       
         
           
             
               b 
               
                 k 
                 + 
                 1 
               
             
             = 
             
               
                 b 
                 k 
               
               - 
               
                 ( 
                 
                   
                     d 
                     
                       k 
                       + 
                       1 
                     
                   
                   - 
                   
                     Φ 
                      
                     
                         
                     
                      
                     
                       u 
                       
                         k 
                         + 
                         1 
                       
                     
                   
                 
                 ) 
               
             
           
         
       
     
         [0079]    In the case of (Eqn. 8), J(u)=μ∥u∥ 1 , Φ=I, and 
         [0000]    
       
         
           
             
               H 
                
               
                 ( 
                 u 
                 ) 
               
             
             = 
             
               
                 1 
                 2 
               
                
               
                 
                   
                      
                     
                       Au 
                       - 
                       f 
                     
                      
                   
                   2 
                   2 
                 
                 . 
               
             
           
         
       
     
         [0000]    The iterations are 
         [0000]    
       
         
           
             
               
                 
                   
                     d 
                     
                       k 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       arg 
                        
                       
                         
                           min 
                           d 
                         
                          
                         
                           
                             μ 
                             λ 
                           
                            
                           
                             
                                
                               d 
                                
                             
                             1 
                           
                         
                       
                     
                     - 
                     
                       〈 
                       
                         
                           b 
                           k 
                         
                         , 
                         
                           d 
                           - 
                           
                             d 
                             k 
                           
                         
                       
                       〉 
                     
                     + 
                     
                       
                         1 
                         2 
                       
                        
                       
                         
                            
                           
                             d 
                             - 
                             
                               u 
                               k 
                             
                           
                            
                         
                         2 
                         2 
                       
                     
                   
                 
               
               
                 
                   ( 
                   18 
                   ) 
                 
               
             
             
               
                 
                   
                     u 
                     
                       k 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       arg 
                        
                       
                         
                           min 
                           u 
                         
                          
                         
                           
                             1 
                             
                               2 
                                
                               λ 
                             
                           
                            
                           
                             
                                
                               
                                 Au 
                                 - 
                                 f 
                               
                                
                             
                             2 
                             2 
                           
                         
                       
                     
                     + 
                     
                       〈 
                       
                         
                           b 
                           k 
                         
                         , 
                         
                           u 
                           - 
                           
                             u 
                             k 
                           
                         
                       
                       〉 
                     
                     + 
                     
                       
                         1 
                         2 
                       
                        
                       
                         
                            
                           
                             
                               d 
                               
                                 k 
                                 + 
                                 1 
                               
                             
                             - 
                             u 
                           
                            
                         
                         2 
                         2 
                       
                     
                   
                 
               
               
                 
                   ( 
                   19 
                   ) 
                 
               
             
             
               
                 
                   
                     b 
                     
                       k 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       b 
                       k 
                     
                     - 
                     
                       
                         ( 
                         
                           
                             d 
                             
                               k 
                               + 
                               1 
                             
                           
                           - 
                           
                             u 
                             
                               k 
                               + 
                               1 
                             
                           
                         
                         ) 
                       
                       . 
                     
                   
                 
               
               
                 
                   ( 
                   20 
                   ) 
                 
               
             
           
         
       
     
         [0080]    Explicitly solving Eqns. 18-19 yields a process 
         [0000]    
       
         
           
             
               Initialize 
                
               
                   
               
                
               
                 u 
                 0 
               
             
             = 
             
               
                 d 
                 0 
               
               = 
               
                 
                   b 
                   0 
                 
                 = 
                 0 
               
             
           
         
       
       
         
           
             
               
                 While 
                  
                 
                    
                   
                     
                       u 
                       
                         k 
                         + 
                         1 
                       
                     
                     - 
                     
                       u 
                       k 
                     
                   
                    
                 
                  
                 
                   2 
                   / 
                   
                     
                        
                       
                         u 
                         
                           k 
                           + 
                           1 
                         
                       
                        
                     
                     2 
                   
                 
               
               &gt; 
               
                 
                   ɛ 
                    
                   
                     
 
                   
                   ( 
                   1 
                   ) 
                 
                  
                 
                     
                 
                  
                 
                   d 
                   
                     k 
                     + 
                     1 
                   
                 
               
             
             = 
             
               shrink 
                
               
                 ( 
                 
                   
                     
                       u 
                       k 
                     
                     + 
                     
                       b 
                       k 
                     
                   
                   , 
                   
                     μ 
                     λ 
                   
                 
                 ) 
               
             
           
         
       
       
         
           
             
               
                 ( 
                 2 
                 ) 
               
                
               
                   
               
                
               
                 u 
                 
                   k 
                   + 
                   1 
                 
               
             
             = 
             
               
                 
                   ( 
                   
                     
                       λ 
                        
                       
                           
                       
                        
                       I 
                     
                     + 
                     
                       
                         A 
                         T 
                       
                        
                       A 
                     
                   
                   ) 
                 
                 
                   - 
                   1 
                 
               
                
               
                 ( 
                 
                   
                     
                       A 
                       T 
                     
                      
                     f 
                   
                   + 
                   
                     λ 
                      
                     
                       ( 
                       
                         
                           d 
                           
                             k 
                             + 
                             1 
                           
                         
                         - 
                         
                           b 
                           k 
                         
                       
                       ) 
                     
                   
                 
                 ) 
               
             
           
         
       
       
         
           
             
               
                 ( 
                 3 
                 ) 
               
                
               
                   
               
                
               
                 b 
                 
                   k 
                   + 
                   1 
                 
               
             
             = 
             
               
                 b 
                 k 
               
               - 
               
                 d 
                 
                   k 
                   + 
                   1 
                 
               
               + 
               
                 u 
                 
                   k 
                   + 
                   1 
                 
               
             
           
         
       
       
         
           
             end 
              
             
                 
             
              
             While 
           
         
       
     
         [0081]    The function “shrink” is a soft threshold function defined by shrink(v,t)=(τ t (v 1 ), τ t (v 2 ), . . . , τ t (v NL )) with τ t (x)=sign(x)max{|x|−t,0}. The matrix A is fixed, and we can precalculate (λI+A T A) −1 , then the iterations only involve matrix multiplication. 
       EFFECT OF THE INVENTION 
       [0082]    The invention provides a system and method for generalized sidelobe cancellation (GSC). The method is particularly suited to complex audio environments, such as the interior of vehicles. There, interferences, such as speech from a codriver, rear-seat passengers, music or radio, engine and wind noise, can significantly degrade performance of an automatic speech recognition system. 
         [0083]    The invention can be used with speech-based command interfaces in vehicles. Applications include automatic dialog system for hands-free phone calls, as well as more advanced features, such as navigation systems. 
         [0084]    The issue of interference is addressed with adaptive interference cancellation techniques, i.e., generalized sidelobe cancellation (GSC), using sparse regularization techniques to improve its robustness. 
         [0085]    The embodiments distinguishes noise only segments (NO), single speaker segments (SS), and overlapping speech segments (OS), and then apply different sub-approaches to suppress diffuse noises and other interferences within different types of segments. 
         [0086]    A first stage is carried out by overlapping speech detection (OSD) and a voice activity detection, while the second stage is achieved by a blind speech separation (BSS) based speaker turn detection, direction of arrival estimation, sparse GSC and post-processing in the form of log-spectral amplitude estimation. 
         [0087]    Although the invention has been described by way of examples of preferred embodiments, it is to be understood that various other adaptations and modifications can be made within the spirit and scope of the invention. Therefore, it is the object of the appended claims to cover all such variations and modifications as come within the true spirit and scope of the invention.