Abstract:
A system for remote assessment of a user is disclosed. The system comprises application software resident on a server and arranged to interact across a network with a user operating a client device to obtain one or more sample signals of the user&#39;s speech. A datastore is arranged to store the user speech samples in association with details of the user. A feature extraction engine is arranged to extract one or more first features from respective speech samples. A comparator is arranged to compare the first features extracted from a speech sample with second features extracted from one or more reference samples and to provide a measure of any differences between the first and second features for assessment of the user.

Description:
FIELD OF THE INVENTION 
   The present invention relates to a method and system for remote assessment of a user. 
   BACKGROUND OF THE INVENTION 
   C. Maguire, P. de Chazal, R. B. Reilly, P. Lacy “Automatic Classification of voice pathology using speech analysis”, World Congress on Biomedical Engineering and Medical Physics, Sydney, August 2003; and C. Maguire, P. de Chazal, R. B. Reilly, P. Lacy “Identification of Voice Pathology using Automated Speech Analysis”, Proc. of the 3rd International Workshop on Models and Analysis of Vocal Emission for Biomedical Applications, Florence, December 2003 disclose methods to aid in early detection, diagnosis, assessment and treatment of laryngeal disorders including feature extraction from acoustic signals to aid diagnosis. 
   J. I. Godino-Llorente, P Gomez-Vilda, “Automatic Detection of Voice Impairments by means of Short-Term Cepstral Parameters and Neural Network Based Detectors”  IEEE Transactions on Biomedical Engineering  Vol. 51, No. 2, pp. 380-384, February 2004 discloses a neural network based detector that is based on short-term cepstral parameters for discrimination between normal and abnormal speech samples. Using a subset of 135 voices from a publicly available database, Mel frequency cepstral coefficients (MFCCs) and their derivatives were employed as input features to a classifier which achieved an accuracy of 96.0% in classifying normal and abnormal voices. 
   Common to these and other prior art pathology detection systems is the recording environments of the voice samples under test. These comprise controlled recordings (soundproof recording room, set distance from patient to microphone) recorded at a sampling rate of approximately 25 kHz. 
   DISCLOSURE OF THE INVENTION 
   According to the present invention there is provided a system for remote assessment of a user according to claim  1 . 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
     Embodiments of the invention will now be described by way of example, with reference to the accompanying drawings, in which: 
       FIG. 1  is a schematic diagram of a system for remote assessment of a user according to a first embodiment of the invention. 
   

   DESCRIPTION OF THE PREFERRED EMBODIMENTS 
   Referring now to  FIG. 1 , in a first embodiment of the present invention, there is provided a system  10  of remotely detecting vocal fold pathologies using telephone quality speech. The system comprises a server  20  to which a remote user can connect using any one of a variety of client devices  12 ,  14 ,  16  equipped with a sound sampling mechanism. 
   One such device is a cellular/mobile phone  12  which connects across the GSM (Global System for Mobile Communications) network to the server  20  via a Voice XML gateway  30  running an Interactive Voice Recognition (IVR) application  32 . Alternatively, a user can employ a conventional telephone  14  connecting across the PSTN (Public Switched Telephone Network) to the gateway  30 . 
   The operation of the application  32  is governed by a script  34  which can be defined by an authoring package such as Voxbuilder produced by Voxpilot Limited, Dublin (www.voxpilot.com) and uploaded to the gateway  30  or uploaded to server  20  and linked back to gateway  30 . The user through interaction with the application  32  in a conventional manner using any combination of tone and/or speech recognition provides their details and any authentication information required. During execution, the application  32  captures a speech sample and this along with the user details is transmitted to the server  20 . In the preferred embodiment, the speech sample comprises a user&#39;s sustained phonation of the vowel sound /a/ (as in the English word “cap”). 
   An alternative interface can be provided by the server  20  by way of a web application. Where a client computer  16  includes a microphone, again through interaction with the application comprising web pages  36  resident on a server  25  (as indicated by the line  35 ), the users details as well as a speech sample can be captured and transmitted to the server  20 . 
   It will also be seen that a networked client computing device  16  can also be used to make, for example, an Internet telephony session connection with the IVR application  32  (as indicated by the line  33 ) in a manner analogous to the clients  12 ,  14 . 
   User details and their associated speech sample(s) are stored by the server  20  in a database  40 . The speech sample can be stored in any suitable for including in PCM (Pulse Code Modulation) or the sample may be stored in a coded form such as MP3 so that certain features such as harmonic or noise values can more easily be extracted from the signal at a later time. 
   According to requirements, either immediately in response to a speech samples being added to the database  40  or offline in batch mode, a feature extraction (FE) engine  50 , processes each speech sample to extract its associated features which will be discussed in more detail later. 
   As well as the database  40 , in the first embodiment, a database  60  of x=631 speech samples of the sustained phonation of the vowel sound /a/ is derived from the Disordered Voice Database Model 4337 acquired at the Massachusetts Eye and Ear Infirmary (MEEI) Voice and Speech Laboratory and distributed by Kay Elemetrics (4337 database) originally recorded at a sampling rate of 25 kHz. 
   The mixed gender 4337 database contains 631 voice recordings, each with an associated clinical diagnosis—573 from patients exhibiting a pathology and 58 for normal patients. The types of pathologies are diverse, ranging from Vocal Fold Paralysis to Vocal Fold Carcinoma. Vocalisations last from 1-3 seconds, over which time, periodicity should remain constant. 
   In the preferred embodiment, classification based on such steady state phonations is preferred to sentence based normal/abnormal classification. Within steady state phonations, it has been shown that the phoneme /a/ outperforms the higher cord-tension /i/ and /e/ phonemes. 
   In the first embodiment, speech samples from the database 4337 database were played over a long distance telephone channel to provide the speech samples stored in the database  60 . This process created a telephone quality voice pathology database for all 631 voice recordings in the 4337 database. 
   As an equivalent to being transmitted over actual phone lines, the speech samples of the 4337 database could be downsampled to limit bandwidth followed by a linear filter modelling the channel characteristics of the analogue first-hop in a telephone circuit followed then by an additive noise source, as illustrated in Table 1. 
   
     
       
             
           
             
             
             
             
           
         
             
               TABLE 1 
             
           
           
             
                 
             
             
               Pre-processing of voice sample database 
             
           
        
         
             
               1. 
               2. 
               3. 
               4. 
             
             
                 
             
             
               Pre-distortion, 
               Downsample 
               Spectral 
               Add noise: 
             
             
               10 kHz. 
               to 8 kHz: 
               Shaping: 
               Additive white 
             
             
                 
               Effective bandwidth 
               Linear filter 
               gaussian noise 
             
             
                 
               4 kHz. 
               200 Hz-3400 Hz. 
               at 30 dB SNR 
             
             
                 
             
           
        
       
     
   
   Nonetheless, it will be seen that that if high quality samples were available these could be stored in the database  60  and used in their high quality form. 
   As in the case of the samples in the database  40 , the feature extraction engine processes each of the speech samples in the database  60  to provide their respective feature vectors. 
   In the preferred embodiment, in general, the features extracted comprise pitch perturbation features, amplitude perturbation features and a set of measures of the harmonic-to-noise ratio (HNR). Preferably, the features extracted include the fundamental frequency (F 0 ), jitter (short-term, cycle to cycle, perturbation in the fundamental frequency of the voice), shimmer (short-term, cycle to cycle, perturbation in the amplitude of the voice), signal-to-noise ratios and harmonic-to-noise ratios. 
   Referring to Tables 2 and 3, pitch and amplitude perturbation measures were calculated by segmenting the speech waveform (2-5 seconds in length) into overlapping ‘epochs’. Each epoch is 20 msecond in duration with an overlap of 75% between successive epochs. For each epoch i, the value of the fundamental frequency, or pitch F i , is calculated and returned with its corresponding amplitude measure A i . These epoch values are used to create two one-dimensional vectors, defining that particular voice recordings&#39; “pitch contour” (the fundamental frequency captured over time) and “amplitude contour”. N voice  is a counting measure of any difference in pitch/amplitude between epoch value i and epoch value i+1 and n is the number of epochs extracted. 
   Mel Frequency Cepstral Coefficients (MFCC) features are commonly used in Automatic Speech Recognition (ASR) and also Automatic Speaker Recognition systems. The Cepstral domain is employed in speech processing, as the lower valued cepstral “quefrencies” model the vocal tract spectral dynamics, while the higher valued quefrencies contain pitch information, seen as equidistant peaks in the spectra. 
   The Harmonic to Noise Ratio measures for a speech sample is calculated in the Cepstral domain, as follows:
     1. Initially, the time domain signal, e.g. PCM format, for the speech sample is normalised to have zero mean and unit variance. This comprises calculating the mean and standard deviation for the individual samples of the speech sample. The mean amplitude value is then subtracted from each original sample value giving positive and negative valued samples with mean equal to zero. Each of these values is then subsequently divided by the standard deviation, producing sample values with variance equal to one.   2. In the preferred embodiment, the normalised samples for a 100 msecond epoch, are extracted from the middle of the speech sample.   3. The samples for the epoch are transformed into the frequency domain and a peak-picking algorithm locates the peaks at multiples of the fundamental frequency.   4. A bandstop filter in the Cepstral domain is applied to the signal. The stopband of the filter is limited to the width of each peak. The remaining signal is known as the rahmonics (harmonics in the cepstral domain) comb-liftered signal and contains the noise information.   5. The Fourier transform of this comb-liftered signal is taken, generating an estimate of the noise energy present N(f). Similarly, the Fourier Transform of the original cepstral-domain signal, including rahmonics is taken, O(f).   6. The HNR for a given frequency band B is then calculated as per
 
 HNR   β ( f )=mean( O ( f )) β −mean( N ( f )) β 
   

   Eleven HNR measures were calculated, as illustrated in Table 4. 
   
     
       
             
           
             
             
             
           
             
             
             
           
         
             
               TABLE 2 
             
           
           
             
                 
             
             
               Pitch Perturbation features 
             
           
        
         
             
               No 
               Description 
               Calculation Method 
             
             
                 
             
           
        
         
             
               1 
               Mean F0 (F0_av) 
               
                 
                   
                     
                       
                         1 
                         n 
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             1 
                           
                           n 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           F 
                           i 
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               2 
               Maximum F0 Detected (F0_hi) 
               max (F i ) 
             
             
               3 
               Minimum F0 Detected 
               min (F i ) 
             
             
                 
               (F0_lo) 
             
             
                 
             
             
               4 
               Standard Deviation of F0 contour 
               
                 
                   
                     
                       
                         1 
                         
                           n 
                           - 
                           1 
                         
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             1 
                           
                           n 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           
                             ( 
                             
                               
                                 F 
                                 i 
                               
                               - 
                               
                                 F 
                                 _ 
                               
                             
                             ) 
                           
                           2 
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               5 
               Phonatory Frequency Range 
               
                 
                   
                     
                       12 
                       × 
                       
                         
                           log 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           
                             ( 
                             
                               
                                 F 
                                 ⁢ 
                                 
                                     
                                 
                                 ⁢ 
                                 0 
                                 ⁢ 
                                 _hi 
                               
                               
                                 F 
                                 ⁢ 
                                 
                                     
                                 
                                 ⁢ 
                                 0 
                                 ⁢ 
                                 _lo 
                               
                             
                             ) 
                           
                         
                         
                           log 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           2 
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               6 
               Mean Absolute Jitter (MAJ) 
               
                 
                   
                     
                       
                         1 
                         
                           n 
                           - 
                           1 
                         
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             
                               n 
                               - 
                               1 
                             
                           
                           1 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                            
                           
                             
                               F 
                               
                                 i 
                                 + 
                                 1 
                               
                             
                             - 
                             
                               F 
                               i 
                             
                           
                            
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               7 
               Jitter (%) 
               
                 
                   
                     
                       MAJ 
                       
                         F 
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         0 
                         ⁢ 
                         _av 
                       
                     
                   
                 
               
             
             
                 
             
             
               8 
               Relative Average Perturbationsmoothed over 3 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               2 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 2 
                               
                               
                                 n 
                                 - 
                                 1 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       F 
                                       
                                         i 
                                         + 
                                         1 
                                       
                                     
                                     + 
                                     
                                       F 
                                       i 
                                     
                                     + 
                                     
                                       F 
                                       
                                         i 
                                         - 
                                         1 
                                       
                                     
                                   
                                   3 
                                 
                                 - 
                                 
                                   F 
                                   i 
                                 
                               
                                
                             
                           
                         
                         
                           F 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           0 
                           ⁢ 
                           _av 
                         
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               9 
               Pitch Perturbation Quotientsmoothed over 5 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               4 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 3 
                               
                               
                                 n 
                                 - 
                                 2 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       ∑ 
                                       
                                         k 
                                         = 
                                         
                                           i 
                                           - 
                                           2 
                                         
                                       
                                       
                                         i 
                                         + 
                                         2 
                                       
                                     
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     
                                       F 
                                       ⁡ 
                                       
                                         ( 
                                         k 
                                         ) 
                                       
                                     
                                   
                                   5 
                                 
                                 - 
                                 
                                   F 
                                   i 
                                 
                               
                                
                             
                           
                         
                         
                           F 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           0 
                           ⁢ 
                           _av 
                         
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               10 
               Pitch Perturbation Quotientsmoothed over 55 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               54 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 28 
                               
                               
                                 n 
                                 - 
                                 27 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       ∑ 
                                       
                                         k 
                                         = 
                                         
                                           i 
                                           - 
                                           27 
                                         
                                       
                                       
                                         i 
                                         + 
                                         27 
                                       
                                     
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     
                                       F 
                                       ⁡ 
                                       
                                         ( 
                                         k 
                                         ) 
                                       
                                     
                                   
                                   55 
                                 
                                 - 
                                 
                                   F 
                                   i 
                                 
                               
                                
                             
                           
                         
                         
                           F 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           0 
                           ⁢ 
                           _av 
                         
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               11 
               Pitch Perturbation Factor 
               
                 
                   
                     
                       
                         
                           
                             
                               
                                 N 
                                 
                                   p 
                                   ≥ 
                                   threshold 
                                 
                               
                               
                                 N 
                                 voice 
                               
                             
                             × 
                             100 
                           
                         
                       
                       
                         
                           
                             where 
                             , 
                           
                         
                       
                       
                         
                           
                             * 
                             
                               N 
                               p 
                             
                             ⁢ 
                             
                               :  
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             epoch 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             perturbation 
                             ⁢ 
                             
                               
                                   
                               
                               ⁢ 
                               
                                   
                               
                             
                             ⁢ 
                             across 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             time 
                           
                         
                       
                       
                         
                           
                             greater 
                             ⁢ 
                             
                               
                                   
                               
                               ⁢ 
                               
                                   
                               
                             
                             ⁢ 
                             than 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             0.5 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             msec 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             in 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             magnitude 
                           
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               12 
               Directional Perturbation Factor 
               
                 
                   
                     
                       
                         
                           
                             
                               
                                 N 
                                 
                                   Δ 
                                   ± 
                                 
                               
                               
                                 N 
                                 voice 
                               
                             
                             × 
                             100 
                           
                         
                       
                       
                         
                           
                             where 
                             , 
                           
                         
                       
                       
                         
                           
                             
                               * 
                               
                                 N 
                                 
                                   Δ 
                                   ± 
                                 
                               
                               ⁢ 
                               
                                 :  
                               
                               ⁢ 
                               epoch 
                               ⁢ 
                               
                                   
                               
                               ⁢ 
                               perturbation 
                               ⁢ 
                               
                                 
                                     
                                 
                                 ⁢ 
                                 
                                     
                                 
                               
                               ⁢ 
                               across 
                               ⁢ 
                               
                                   
                               
                               ⁢ 
                               time 
                               ⁢ 
                               
                                   
                               
                               ⁢ 
                               for 
                             
                             ⁢ 
                             
                                 
                             
                           
                         
                       
                       
                         
                           
                             which 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             there 
                             ⁢ 
                             
                               
                                   
                               
                               ⁢ 
                               
                                   
                               
                             
                             ⁢ 
                             is 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             a 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             change 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             in 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             algebraic 
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                               sign 
                               . 
                             
                           
                         
                       
                     
                   
                 
               
             
             
                 
             
           
        
       
     
   
   
     
       
             
           
             
             
             
           
             
             
             
           
         
             
               TABLE 3 
             
           
           
             
                 
             
             
               Amplitude Perturbation features 
             
           
        
         
             
               No 
               Description 
               Calculation method 
             
             
                 
             
           
        
         
             
               1 
               Mean Amp (Amp_av) 
               
                 
                   
                     
                       
                         1 
                         n 
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             1 
                           
                           n 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           A 
                           i 
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               2 
               Maximum Amp Detected 
               max (A i ) 
             
             
               3 
               Minimum Amp Detected 
               min (A i ) 
             
             
                 
             
             
               4 
               Standard Deviation of Amp contour 
               
                 
                   
                     
                       
                         1 
                         
                           n 
                           - 
                           1 
                         
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             
                               n 
                               - 
                               1 
                             
                           
                           1 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           
                             ( 
                             
                               
                                 A 
                                 i 
                               
                               - 
                               
                                 A 
                                 _ 
                               
                             
                             ) 
                           
                           2 
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               5 
               Mean Absolute Shimmer (MAS) 
               
                 
                   
                     
                       
                         1 
                         
                           n 
                           - 
                           1 
                         
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             
                               n 
                               - 
                               1 
                             
                           
                           1 
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                            
                           
                             
                               A 
                               
                                 i 
                                 + 
                                 1 
                               
                             
                             = 
                             
                               A 
                               i 
                             
                           
                            
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               6 
               Shimmer (%) 
               
                 
                   
                     
                       MAS 
                       Amp_av 
                     
                   
                 
               
             
             
                 
             
             
               7 
               Shimmer: Decibels 
               
                 
                   
                     
                       
                         1 
                         
                           n 
                           - 
                           1 
                         
                       
                       ⁢ 
                       
                         
                           ∑ 
                           
                             i 
                             = 
                             1 
                           
                           
                             n 
                             - 
                             1 
                           
                         
                         ⁢ 
                         
                             
                         
                         ⁢ 
                         
                           20 
                           × 
                           log 
                           ⁢ 
                           
                               
                           
                           ⁢ 
                           
                             ( 
                             
                               
                                 A 
                                 i 
                               
                               
                                 A 
                                 
                                   i 
                                   + 
                                   1 
                                 
                               
                             
                             ) 
                           
                         
                       
                     
                   
                 
               
             
             
                 
             
             
               8 
               Amplitude Relative Average Perturbationsmoothed over 3 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               2 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 2 
                               
                               
                                 n 
                                 - 
                                 1 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       A 
                                       
                                         i 
                                         + 
                                         1 
                                       
                                     
                                     + 
                                     
                                       A 
                                       i 
                                     
                                     + 
                                     
                                       A 
                                       
                                         i 
                                         - 
                                         1 
                                       
                                     
                                   
                                   3 
                                 
                                 - 
                                 
                                   A 
                                   i 
                                 
                               
                                
                             
                           
                         
                         Amp_av 
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               9 
               Amplitude Perturbation Quotientsmoothed over 5 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               4 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 3 
                               
                               
                                 n 
                                 - 
                                 2 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       ∑ 
                                       
                                         k 
                                         = 
                                         
                                           i 
                                           - 
                                           2 
                                         
                                       
                                       
                                         i 
                                         + 
                                         2 
                                       
                                     
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     
                                       A 
                                       ⁡ 
                                       
                                         ( 
                                         k 
                                         ) 
                                       
                                     
                                   
                                   5 
                                 
                                 - 
                                 
                                   A 
                                   i 
                                 
                               
                                
                             
                           
                         
                         Amp_av 
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               10 
               Amplitude Perturbation Quotientsmoothed over 55 pitch periods 
               
                 
                   
                     
                       
                         
                           
                             1 
                             
                               n 
                               - 
                               54 
                             
                           
                           ⁢ 
                           
                             
                               ∑ 
                               
                                 i 
                                 = 
                                 28 
                               
                               
                                 n 
                                 - 
                                 27 
                               
                             
                             ⁢ 
                             
                                 
                             
                             ⁢ 
                             
                                
                               
                                 
                                   
                                     
                                       ∑ 
                                       
                                         k 
                                         = 
                                         
                                           i 
                                           - 
                                           27 
                                         
                                       
                                       
                                         i 
                                         + 
                                         27 
                                       
                                     
                                     ⁢ 
                                     
                                         
                                     
                                     ⁢ 
                                     
                                       A 
                                       ⁡ 
                                       
                                         ( 
                                         k 
                                         ) 
                                       
                                     
                                   
                                   55 
                                 
                                 - 
                                 
                                   A 
                                   i 
                                 
                               
                                
                             
                           
                         
                         Amp_av 
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               11 
               Amplitude Perturbation Factor 
               
                 
                   
                     
                       
                         
                           N 
                           
                             p 
                             ≥ 
                             threshold 
                           
                         
                         
                           N 
                           voice 
                         
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
             
               12 
               Amplitude Directional Perturbation Factor 
               
                 
                   
                     
                       
                         
                           N 
                           
                             Δ 
                             ± 
                           
                         
                         
                           N 
                           voice 
                         
                       
                       × 
                       100 
                     
                   
                 
               
             
             
                 
             
           
        
       
     
   
   
     
       
             
           
             
             
             
           
             
             
             
           
         
             
               TABLE 4 
             
           
           
             
                 
             
             
               Harmonic to Noise Ratio Bands 
             
           
        
         
             
                 
               Band 
               Incorporating 
             
             
                 
               Number 
               Frequencies (Hz) 
             
             
                 
                 
             
           
        
         
             
                 
               1 
                0-500 
             
             
                 
               2 
                 0-1000 
             
             
                 
               3 
                 0-2000 
             
             
                 
               4 
                 0-3000 
             
             
                 
               5 
                 0-4000 
             
             
                 
               6 
                 0-5000 
             
             
                 
               7 
                500-1000 
             
             
                 
               8 
               1000-2000 
             
             
                 
               9 
               2000-3000 
             
             
                 
               10 
               3000-4000 
             
             
                 
               11 
               4000-5000 
             
             
                 
                 
             
           
        
       
     
   
   Again, according to requirements, in a first embodiment of the invention, a classification engine  70  is arranged to compare feature vectors for respective speech samples (probes) provided by remote users of the client devices  12 ,  14  or  16  to feature vectors from the database  60  either as they are written to the database or offline in batch mode. 
   In the first embodiment, the feature vectors of the database  60  are used to test and train automatic classifiers employing Linear Discriminant Analysis. Then depending on the Euclidian distance from the probe to the various samples or clusters of samples of the database  60 , an assessment of the user&#39;s condition may be made by the classification engine  70 . It will be seen that the classification engine could be re-defined to use Hidden Markov Models which would utilise features extracted in the time domain and discriminate between pathological and normal using a non-linear network. This result can in turn be written to the database  40  where it can be made available to either a user and/or their clinician either through via server  20  through the applications  32 ,  36  or by any other means. 
   It will be seen that while the servers  20 ,  25  and  30  are shown in  FIG. 1  as separate, these may in fact be combined as required. Also while the feature extraction engine  50  and classification engine  70  have been shown running independently, these could be implemented within any one or more of the servers  20 ,  25  and  30 . 
   While a sustained phonation, recorded in a controlled environment, can be classified as normal or pathologic with accuracy greater than 90%, results for the first embodiment indicate that a telephone quality speech can be classified as normal or pathologic with an accuracy of 74.2%. It has been found that amplitude perturbation features prove most robust in channel transmission. 
   When the database  60  was subcategorised into four independent clusters/classes of samples, comprising normal, neuromuscular pathologic, physical pathologic and mixed (neuromuscular with physical) pathologic, it was found that using these homogenous training and testing clusters/sets improved classifier performance, with neuromuscular disorders being those most often correctly detected. Results show that neuromuscular disorders could be detected remotely with an accuracy of 87%, while physical abnormalities gave accuracies of 78% and mixed pathology voice were separated from normal voice with an accuracy of 61%. 
   In a second embodiment of the invention, there is provided a system for remotely recording the symptoms of asthma sufferers. In general the system comprises the same blocks as in  FIG. 1  except that the database  60  is in general not required. 
   The second embodiment is distinct from the system of the first embodiment, where one speech sample need only be taken from a user for comparison against the database  60  to provide an assessment, in that multiple samples are taken for each user. The feature vectors for these samples are compared against the feature vectors for other speech samples from the same user to provide a record and an assessment of the user&#39;s condition over time. 
   So, for example, on or after registering for the system either through interaction with a modified IVR application  32  or web application  36 , the user provides a speech sample when not exhibiting asthmatic symptoms. This is stored in the database  40  as a reference sample #1 along with its extracted feature vector. Subsequently, when a user begins to exhibit asthma symptoms or in order to assess the degree to which they exhibit asthma symptoms, they connect to the server  20  through any one of the clients  12 - 16  using the modified applications  32 , 36  and provide a further speech sample. This subsequently provided speech sample is recorded and its corresponding feature vector extracted by the FE engine  50 . The distance of subsequently extracted feature vectors from the reference sample feature vector can be used as a measure of the degree of severity of the asthma attack. This measure can be normalised with reference to measures from the single user or with reference to measures taken from other users. Measures for users can in turn be used to assist a clinician in altering a patient&#39;s medication or in simply gaining an objective measure of the degree of severity of an attack, especially when the patient may only be in a position to report the attack to the clinician afterwards. 
   While the details provided above should be sufficient to enable the second embodiment to be implemented, it is worth noting that there has been some literature in the area of assessing spectro-temporal aspects of speech samples for asthma sufferers. These include:
         Gavriely, Breath Sounds Methodology. CRC Press, 1995.   R A Sovijarvi, F Dalmasso, J Vanderschoot, Malmberg. Definition of terms for applications of respiratory sounds. Eur Respir Rev, 10:77, pp 597-610, 2000.   Hans Pasterkamp, Steve S Kraman and George Wodicka. Respiratory Sounds: Advances Beyond the Stethoscope. Am J Respir Crit Care Med. Vol 156. pp 974-987, 1997.   R. P Baughman and Loudon. Lung Sound analysis for continuous evaluation of airflow obstruction in asthma. Chest, Vol 88, 364-368, 1985   Meslier, N. G. Charbonneau, and J. L. Racineux. Wheezes. Eur. Respir J. 8 :1942-1948, 1995   Y Shabtai-Musih, J B Grotberg, N Gavriely. Spectral Content of Forced Expiratory Wheezes during air, He, and SF6 Breathing in Normal Humans. J Appl Physiol, 72:629-635, 1992.   Homs-Corbera, A., J. A. Fiz, J. Morera, R. Jané (2004). Time-Frequency Detection and Analysis of Wheezes during Forced Exhalation. IEEE Transactions on Biomedical Engineering, vol. 51, n. 1, pp. 182-186.   José A Fiz, Raimon Jané, D Salvatella, José Izquierdo, L Lores, P Caminal, Jose Morera. Analysis of traqueal sounds during forced exhalation in asthma patients and normal subject. Chest, 116, 3, 1999.   José A Fiz, Raimon Jané, Antoni Hons, José Izquierdo, Maria A Garcia and Jose Morera. Detection of wheezing during maximal forced exhalation in patients with obstructed airways. Chest, 122, pp: 186 191. 2002.   R. Jané, J. A Fiz, J. Morera. Analysis of Wheezes in Asthmatic Patients during Spontaneous Respiration. Proc of the 26 th  Annual International Conference of the IEEE EMBS pp. 3836-3839. 2004.       

   All have considered frequency analysis in the 100-2000 Hz range and these support the merit of results provided by a telephony based assessment application according to the second embodiment. As such, in a particularly preferred implementation of the second embodiment, sample audio signals can be acquired with a sampling frequency of as low as 5000 Hz. Each sample audio signal is preferably between 20 and 120 seconds long and includes at least one respiratory cycle. These samples are stored in the database  40  and each sample is associated both with the patient and also with details of the patient&#39;s state when providing the sample. 
   The FE engine  50  is adapted to first use a zero-crossing detector when processing stored or acquired sample audio signals. This involves analysing the audio signal in the time domain to separate stored or acquired sample audio signals into portions, each comprising an inspiration or an expiration phase of breathing. As in the case of HNR above, the individual samples of the audio signal are first normalised to have zero mean so giving individual positive and negative sample values. The zero-crossing detector parses the audio signal to determine where the sample values change sign. Contiguous groups of normalised samples valued above or below the mean are taken to indicate the mid point of an inpiration or expiratory phase. Alternate, contiguous groups of such signal samples are therefore taken as inpiration and expiratory phases respectively. 
   A signal portion comprising an expiratory phase is required to analyse respiratory sounds in spontaneous and forced manoeuvres, as it is known that there is a higher contribution of wheezing during expiration. 
   The FE engine  50  continues by analysing expiration phases for each respiratory cycle in the frequency domain as follows:
         Each expiration phase sample signal portion is divided into segments (typically 14).   The power spectral density (PSD) of these segments is estimated, using an autoregressive model (typically of order  16 ). Preferably, only the central temporal segments are considered because the airflow is more stable in these segments. So for example, a central 10 segments can be chosen from 14 sample segments.   The mean frequency (F 0  as discussed previously) or alternatively the peak frequency (used as F 0 ) is estimated in the band 100-2000 Hz for each segment.   A mean or median value of F 0  (feature  1  listed in Table 2) is obtained for the segments of a respiratory cycle.   A mean or median value of F 0  can then be taken across all of the cycles of a sample signal.       

   The FE engine stores F 0  for each speech sample produced by a patient in the database  40 . Values of F 0  can be studied for samples taken during different manoeuvres (spontaneous and forced) and patient state (baseline and after bronchodilator inhalation) and the patient can be guided through interaction with the application  32 , 36  to either conduct specific manoeuvres while providing their speech sample(s) or to supply details of their state when providing their speech sample(s). 
   It has been shown that analysis in the bandwidth 600-2000 Hz allows quantification of wheezes episodes. As such, if the F 0  inside of the 600-2000 Hz band changes during a number of consecutive segments of a cycle, a wheeze is considered to have occurred in this expiration. The degree of fluctuation can used to assess the degree of obstruction in a patient&#39;s breathing and to follow-up with treatment or to adjust the treatment of the patient.