# Invariant Measures Based on the U-Correlation Integral: An Application to the Study of Human Voice

Authors: Juan F. Restrepo; Gastón Schlotthauer
Journal: Complexity
 (2018)

---

## Abstract

Nonlinear measures such as the correlation dimension, the correlation entropy, and the noise level were used in this article to characterize normal and pathological voices. These invariants were estimated through an automated algorithm based on the recently proposed U-correlation integral. Our results show that the voice dynamics have a low dimension. The value of correlation dimension is greater for pathological voices than for normal ones. Furthermore, its value also increases along with the type of the voice. The low correlation entropy values obtained for normal and pathological type 1 and type 2 voices suggest that their dynamics are nearly periodic. Regarding the noise level, in the context of voice signals, it can be interpreted as the power of an additive stochastic perturbation intrinsic to the voice production system. Our estimations suggest that the noise level is greater for pathological voices than for normal ones. Moreover, it increases along with the type of voice, being the highest for type4 voices. From these results, we can conclude that the voice production dynamical system is more complex in the presence of a pathology. In addition, the presence of the inherent stochastic perturbation strengthens along with the voice type. Finally, based on our results, we propose that the noise level can be used to quantitatively differentiate between type 3 and type 4 voices.


---

## Body

## 1. Introduction

The human voice is the most important means of communication among individuals. Thanks to vocal communication, activities like asking for help are apparently trivial in our daily routine. Thus, a voice disorder can limit our ability to cover our most basic needs, producing a negative impact on our quality of life. For this reason, it is very important not only to increase our knowledge about the mechanism of voice production but also to characterize its dynamics in normal and pathological conditions.In the literature, several methodologies to assess human voices can be found. However, their reliability depends on the nature of the studied voice. Consequently, Titze proposed a qualitative classification for voice signals [1]. The scheme proposed by Titze divides the signals into three types: type 1 signals are nearly periodic voice signals, type 2 signals have strong modulation or subharmonics, and type 3 signals are characterized by a very irregular or even chaotic behavior. Sprecher et al. proposed a modification to this scheme. They redefined type 3 voices as being deterministic chaotic signals, adding a fourth type that is characterized by a dominant random-like behavior [2].Figure1 shows the time series, the state space reconstruction, and the spectrogram of each type of voice. A normal voice (first column) is characterized for a quasiperiodic time representation and a smooth attractor in the reconstructed state space. Moreover, from its spectrogram, one can easily observe the fundamental frequency and its harmonics. A pathological type 1 voice (second column) displays a more irregular time series than the normal voice. Notice that although their attractors are similar, pathological type 1 attractor is not so smooth. Furthermore, both spectrograms are also similar in the sense that one can still distinguish a fundamental frequency and its harmonics. Nevertheless, the noise content blurs the harmonics at high frequencies. In the case of a pathological type 2 voice (third column), it is possible to observe a less regular time series, compared to the pathological type 1 voice. The volume occupied by its attractor has been reduced and it is more difficult to distinguish a smooth shape. In its spectrogram, one can find subharmonic frequencies. The pathological type 3 voice (fourth column) is characterized by an irregular time series. The state space reconstruction is similar to the one of white Gaussian noise. Its spectrogram shows the fundamental frequency but its harmonics are rapidly blurred. Finally, a pathological type 4 voice (fifth column) has an irregular time series representation and a regular state space reconstruction, like the type 3 voice. In its spectrogram, one can find a fundamental frequency but not the harmonics.Figure 1
Time series, state space reconstruction, and spectrogram of normal and pathological voices. First column: normal voice; second column: pathological type1 voice; third column: pathological type 2 voice; fourth column: pathological type 3 voice; fifth column: pathological type 4 voice.These representations are useful to differentiate between some kinds of voices, for example, between normal and pathological type3 voices. However, it is very difficult to differentiate between a normal and a pathological type 1 voice or between a type 3 and a type 4 voice. The importance of this classification is based on the fact that traditional perturbation measures like jitter and shimmer give reliable results if they are applied to type 1 and type 2 signals. In contrast, nonlinear dynamics concepts should be used to characterize type 3 voices, whereas they are unreliable when applied to type 4 signals. Moreover, until now, the classification of type 4 voices has been done subjectively by visual inspection [2].Over the last three decades, strong evidence about the nonlinear behavior of the voice production mechanism has been collected [3–6], leading the scientific community to develop concepts and methods based on nonlinear dynamics and chaos theories. There exist an extensive set of publications in which those concepts have been used to characterize healthy and pathological voices. The correlation dimension (D) and the correlation entropy (K2) are two quantities that are used to characterize the complexity of a dynamical system. The former can be thought of as an estimation of the number of variables involved in the dynamics (degrees of freedom) [7]. The latter measures the rate at which information about the dynamics is lost over time. More complex systems are commonly characterized by having higher dimensions and entropy values [8].The correlation integral is the quantity used to estimateD and K2 [9]. It has been widely used in the biomedical field since it was proposed by Grassberger and Procaccia in the early 1980s [9].According to what we know so far, this correlation integral has been used in all studies that have estimatedD and K2 from voice signals. However, it is well known that the Grassberger and Procaccia approach is not robust in the presence of noise, and it needs special conditions to converge [10]. More robust variants of the correlation integrals have been proposed, like the Gaussian kernel correlation integral (GCI) [11] and the U-correlation integral [12].The objective of this article is to characterize the dynamics of normal and pathological voices through the correlation dimension, the correlation entropy, and the noise level(σ). Furthermore, we seek to statistically analyze these invariants for the four types of voices. As a novelty, we obtain these invariants using U-correlation integral through an automated algorithm [12] which allowed us to avoid subjective judgements. Finally, we propose a new quantitative methodology to differentiate between type 3 and type 4 voices.


## 2. Materials and Methods

The correlation dimension and the correlation entropy are invariants that characterize the natural measure of a dynamical system [13]. These invariants can be easily computed from the correlation integral which is obtained from indirect temporal measures of one of the variables of the system [9]. For an observed stationary time series of length N, xnn=1N, the reconstructed m-dimensional delay vectors xi=xi,xi+τ,…,xi-m-1τ,i=1,2,…,L=N-m-1τ, must be formed. The correlation integral Gmh, in its general form, is defined as the probability that the distance z~=xi-xj between two randomly selected m-dimensional delay vectors xi and xj is smaller than a value h [13]:(1)Gmh=∫gh,z~fz~mz~dz~,where gh,z~ is a kernel function and fz~mz~ is the probability density function (pdf) of the distance between pairs of delay vectors. In this article, we used the Euclidean distance.The Grassberger and Procaccia correlation integralCmh uses as a kernel function gh,z~=H1-z~/h, where H· is the Heaviside step function [9]. On the other hand, the GCI proposed by Diks et al., Tmh, adopts gh,z~=exp⁡-z~2/4h2 [11]. The main advantage of the GCI over the Grassberger and Procaccia correlation integral is that the former allows us to model the influence of additive noise on the scaling law.For a zero-mean time series of varianceσc2 with additive white Gaussian noise of variance σn2, the scaling rule is [11, 14, 15](2)Tmh~hmh2+σ2D-m/2e-mτK2form⟶∞,h2+σ2⟶0,where(3)σ=σnσc2+σn2.It is important to say that all time series used in this work were rescaled to have unitary standard deviation. In this sense,σ is the noise level after rescaling; that is, σ→0 corresponds to clean time series and σ→1 implies a pure stochastic process. The signal-to-noise ratio (SNR) can be calculated as(4)SNR=10log10⁡1-σ2σ2dB.In practical applications, it is very important to be able to quantifyσ, the noise level in the time series. This is because it allows us to correct the estimations of D and K2. Moreover, the conclusions driven by the interpretation of the invariants calculated in the presence of high levels of noise should be taken carefully. For this reason, an estimate of the noise level must be also reported, allowing the readers to be aware of the limitations of the estimates. On the other hand, when the data is taken under controlled conditions, like the voices in the database analyzed herein, a high noise level can be seen as an indicator of a dominant underlying additive stochastic process.The main disadvantage of the GCI is that it requires high values ofm to obtain a convergent estimate of K2 [10, 15]. This is because the pdf of the interpoint distance changes with the embedding dimension, whereas the GCI’s kernel does not (see (1)). As a result, the convergence of the GCI to K2 is slowed down [12]. The last statement also applies to the Grassberger and Procaccia correlation integral. As a solution, we have recently proposed the U-correlation integral (UCI) [12]: (5)Umβh=∫Γβ/2,z/h2Γβ/2f^mσ;zdz,where Γa,t is the upper incomplete Gamma function, Γa is the Gamma function, and f^mσ;z is the pdf of the squared interpoint distance. There are two important aspects about this correlation integral that deserve to be mentioned. First, note that the UCI’s kernel function, given by (6)gh,β,z=Γβ/2,z/h2Γβ/2,has a parameter β that is used to incorporate information about the embedding dimension. In other words, this kernel function is able to change according to m. Second, we are now working with the square of the interpoint distance, that is, z=z~2, to reduce the computational cost.The scaling law for the UCI is [12] (7)Umβh=ϕ^22σDΓD/2Γβ+m/2Γβ/2Γm/2+1e-mτK2h24σ2m/2Fβ+m2,m-D2;m+22;-h24σ2,where ϕ^ is a normalization constant and Fa,b;c;t is the Gauss hypergeometric function. The UCI is approximated with the U-correlation sum U^mβh which, in this article, is calculated as follows: first, we obtain the squared distances between each pair of m-dimensional delay vectors zω=xi-xj2, where ω={i,j/i=1,2,…L,j=1,2,…,L,i≠j}, and then(8)U^mβh=1Ω∑ω=1Ωgh,β,zω=1Ω∑ω=1ΩΓβ/2,zω/h2Γβ/2,where Ω=LL-1. The evaluation of the function gh,β,zω requires numerical integration which is computationally expensive. Instead, we performed the evaluation through spline interpolation of the function g^t=Γβ/2,t/Γβ/2, where t∈10-6,102 for each value of β.Once the correlation sum is calculated, we estimatedD, K2, and σ using coarse-grained estimators. These are explicit expressions for D, K2, and σ as functions of m and h [13]. Such functions are useful because they allow us to estimate the invariants and to visually confirm a scaling regime. In [16], we have presented three coarse-grained functions: DmUh, KmUh, and σmUh which are based on the UCI. As an advantage, they can be calculated in an automated manner from two U-correlation integrals. Moreover, we have proposed an automated algorithm to estimate D, K2, and σ from these coarse-grained estimators [16].


### 2.1. Coarse-Grained Estimators Based on UCI

Here, we present the coarse-grained estimators used in this study. A more detailed description can be found in [12, 16].We define the noise level functional as [12] (9)ΔmUh=12D˙m+2β=mh-D˙mβ=mh≈4σ2h2+4σ2form≫D,where (10)D˙mβh=dln⁡Umβhdln⁡h.This functional is the difference between the logarithmic derivatives of two U-correlation integrals:Umβ=mh, which is the UCI calculated with squared distances zω coming from m-dimensional delay vectors and a kernel with the parameter β=m, and Um+2β=mh. The last one is the correlation integral obtained from distances between pairs of m+2-dimensional delay vectors and a kernel with the parameter β=m.We have shown in [12] that ΔmUh is a function that decreases monotonically from 1 to 0 on a scale proportional to the value of σ. From this noise functional, we can define the noise level coarse-grained estimator as [12] (11)σmUh=h2ΔmUh1-ΔmUh.The coarse-grained estimators forD and K2 can be read as [16] (12)DmUh=D˙mβ=mh+ΔmUh1-ΔmUhD˙mβ=mh+2m-1Umβ=m-2hUmβ=mh-1,(13)KmUh=-12τln⁡Um+2β=m+2hUmβ=mh+ln⁡DmUhm+1+12τln⁡ΔmUhm-D˙mβ=mhm-DmUh+1-ΔmUhD˙mβ=mhm+1,respectively.The calculation ofDmUh requires the estimation of ΔmUh and two correlation integrals: Umβ=mh and Umβ=m-2h. On the other hand, KmUh depends on the correlation integrals Um+2β=m+2h and Umβ=mh, ΔmUh, the logarithmic derivative D˙mβ=mh, and the coarse-grained estimator DmUh.


### 2.2. Database

This study was conducted using theMassachusetts Eye & Ear Infirmary (MEEI) Voice Disorders Database, distributed byKay Elemetrics [17]. We have chosen a subset of 219 records (53 normal and 166 pathological) of sustained phonation of vowel/a/ [18]. Each record was downsampled to 10 kHz and the subjects’ descriptive statistics are presented in Table 1. From this set of voices, we excluded 3 records because they contained less than 8000 sample points, ending with a total of 216 records to be analyzed.Table 1
Analyzed subjects: number and age.
Condition Number Age (years) mean ± SD Male Female Male Female Healthy 21 32 38.8 ± 8.5 34.1 ± 7.8 Pathologic 67 96 41.2 ± 9.2 37.6 ± 8.3For each record, a centered window ofN=8000 data points was selected and normalized to have zero mean and unitary standard deviation. Then, the U-correlation sums were computed for m=4,6,…,20, τ=10, and h∈e-5,e2. Moreover, the nearest 10 temporal neighbors of each delay vector were discarded [7]. Finally, Algorithm 1 was applied. We must clarify that the range of values for the embedding dimension was selected taking into account the studies conducted in [6, 19–21], where a low-dimensional vocal system is suggested (D<5 for pathological voices). On the other hand, the embedding lag was selected as the average lag (over all voices) where the first minimum of the mutual information function occurs [7, 10].Algorithm 1:Automated estimation of attractors’ invariants.
(1) Calculate Umβ=mh and Umβ=m-2h using Eq. (8) for m>2. (2) Calculate ΔmUh using Eq. (9) and the UCIs obtained in step (1). (3) Compute σmUh with Eq. (11) and obtain the function Fσh. Estimate σ within a range ofh centered at the value h where Fσh is minimum. (4) Use Umβ=mh, Umβ=m-2h and ΔmUh to calculate DmUh (Eq. (12)) and obtain the functionFDh. Estimate D within a range of h centered at the value h where FDh is minimum. (5) Obtain KmUh (Eq. (13)) using Umβ=mh, ΔmUh and DmUh. Calculate the function FK2h. Estimate K2 within a range of h centered at the value h where FK2h is minimum.In a preliminary study, the pathological records were classified into Titze’s scheme based on the visual observation of the time series and its spectrograms. The classification resulted in74 type 1 records and 81 type 2 records. The remainder 11 voices where taken apart since these techniques cannot differentiate between type 3 and type 4 voices. Following the definition of type 4 voices given by Sprecher et al. in [2], we calculated the coarse-grained estimators DmUh and KmUh for these 11 voices. Then, we grouped together the voices that did show a scaling regime (finite correlation dimension and entropy) as type 3 and those that did not as type 4.


## 2.1. Coarse-Grained Estimators Based on UCI

Here, we present the coarse-grained estimators used in this study. A more detailed description can be found in [12, 16].We define the noise level functional as [12] (9)ΔmUh=12D˙m+2β=mh-D˙mβ=mh≈4σ2h2+4σ2form≫D,where (10)D˙mβh=dln⁡Umβhdln⁡h.This functional is the difference between the logarithmic derivatives of two U-correlation integrals:Umβ=mh, which is the UCI calculated with squared distances zω coming from m-dimensional delay vectors and a kernel with the parameter β=m, and Um+2β=mh. The last one is the correlation integral obtained from distances between pairs of m+2-dimensional delay vectors and a kernel with the parameter β=m.We have shown in [12] that ΔmUh is a function that decreases monotonically from 1 to 0 on a scale proportional to the value of σ. From this noise functional, we can define the noise level coarse-grained estimator as [12] (11)σmUh=h2ΔmUh1-ΔmUh.The coarse-grained estimators forD and K2 can be read as [16] (12)DmUh=D˙mβ=mh+ΔmUh1-ΔmUhD˙mβ=mh+2m-1Umβ=m-2hUmβ=mh-1,(13)KmUh=-12τln⁡Um+2β=m+2hUmβ=mh+ln⁡DmUhm+1+12τln⁡ΔmUhm-D˙mβ=mhm-DmUh+1-ΔmUhD˙mβ=mhm+1,respectively.The calculation ofDmUh requires the estimation of ΔmUh and two correlation integrals: Umβ=mh and Umβ=m-2h. On the other hand, KmUh depends on the correlation integrals Um+2β=m+2h and Umβ=mh, ΔmUh, the logarithmic derivative D˙mβ=mh, and the coarse-grained estimator DmUh.


## 2.2. Database

This study was conducted using theMassachusetts Eye & Ear Infirmary (MEEI) Voice Disorders Database, distributed byKay Elemetrics [17]. We have chosen a subset of 219 records (53 normal and 166 pathological) of sustained phonation of vowel/a/ [18]. Each record was downsampled to 10 kHz and the subjects’ descriptive statistics are presented in Table 1. From this set of voices, we excluded 3 records because they contained less than 8000 sample points, ending with a total of 216 records to be analyzed.Table 1
Analyzed subjects: number and age.
Condition Number Age (years) mean ± SD Male Female Male Female Healthy 21 32 38.8 ± 8.5 34.1 ± 7.8 Pathologic 67 96 41.2 ± 9.2 37.6 ± 8.3For each record, a centered window ofN=8000 data points was selected and normalized to have zero mean and unitary standard deviation. Then, the U-correlation sums were computed for m=4,6,…,20, τ=10, and h∈e-5,e2. Moreover, the nearest 10 temporal neighbors of each delay vector were discarded [7]. Finally, Algorithm 1 was applied. We must clarify that the range of values for the embedding dimension was selected taking into account the studies conducted in [6, 19–21], where a low-dimensional vocal system is suggested (D<5 for pathological voices). On the other hand, the embedding lag was selected as the average lag (over all voices) where the first minimum of the mutual information function occurs [7, 10].Algorithm 1:Automated estimation of attractors’ invariants.
(1) Calculate Umβ=mh and Umβ=m-2h using Eq. (8) for m>2. (2) Calculate ΔmUh using Eq. (9) and the UCIs obtained in step (1). (3) Compute σmUh with Eq. (11) and obtain the function Fσh. Estimate σ within a range ofh centered at the value h where Fσh is minimum. (4) Use Umβ=mh, Umβ=m-2h and ΔmUh to calculate DmUh (Eq. (12)) and obtain the functionFDh. Estimate D within a range of h centered at the value h where FDh is minimum. (5) Obtain KmUh (Eq. (13)) using Umβ=mh, ΔmUh and DmUh. Calculate the function FK2h. Estimate K2 within a range of h centered at the value h where FK2h is minimum.In a preliminary study, the pathological records were classified into Titze’s scheme based on the visual observation of the time series and its spectrograms. The classification resulted in74 type 1 records and 81 type 2 records. The remainder 11 voices where taken apart since these techniques cannot differentiate between type 3 and type 4 voices. Following the definition of type 4 voices given by Sprecher et al. in [2], we calculated the coarse-grained estimators DmUh and KmUh for these 11 voices. Then, we grouped together the voices that did show a scaling regime (finite correlation dimension and entropy) as type 3 and those that did not as type 4.


## 3. Results

The first result of the simulations can be observed in Figure2. It shows the coarse-grained estimators σmUh, DmUh, and KmUh for a normal voice (Figures 2(a), 2(f), and 2(k)), a pathological type 1 voice (Figures 2(b), 2(g), and 2(l)), a pathological type 2 voice (Figures 2(c), 2(h), and 2(m)), a pathological type 3 voice (Figures 2(d), 2(i), and 2(n)), and a pathological type 4 voice (Figures 2(e), 2(j), and 2(o)).Figure 2
Coarse-grained estimatorsσmUh, DmUh, and KmUh for normal and pathological voices. First column: normal voice; second column: pathological type 1 voice; third column: pathological type 2 voice; fourth column: pathological type 3 voice; fifth column: pathological type 4 voice. The curves for m=4,6,…,20 are color-coded in grayscale where the lightest gray corresponds to m=4.It is important to observe that all coarse-grained estimators present a scaling region, except the ones for correlation dimension andK2 entropy of type 4 voices. This highlights the suitability of these estimators to analyze normal and pathological (type 1, type 2, and type 3) voices.As it can be observed in the first row of Figure2, the noise level is greater for the pathological voices than for the normal voice and, in the pathological case, it increases along with the type. This means that, for both normal and pathological voices, there is an underlying stochastic component and its level increases in the presence of pathology.The behavior of the estimatorDmUh is presented in the second row of Figure 2. As it can be seen, this estimator suggests a value of D≈1.25 for normal voices and slightly greater values for pathological type 1 and type 2 voices. However, it is difficult to say whether there is any difference between the analyzed normal and pathological voice. Nevertheless, these results suggest that the voice production system has a relatively low dimension.Regarding the estimatorKmUh, it can be observed from the third row of Figure 2 that, for the voices analyzed herein, the estimator converges to values close to zero. This suggests the presence of a strong harmonic component. Furthermore, there exists a small increase of K2 entropy from normal voice to pathological type 1 voice and from the latter to pathological type 2 voice. This reflects an increasing degree of irregularity which is often associated with an increase in complexity.For the type3 voice, it can be observed in the fourth column of Figure 2 that the noise level coarse-grained estimator converges to a higher value than the one corresponding to the type 2 voice. However, it is still possible to observe a scaling range in both DmUh and KmUh. Moreover, these estimators converge to higher values than the ones for type 2 voice. On the other hand, for the type 4 voice (fifth column of Figure 2), it is not possible to find a scaling range either in dimension or in the entropy estimator. This behavior is expected since, by definition, these types of voices have an infinite value of dimension and entropy.As we mentioned before, this kind of nonlinear techniques should not be used with type4 voices. Note that, from the curves of DmUh and KmUh (Figures 2(j) and 2(o), resp.), it is not easy to decide whether there is a scaling range. In this sense, an untrained person could erroneously determine its existence, resulting in misleading estimations.On the other hand, a scaling range can be found forσmUh (Figure 2(e)), and it converges to a very high noise level value σ≈0.5 (SNR ≈4.77 dB). This suggests that the dynamics are mostly ruled by the underlying stochastic component. It is important to mention that this behavior is consistent in all voices that did not have a scaling region on DmUh and KmUh (type 4 voices). Based on this result, we suggest that a high value of σ could be a quantitative indicator of type 4 voices.In order to find a noise level value that allows us to differentiate between type3 and type 4 voices, we select by visual inspection all voices that did not show a scaling region on the estimators DmUh and KmUh. Then, for each signal, we estimate the noise level value from σmUh and select the minimum of these values (σthr=0.4) as a threshold.


### 3.1. Automated Estimation of Invariants

In order to obtain reliable estimations ofD, K2, and σ, it is essential to verify the existence of a scaling behavior over the coarse-grained estimators. Once it is found, one has to choose a range of h values from which to estimate the invariants. This choice is critical since, in practical application, the coarse-grained estimators strongly vary as a function of the scale. To avoid subjective judgements, we have proposed an algorithm (see Algorithm 1) for the automated estimation of D, K2, and σ based on the coarse-grained estimators DmUh, KmUh, and σmUh, respectively [16].This algorithm selects the scaling range where those invariants should be estimated based on the next criteria: (i) the coarse-grained estimator must be constant for a range of scale values and (ii) the value of the invariant should converge as the embedding dimension increases.The algorithm begins by approximating the U-correlation integralsUmβ=mh and Umβ=m-2h for different m values (m>2) using (8). Note that Umβ=m-2h must be calculated for m>2 since the shape parameter of the incomplete Gamma and Gamma functions must be greater than zero. Next, the logarithmic derivatives D˙mβ=mh and D˙m+2β=mh must be computed in order to obtain ΔmUh (see (9)). Observe that the correlation integral Um+2β=mh is equal to the correlation integral Um^β=m^-2h evaluated at m^=m+2. In this article, the logarithmic derivatives were obtained using a wavelet transform approach [22]. This produces a smooth version of the derivatives allowing us to better estimate the invariants.The noise level must be calculated from a range ofh where the coarse-grained estimator σmUh is nearly constant and its variation across the m values is the smallest. In this sense, for the noise level, we define the functions [16](14)Aσh=1M∑i=1MdσmiUhdln⁡h,Vσh=1M-1∑i=1MσmiUh-σ^Uh2,Fσh=AσhVσh,where m∈m1,m2,…,mi,…,mM and σ^Uh is the average of σmUh across m. Aσh is the average over m of the derivative of σmUh with respect to ln⁡h, Vσh gives the variation of σmUh across m, and Fσh is the product of the two aforementioned functions. We propose to estimate σ within a range of h centered at the h value at which Fσh is minimum. This way, σ is estimated in a range of h centered in a plateaued region (scaling region) of σmUh, and its value is consistent through the parameter m.The correlation dimension and the correlation entropy can be determined using the coarse-grained estimatorsDmUh (see (12)) and KmUh (see (13)), respectively. To find a range of h values to estimate D and K2, we use a similar approach, but from functions FDh and FK2h, respectively. The functions FDh and FK2h can be computed similarly to Fσh but using the coarse-grained estimators DmUh and KmUh, respectively.The estimation of each invariant for the whole group of signals is presented in Figure3. Figure 3(a) shows a box plot of the noise level estimation for normal (N), pathological type 1 (PT1), pathological type 2 (PT2), pathological type 3 (PT3), and pathological type 4 (PT4) voices. As it can be observed, σ is greater for pathological voices than for normal ones. However, it is not possible to establish a statistical difference between normal and pathological type 1 and type 2 voices. On the other hand, we can differentiate normal from pathological type 3 and type 4 voices. It is very important to say that the group labeled as TP4 was selected because they have a noise level value σ>0.4. Note that, using this threshold, we can separate type 3 from type 4 voices.Figure 3
Invariant estimation box plot: (a) noise level, (b) correlation dimension, and (c) correlation entropy. Normal (N), pathological type1 (PT1), pathological type 2 (PT2), pathological type 3 (PT3), and pathological type 4 (PT4) voices.
(a) (b) (c)The box plot of the correlation dimension is presented in Figure3(b). There is an increase of D from normal to pathological voices. For normal voices, the median is D=1.4; for pathological type 1 voices, D=1.68; for type 2 voices, D=2.23; and for type 3 voices, D=2.99. From these results, we can establish that the vocal system has a low dimension, even in the presence of a pathology. The group TP4 is not shown in this plot since, by definition, its dimension is infinite. Regarding the correlation entropy, it is shown in Figure 3(c) that there is a small increase of K2 from normal to pathological voices. However, it is not possible to find a statistical difference between normal, pathological type 1, and pathological type 2 voices. The median correlation entropy estimated for normal voices is K2=0.0038, for pathological type 1 voices is K2=0.0053, for pathological type 2 voices is K2=0.0068, and for pathological type 3 voices is K2=0.012.


## 3.1. Automated Estimation of Invariants

In order to obtain reliable estimations ofD, K2, and σ, it is essential to verify the existence of a scaling behavior over the coarse-grained estimators. Once it is found, one has to choose a range of h values from which to estimate the invariants. This choice is critical since, in practical application, the coarse-grained estimators strongly vary as a function of the scale. To avoid subjective judgements, we have proposed an algorithm (see Algorithm 1) for the automated estimation of D, K2, and σ based on the coarse-grained estimators DmUh, KmUh, and σmUh, respectively [16].This algorithm selects the scaling range where those invariants should be estimated based on the next criteria: (i) the coarse-grained estimator must be constant for a range of scale values and (ii) the value of the invariant should converge as the embedding dimension increases.The algorithm begins by approximating the U-correlation integralsUmβ=mh and Umβ=m-2h for different m values (m>2) using (8). Note that Umβ=m-2h must be calculated for m>2 since the shape parameter of the incomplete Gamma and Gamma functions must be greater than zero. Next, the logarithmic derivatives D˙mβ=mh and D˙m+2β=mh must be computed in order to obtain ΔmUh (see (9)). Observe that the correlation integral Um+2β=mh is equal to the correlation integral Um^β=m^-2h evaluated at m^=m+2. In this article, the logarithmic derivatives were obtained using a wavelet transform approach [22]. This produces a smooth version of the derivatives allowing us to better estimate the invariants.The noise level must be calculated from a range ofh where the coarse-grained estimator σmUh is nearly constant and its variation across the m values is the smallest. In this sense, for the noise level, we define the functions [16](14)Aσh=1M∑i=1MdσmiUhdln⁡h,Vσh=1M-1∑i=1MσmiUh-σ^Uh2,Fσh=AσhVσh,where m∈m1,m2,…,mi,…,mM and σ^Uh is the average of σmUh across m. Aσh is the average over m of the derivative of σmUh with respect to ln⁡h, Vσh gives the variation of σmUh across m, and Fσh is the product of the two aforementioned functions. We propose to estimate σ within a range of h centered at the h value at which Fσh is minimum. This way, σ is estimated in a range of h centered in a plateaued region (scaling region) of σmUh, and its value is consistent through the parameter m.The correlation dimension and the correlation entropy can be determined using the coarse-grained estimatorsDmUh (see (12)) and KmUh (see (13)), respectively. To find a range of h values to estimate D and K2, we use a similar approach, but from functions FDh and FK2h, respectively. The functions FDh and FK2h can be computed similarly to Fσh but using the coarse-grained estimators DmUh and KmUh, respectively.The estimation of each invariant for the whole group of signals is presented in Figure3. Figure 3(a) shows a box plot of the noise level estimation for normal (N), pathological type 1 (PT1), pathological type 2 (PT2), pathological type 3 (PT3), and pathological type 4 (PT4) voices. As it can be observed, σ is greater for pathological voices than for normal ones. However, it is not possible to establish a statistical difference between normal and pathological type 1 and type 2 voices. On the other hand, we can differentiate normal from pathological type 3 and type 4 voices. It is very important to say that the group labeled as TP4 was selected because they have a noise level value σ>0.4. Note that, using this threshold, we can separate type 3 from type 4 voices.Figure 3
Invariant estimation box plot: (a) noise level, (b) correlation dimension, and (c) correlation entropy. Normal (N), pathological type1 (PT1), pathological type 2 (PT2), pathological type 3 (PT3), and pathological type 4 (PT4) voices.
(a) (b) (c)The box plot of the correlation dimension is presented in Figure3(b). There is an increase of D from normal to pathological voices. For normal voices, the median is D=1.4; for pathological type 1 voices, D=1.68; for type 2 voices, D=2.23; and for type 3 voices, D=2.99. From these results, we can establish that the vocal system has a low dimension, even in the presence of a pathology. The group TP4 is not shown in this plot since, by definition, its dimension is infinite. Regarding the correlation entropy, it is shown in Figure 3(c) that there is a small increase of K2 from normal to pathological voices. However, it is not possible to find a statistical difference between normal, pathological type 1, and pathological type 2 voices. The median correlation entropy estimated for normal voices is K2=0.0038, for pathological type 1 voices is K2=0.0053, for pathological type 2 voices is K2=0.0068, and for pathological type 3 voices is K2=0.012.


## 4. Discussion

Bearing in mind that the used records were taken in a controlled environment, we could associate the noise level with the strength of an additive stochastic component that coexists with the dynamic producing the voice. There is a tendency ofσ to increase its value from normal voices to pathological ones. This can be seen as an increase of the power of the stochastic component caused by the presence of a pathology. Moreover, in pathological voices, σ increases its value along with the voice type.The definition of type4 voices given by Sprecher et al. [2] states that these signals are characterized by pure stochastic oscillations; therefore, their dimension is infinite [10]. In practice, it is not possible to measure an infinite correlation dimension value since it is bounded by the embedding dimension used to calculate the correlation integral. Instead, an infinite correlation dimension is inferred if there is not a scaling regime in the coarse-grained estimator of D. In previous studies, this was done through visual inspection, which is always a subjective judgement [2, 19].One interesting aspect of the coarse-grained estimatorσmUh is that, in the type 4 signals analyzed here, it always presents a scaling range from which to estimate σ, although DmUh and KmUh have no scaling regions. These results led us to think that the noise level can be used as an objective measure to discriminate between type 3 and type 4 voices.The threshold proposed here (σthr=0.4) was set using the voice signals that did not present a scaling regime in DmUh and KmUh. With this threshold, we were able to well separate type 3 and type 4 voices. Nevertheless, we are aware that this threshold was selected based on observations from this database. This finding must be validated with a more extensive study involving a larger number of records and voice care professionals.Our estimations of correlation dimension are in concordance with other studies [6, 19–21]. In [23], Choi et al. conducted a very similar simulation over the Kay Elemetrics database. They reported a mean value of D=1.57 for normal voices and an increased dimension value for pathological ones. Moreover, they obtained a decreasing SNR (it was calculated according to [24]) with the type of the voice, being the lowest for type 3 voices. However, they did not analyze type 4 voices. Another study by Zhang and Jiang conducted over the Kay Elemetrics database reported a mean correlation dimension of D=1.51 for normal voices and D=3.17 for a group with vocal tremor [25]. As far as we know, all researches conducted on normal and pathological voices have used the Grassberger and Procaccia correlation integral to estimate D and K2. This methodology has the disadvantage that its estimations are sensitive to noise presence, requires large m values to converge, and does not give an estimation of the noise level [10, 13]. However, other variants like the Gaussian correlation integral have not been used.Regarding the correlation entropy, our results suggest that pathological type1 and type 2 voices have a slightly greater value than normal ones. Furthermore, these three types of voices have a K2 value close to zero, suggesting nearly periodic dynamics. For type 3 voices, the values of K2 are the greatest, meaning more irregular and unpredictable dynamics. These values are comparable with those presented by Yan et al. [26]. They reported an estimation of K2 for normal (mean value K2=0.014) and esophageal phonation (mean value K2=0.023) subjects. In [27], Calawerts et al. calculated the largest Lyapunov exponent for type 1, type 2, and type 3 voices using the Kay Elemetrics database. Their results suggest an increase of the value of the largest Lyapunov exponent along with the type of the voice. Our results are in concordance with this study since we obtain an estimation of correlation entropy that not only is greater for pathological voices than for normal ones but also increases with the type of the voice.


## 5. Conclusions

In this article, we have studied normal and pathological voices through the correlation dimension, the correlation entropy, and the noise level. These invariants were estimated using an automated algorithm based on coarse-grained estimators derived from the U-correlation integral. The results suggest that the voice production dynamical system has a low dimension. The value ofD is greater for pathological voices than for normal ones. Moreover, its value also increases along with the type of the voice. Regarding the correlation entropy, its value is very low for normal and for type 1 and type 2 pathological voices. Although a more extensive study is still needed, this finding suggests that the system dynamics have a harmonic oscillatory behavior. On the other hand, pathological type 3 voices present higher values of K2, implying a more complex behavior which is reflected in a more irregular dynamic. The noise level can be interpreted as the power of a stochastic perturbation intrinsic to the voice production system. Our results show that σ is greater for pathological voices than for normal ones. Furthermore, it increases along with the type of voice, being the highest for type 4 voices. This means that the presence of the stochastic component is stronger in pathological voices. Based on these results, in this work, we have proposed a quantitative criterion that can be used to differentiate between type 3 and type 4 voices. We are aware of the limitation of the reduced samples of type 3 and type 4 voices. In this sense, these preliminary results will be validated with a more extensive study involving a larger number of records and voice care professionals.



---

*Source: 2173640-2018-04-17.xml*