Distribution temps-fréquence à paramétrisation radialement Gaussienne optimisée pour la classification Optimizing time-frequency representations for signal classification using radially Gaussian kernels

and key words Time-frequency and time-scale distributions offer a broad class of tools for nonstationary signal analysis. The price to pay is however the choice of a well-adapted, possibly signal-dependent, representation. Time-frequency distributions with radially Gaussian kernel (RGK) provide tunable representations for a large class of applications. This parameterization was initially introduced by Baraniuk and Jones in [1] for reducing interference terms in time-frequency distributions. The RGK has attracted the attention of many researchers since this pioneering work, for instance [3] where it is optimized for a given classification problem. However, all these works do not necessarily take advantage of the recent developments in pattern recognition with kernel machines. This paper provides a connection between the optimization of RGK for classifying non-stationary signals and some criteria coming from the machine learning literature. We consider more specifically the kernel-target alignment, a criterion that allows to select optimal reproducing kernels. We show that this criterion leads to an optimization problem similar to that initially proposed by Baraniuk and Jones for signal analysis. Experimental results demonstrate the relevance of our approach. Over the last decade, a wide class of pattern recognition algorithms based on the theory of reproducing kernel Hilbert spaces have been proposed, with improved performance and low computational complexity. The latter is mainly due to the kernel trick, a key idea that allows to transform any conventional linear technique into a nonlinear one if it can be expressed only in terms of inner products. It suffices to replace them by a reproducing kernel, since it corresponds to an traitement du signal 2008_volume 25_numero 6 469 inner product between data mapped (implicitly) into a nonlinearly transformed space. Most popular kernel machines include the Support Vector Machines (SVM) for classification and regression [9], kernel principal component analysis [9] and kernel Fisher discriminant analysis [10]. Recently, we have presented in [13, 14] a new framework for nonstationary signal classification and analysis based on machine learning considerations. For this purpose, we considered the Cohen’s class of time-frequency distributions as a natural choice for nonlinear transformations to be applied to nonstationary signals. It can be shown that the reproducing kernel associated to these spaces of representations can be written as (17). Here is the parameterizing function of the time-frequency distribution, expressed in polar coordinates, and Ax the ambiguity function. The cumbersome optimization of the two-dimensional function can be overcome by using the RGK, which is of the form σ(r,θ) = e−r/2σ(θ). By injecting this expression into the general form of the reproducing kernel defined in (17), we get (18). Equivalently, by considering the discretization recommended in [16] that involves polar coordinates, we get (19) where r = 2 √ π/ with the signal length. By considering such a reproducing kernel, we can therefore use the most effective and innovative kernel machines to process time-frequency representations. We can also take advantage of the large spectrum of kernel selection criteria in the machine learning literature to optimize time-frequency representations. In what follows, we study one particular criterion, the kernel-target alignment. Introduced by Cristianini et al. in [30], the alignment is a measure of similarity between two reproducing kernels, or between a reproducing kernel and a target function. Given a learning set, the alignment between two kernels κ1 and κ2 is defined by (20) where 〈· ,·〉F is the Frobenius inner product, and K1 and K2 the Gram matrices with (i, j)-th entries κ1(xi ,xj ) and κ2(xi ,xj ) . In [20, 30], Cristianini et al. suggest to determine the optimal reproducing kernel for a given classification problem as the one that maximizes the alignment with an ideal kernel. The ideal kernel for a bi-class problem is the one that transforms each xi into its label yi. The (i, j)-th entry of the resulting ideal Gram matrix then is yi yj. Therefore the kernel-target alignment criterion applied to a σ-tunable kernel is given by (22), namely, σ∗ = arg max σ 〈Kσ,K ∗〉F/n‖Kσ‖F where Kσ denotes the Gram matrix of the tunable kernel and K ∗ the ideal target matrix. By considering the reproducing kernel associated with the RGK time-frequency distribution, we can further simplify the resulting optimization problem. For this purpose, we can write it as an optimization problem that consists of maximizing the numerator of the objective function in (22) subject to setting its denominator to a constant. This optimization problem is given by (23) subject to (24), where υ0 is a normalization parameter. By injecting the RGK-based reproducing kernel, we can write the objective function as (25). We get an objective function similar to the one proposed in [1] within a signal analysis context. The signal-dependent entry in the latter, say |Ax(r,θ)|2, is substituted here by the so-called equivalent representation defined by |Aeq(r,θ)|2 = ∑ i, j yi yj Axi (r,θ) Axj (r,θ) . We can therefore take advantage of the alternate-projection technique proposed in [1]. In particular, we relax the constraint (24) and replace it with a low-cost computation constraint on the volume of the parameter function as follows : ∫ σ2(θ) dθ = υ ′ 0. Compared with [1], it is worth noting that the computational complexity of the technique remains unchanged once we have evaluated the equivalent representation. In order to solve the optimization problem, we consider an alternate-projecting technique inspired from [1] with two updating rules at each iteration. Let σk be the bandwidth parameter at iteration k. At iteration k + 1, we perform a gradient ascent update using expression (28), where μk is the step-size parameter controlling the convergence of the algorithm, and f the objective function to be maximized in (26). The gradient of f is defined by the vector of entries given by expression (29) for θ = 0,1,. , − 1. In order to take into account the constraint in the optimization problem, we project the solution onto the set of admissible functions. This can be implemented by normalizing σk+1(θ) at each iteration step with ‖σk+1(θ)‖/υ ′ 0. In order to illustrate the relevance of our approach, we propose to study two classification problems. Each one consists of two classes of two hundred 64-sample signals with a linear frequency modulation embedded in a white Gaussian noise. The signal-to-noise ratio is approximately –8 dB. In the first problem, signals are characterized by an increasing frequency modulation, from 0.1 to 0.25 for the first class, and from 0.25 to 0.4 for the second one. In the second problem, signals are characterized by an increasing frequency modulation from 0.1 to 0.4, and by a decreasing one from 0.4 to 0.1. Figure 1 shows the resulting RGK parameterization function. We observe that the regions in the Doppler-lag plan are relevant for the classification problems we have considered. The convergence of the algorithm is 470 traitement du signal 2008_volume 25_numero 6 Distribution temps-frequence a parametrisation radialement Gaussienne optimisee pour la classification