Wavelet transform learning and applications

Transform learning (TL) is currently an active research area. It has been explored in several applications including image/video denoising, compressed sensing (CS) of magnetic resonance images (MRI), etc. and is observed to perform better than the existing transforms. However, TL involves non-convex optimization problem with no closed form solution and hence, is solved using greedy algorithms. A large number of variables (transform basis as well as transform coefficients) along with the greedy-based solution makes TL computationally expensive. Also, TL requires a large amount of training data for learning. Hence, it may run with challenges in applications where only single snapshots of short-duration signals such as speech, music or electrocardiogram (ECG) signal are available. Thus, one uses existing transforms that are signal independent. This motivates us to look for a strategy to learn transform in such applications. Among existing transforms, discrete wavelet transform provides an efficient representation for a variety of multi-dimensional signals. Owing to this, wavelets have been applied successfully in many applications. In addition, wavelet analysis provides an option to choose among existing basis or to learn new basis. This motivates us to learn wavelet transform from a given signal of interest that may perform better than the fixed transforms in an application. The learned wavelet transform is, hereby, called signal-matched wavelet transform. Since the translates of the wavelet filters associated with discrete wavelet transform form the basis in lspace, wavelet transform learning implies learning wavelet filter coefficients. This reduces the number of parameters required to be learned with wavelet learning compared to the traditional transform learning. Also, the requirement of learning fewer coefficients allows one to learn basis from a short single snapshot of signal or from the small training data. We also show that closed form solution exists for learning the wavelet transform unlike traditional transform learning. Although the problem of signal-matched wavelet design/learning has been explored in the literature, there are a number of limitations. Firstly, existing methods require full original signal to learn wavelet transforms and hence, these methods can not be used in inverse problems, where one has access to only the degraded signal and not to the original signal. Secondly, signal-matched wavelet transform learning is not explored for rational wavelets, although rational wavelets are observed to be more effective than dyadic wavelets in audio and speech signal processing. Thus, we note that there is a need for methods to learn signal-matched wavelets that are modular, have compactly supported filters for dyadic or rational wavelet systems, are easily implementable in DSP hardware, and can also be learned from degraded signals. This thesis is motivated to address these limitations and proposes a number of methods along with their utility in applications. Specifically, we propose methods to learn dyadic as well as rational wavelet transform using the lifting framework. The proposed method inherits all the advantages of lifting, i.e., the learned wavelet transform is always invertible, method