Canonical Correlation and Correspondence Analysis of Longitudinal Data

CANONICAL CORRELATION AND CORRESPONDENCE ANALYSIS OF LONGITUDINAL DATA Jayesh Srivastava Old Dominion University, 2007 Director: Dr. Dayanand Naik Assessing the relationship between two sets of multivariate vectors is an important problem in statistics. Canonical correlation coefficients are used to study these re­ lationships. Canonical correlation analysis (CCA) is a general multivariate method that is mainly used to study relationships when both sets of variables are quantitative. When the variables are qualitative (categorical), a technique called correspondence analysis (CA) is used. Canonical correspondence analysis (CCPA) is used to deal with the case when one set of variables is categorical and the other set is quantitative. By exploiting the interrelationships between these three techniques we first provide a theoretical basis for CCPA. Next, in this dissertation, we have generalized each of these three techniques to analyze the relationships between two sets of repeatedly or longitudinally observed data. When the two vectors are quantitative, we use a block Kronecker product matrix to model dependency of the variables over time. We then apply canonical correlation analysis on this matrix to obtain canonical correlations and canonical variables. When the variables are qualitative, the data are summarized in the form of a contingency table. It is generally not straightforward to model dependency of contingency tables over time. However, we have proposed fitting correlated linear models to the summary statistics obtained by performing the usual correspondence analysis at each time period. We have shown that the most useful summary measure for this purpose is the first singular value of the correspondence matrix, which is essentially the matrix of relative frequencies obtained from the given contingency table. Our method is a reasonable approach to analyze repeated contingency table data. Finally, to deal with the case when one set of variables is categorical and R ep ro d u ced with p erm issio n o f th e copyrigh t ow n er. Further reproduction prohibited w ithout p erm ission . the other set is quantitative, we have proposed combining the two approaches to deal with quantitative and qualitative variables. We have illustrated and studied the performances of our methods my implementing them on simulated data sets. High dimensional data are now common due to the Internet, genomics, proteomics, and the like. Although, correspondence analysis and other methods consid­ ered in this dissertation are general techniques for analyzing multivariate data their usefulness for analyzing very high dimensional data have not been compared with the other more modern machine learning methods. In the last chapter of this dis­ sertation, we provide a brief introduction to a machine learning method that is used to analyze very high dimensional and sparse contingency table data from the field of language processing or information retrieval, named latent semantic analysis (LSA). We then propose certain criteria to compare the performance of LSA with the cor­ respondence analysis. Based on these criteria we find that under certain situations correspondence analysis performs better. R ep ro d u ced with p erm issio n o f th e copyrigh t ow n er. Further reproduction prohibited w ithout p erm ission .