correlation functions cluster functions and spacing distributions for random matrices the usual formulas for the correlation functions in orthogonal and symplectic matrix models express them as quaternion determinants from this representation one can deduce formulas for spacing probabilities in terms of fredholm determinants of matrix valued kernels the derivations of the various formulas are somewhat involved in this article we present a direct approach which leads immediately to scalar kernels for the unitary ensembles and matrix kernels for the orthogonal and symplectic ensembles and the representations of the correlation functions cluster functions and spacing distributions in terms of them

outlier robust pca the high dimensional case principal component analysis plays a central role in statistics engineering and science because of the prevalence of corrupted data in real world applications much research has focused on developing robust algorithms perhaps surprisingly these algorithms are unequipped indeed unable to deal with outliers in the high dimensional setting where the number of observations is of the same magnitude as the number of variables of each observation and the dataset contains some arbitrarily corrupted observations we propose a high dimensional robust principal component analysis algorithm that is efficient robust to contaminated points and easily kernelizable in particular our algorithm achieves maximal robustness it has a breakdown point of 50 the best possible while all existing algorithms have a breakdown point of zero moreover our algorithm recovers the optimal solution exactly in the case where the number of corrupted points grows sublinearly in the dimension

a note on universality of the distribution of the largest eigenvalues in certain sample covariance matrices recently johansson and johnstone proved that the distribution of the properly rescaled largest principal component of the complex real wishart matrix x x xtx converges to the tracy widom law as n p the dimensions of x tend to in some ratio n p 0 we extend these results in two directions first of all we prove that the joint distribution of the first second third etc eigenvalues of a wishart matrix converges after a proper rescaling to the tracy widom distribution second of all we explain how the combinatorial machinery developed for wigner random matrices in refs 27 38 and 39 allows to extend the results by johansson and johnstone to the case of x with non gaussian entries provided n p o p1 3 we also prove that max n1 2 p1 2 2 o p1 2 log p a e for general 0

on the number of principal components in high dimensions we consider the problem of how many components to retain in the application of principal component analysis when the dimension is much higher than the number of observations to estimate the number of components we propose to sequentially test skewness of the squared lengths of residual scores that are obtained by removing leading principal components the residual lengths are asymptotically left skewed if all principal components with diverging variances are removed and right skewed if not the proposed estimator is shown to be consistent performs well in high dimensional simulation studies and provides reasonable estimates in a number of real data examples

pca consistency in high dimension low sample size context principal component analysis pca is an important tool of dimension reduction especially when the dimension or the number of variables is very high asymptotic studies where the sample size is fixed and the dimension grows i e high dimension low sample size hdlss are becoming increasingly relevant we investigate the asymptotic behavior of the principal component pc directions hdlss asymptotics are used to study consistency strong inconsistency and subspace consistency we show that if the first few eigenvalues of a population covariance matrix are large enough compared to the others then the corresponding estimated pc directions are consistent or converge to the appropriate subspace subspace consistency and most other pc directions are strongly inconsistent broad sets of sucient conditions for each of these cases are specified and the main theorem gives a catalogue of possible combinations in preparation for these results we show that the geometric representation of hdlss data holds under general conditions which includes a mixing condition and a broad range of sphericity measures of the covariance matrix

generalized measures of fault tolerance for bubble sort networks abstract the k and k are two generalized measurements for fault tolerance of large scale processing system for the bubble sort networks bn this paper determines k b n k b n 2 k n k 1 for k n 2 the results show that to disconnect bn with each vertex in resulting graph has at least k fault free neighbors at least 2 k n k 1 faulty vertices or faulty edges have to occur in particular the results also settle affirmatively a conjecture proposed by shi and wu acta math appl sin e 33 4 2017 933 944

convergence of sample eigenvalues eigenvectors and principal component scores for ultra high dimensional data the development of high throughput biomedical technologies has led to increased interest in the analysis of high dimensional data where the number of features is much larger than the sample size in this paper we investigate principal component analysis under the ultra high dimensional regime where both the number of features and the sample size increase as the ratio of the two quantities also increases we bridge the existing results from the finite and the high dimension low sample size regimes embedding the two regimes in a more general framework we also numerically demonstrate the universal application of the results from the finite regime

conditional connectivity of recursive interconnection networks respect to embedding restriction abstract large scale multiprocessor systems always take some recursive interconnection networks as underlying topologies let g n be an n dimensional recursive interconnection network the m embedding restricted connectivity m g n resp the m embedding restricted edge connectivity m g n of g n is the cardinality of a minimum subset of nodes resp edges if any whose deletion disconnects g n and each node of the remaining components lies in an undamaged m dimensional sub network g m in this paper we present some relationships between the proposed indices and other conditional connectivity indices in general recursive interconnection networks we give some bounds on these two indices in k ary n cubes and bubble sort networks in addition we determine these two indices in k ary n cubes and bubble sort networks in some cases

correspondence a counterexample to generalized eigenvalue based stability tests for 2 d linear systems necessary and sufficient conditions by fu p chen j and s i niculescu we present a counterexample contradicting the equivalence of statements i ii and iii v of theorem 1 of fu chen and niculescu 2006

on the distribution of the largest eigenvalue in principal components analysis let x 1 denote the square of the largest singular value of an n p matrix x all of whose entries are independent standard gaussian variates equivalently x 1 is the largest principal component variance of the covariance matrix x x or the largest eigenvalue of a p variate wishart distribution on n degrees of freedom with identity covariance consider the limit of large p and n with n p gamma ge 1 when centered by mu p sqrt n 1 sqrt p 2 and scaled by sigma p sqrt n 1 sqrt p 1 sqrt n 1 1 sqrt p 1 3 the distribution of x 1 approaches the tracey widom law of order 1 which is defined in terms of the painleve ii differential equation and can be numerically evaluated and tabulated in software simulations show the approximation to be informative for n and p as small as 5 the limit is derived via a corresponding result for complex wishart matrices using methods from random matrix theory the result suggests that some aspects of large p multivariate distribution theory may be easier to apply in practice than their fixed p counterparts

shape fluctuations and random matrices we study a certain random growth model in two dimensions closely related to the one dimensional totally asymmetric exclusion process the results show that the shape fluctuations appropriately scaled converges in distribution to the tracy widom largest eigenvalue distribution for the gaussian unitary ensemble gue

on the distribution of the length of the longest increasing subsequence of random permutations let sn be the group of permutations of 1 2 n if 7r e sn we say that 7 i1 7f ik is an increasing subsequence in 7r if il i2 ik and 7r ii 7r i2 7r ik let 1n r be the length of the longest increasing subsequence for example if n 5 and 7r is the permutation 5 1 3 2 4 in one line notation thus 7r 1 5 7r 2 1 then the longest increasing subsequences are 1 2 4 and 1 3 4 and n 3 equip sn with uniform distribution

testing conditional independence using maximal nonlinear conditional correlation in this paper the maximal nonlinear conditional correlation of two random vectors x and y given another random vector z denoted by 1 x y z is defined as a measure of conditional association which satisfies certain desirable properties when z is continuous a test for testing the conditional independence of x and y given z is constructed based on the estimator of a weighted average of the form nz k 1 f z z k 2 1 x y z z k where f z is the probability density function of z and the z k s are some points in the range of z under some conditions it is shown that the test statistic is asymptotically normal under conditional independence and the test is consistent

nonparametric detection of signals by information theoretic criteria performance analysis and an improved estimator determining the number of sources from observed data is a fundamental problem in many scientific fields in this paper we consider the nonparametric setting and focus on the detection performance of two popular estimators based on information theoretic criteria the akaike information criterion aic and minimum description length mdl we present three contributions on this subject first we derive a new expression for the detection performance of the mdl estimator which exhibits a much closer fit to simulations in comparison to previous formulas second we present a random matrix theory viewpoint of the performance of the aic estimator including approximate analytical formulas for its overestimation probability finally we show that a small increase in the penalty term of aic leads to an estimator with a very good detection performance and a negligible overestimation probability

high dimensional analysis of semidefinite relaxations for sparse principal components principal component analysis pca is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix however pca is well known to behave poorly in the large p small n setting in which the problem dimension p is comparable to or larger than the sample size n this paper studies pca in this high dimensional regime but under the additional assumption that the maximal eigenvector is sparse say with at most k nonzero components we consider a spiked covariance model in which a base matrix is perturbed by adding a k sparse maximal eigenvector and we analyze two computationally tractable methods for recovering the support set of this maximal eigenvector as follows a a simple diagonal thresholding method which transitions from success to failure as a function of the rescaled sample size dia n p k n k 2 log p k and b a more sophisticated semidefinite programming sdp relaxation which succeeds once the rescaled sample size sdp n p k n klog p k is larger than a critical threshold in addition we prove that no method including the best method which has exponential time complexity can succeed in recovering the support if the order parameter sdp n p k is below a threshold our results thus highlight an interesting trade off between computational and statistical efficiency in high dimensional inference

non parametric detection of the number of signals hypothesis testing and random matrix theory detection of the number of signals embedded in noise is a fundamental problem in signal and array processing this paper focuses on the non parametric setting where no knowledge of the array manifold is assumed first we present a detailed statistical analysis of this problem including an analysis of the signal strength required for detection with high probability and the form of the optimal detection test under certain conditions where such a test exists second combining this analysis with recent results from random matrix theory we present a new algorithm for detection of the number of sources via a sequence of hypothesis tests we theoretically analyze the consistency and detection performance of the proposed algorithm showing its superiority compared to the standard minimum description length mdl based estimator a series of simulations confirm our theoretical analysis

random matrix ensembles with an effective extensive external charge recent theoretical studies of chaotic scattering have encountered ensembles of random matrices in which the eigenvalue probability density function contains a one body factor with an exponent proportional to the number of eigenvalues two such ensembles have been encountered an ensemble of unitary matrices specified by the so called poisson kernel and the laguerre ensemble of positive definite matrices here we consider various properties of these ensembles jack polynomial theory is used to prove a reproducing property of the poisson kernel and a certain unimodular mapping is used to demonstrate that the variance of a linear statistic is the same as in the dyson circular ensemble for the laguerre ensemble the scaled global density is calculated exactly for all even values of the parameter while for random matrices with unitary symmetry the neighbourhood of the smallest eigenvalue is shown to be in the soft edge universality class

embedded connectivity of recursive networks let gn be an n dimensional recursive network the h embedded connectivity h gn resp edge connectivityh gn of gn is the minimum number of vertices resp edges whose removal results in disconnected and each vertex is contained in an h dimensional subnetwork gh this paper determinesh andh for the hypercube qn and the star graph sn and 3 for the bubble sort network bn

distribution functions for random variables for ensembles of positive hermitian matrices distribution functions for random variables that depend on a parameter are computed asymptotically for ensembles of positive hermitian matrices the inverse fourier transform of the distribution is shown to be a fredholm determinant of a certain operator that is an analogue of a wiener hopf operator the asymptotic formula shows that up to the terms of order o 1 the distributions are gaussian

a new approach to cholesky based covariance regularization in high dimensions summary in this paper we propose a new regression interpretation of the cholesky factor of the covariance matrix as opposed to the well known regression interpretation of the cholesky factor of the inverse covariance which leads to a new class of regularized covariance estimators suitable for high dimensional problems regularizing the cholesky factor of the covariance via this regression interpretation always results in a positive definite estimator in particular one can obtain a positive definite banded estimator of the covariance matrix at the same computational cost as the popular banded estimator of bickel levina 2008b which is not guaranteed to be positive definite we also establish theoretical connections between banding cholesky factors of the covariance matrix and its inverse and constrained maximum likelihood estimation under the banding constraint and compare the numerical performance of several methods in simulations and on a sonar data example

longest increasing subsequences from patience sorting to the baik deift johansson theorem we describe a simple one person card game patience sorting its analysis leads to a broad circle of ideas linking young tableaux with the longest increasing subsequence of a random permutation via the schensted correspondence a recent highlight of this area is the work of baik deift johansson which yields limiting probability laws via hard analysis of toeplitz determinants

the distribution and moments of the smallest eigenvalue of a random matrix of wishart type abstract given a random rectangular m n matrix with elements from a normal distribution what is the distribution of the smallest singular value to pose an equivalent question in the language of multivariate statistics what is the distribution of the smallest eigenvalue of a matrix from the central wishart distribution in the null case we give new results giving the distribution as a simple recursion this includes the more difficult case when n m is an even integer without resorting to zonal polynomials and hypergeometric functions of matrix arguments with the recursion one can obtain exact expressions for the density and the moments of the distribution in terms of functions usually no more complicated than polynomials exponentials and at worst ordinary hypergeometric functions we further elaborate on the special cases when n m 0 1 2 and 3 and give a numerical table of the expected values for 2 m 25 and 0 n m 25

limits of spiked random matrices ii given a large high dimensional sample from a spiked population the top sample covariance eigenvalue is known to exhibit a phase transition we show that the largest eigenvalues have asymptotic distributions near the phase transition in the rank one spiked real wishart setting and its general analogue proving a conjecture of baik et al ann probab 33 1643 1697 2005 we also treat shifted mean gaussian orthogonal and ensembles such results are entirely new in the real case in the complex case we strengthen existing results by providing optimal scaling assumptions one obtains the known limiting random schrodinger operator on the half line but the boundary condition now depends on the perturbation we derive several characterizations of the limit laws in which appears as a parameter including a simple linear boundary value problem this pde description recovers known explicit formulas at 2 4 yielding in particular a new and simple proof of the painleve representations for these tracy widom distributions

asymptotic behavior of support vector machine for spiked population model for spiked population model we investigate the large dimension n and large sample size m asymptotic behavior of the support vector machine svm classification method in the limit of n m at fixed m n we focus on the generalization performance by analytically evaluating the angle between the normal direction vectors of svm separating hyperplane and corresponding bayes optimal separating hyperplane this is an analogous result to the one shown in paul 2007 and nadler 2008 for the angle between the sample eigenvector and the population eigenvector in random matrix theorem we provide not just bound but sharp prediction of the asymptotic behavior of svm that can be determined by a set of nonlinear equations based on the analytical results we propose a new method of selecting tuning parameter which significantly reduces the computational cost a surprising finding is that svm achieves its best performance at small value of the tuning parameter under spiked population model these results are confirmed to be correct by comparing with those of numerical simulations on finite size systems we also apply our formulas to an actual dataset of breast cancer and find agreement between analytical derivations and numerical computations based on cross validation

fault tolerance measures for m ary n dimensional hypercubes based on forbidden faulty sets in this paper we study fault tolerance measures for m ary n dimensional hypercubes based on the concept of forbidden faulty sets in a forbidden faulty set certain nodes cannot be faulty at the same time and this model can better reflect fault patterns in a real system than the existing ones specifically we study the bounds of the minimum vertex cut set for m ary n dimensional hypercubes by requiring each node to have at least k healthy neighbors our result enhances and generalizes a result by latifi et al for binary hypercubes our study also shows that the corresponding result based on the traditional fault model where k is zero tends to underestimate network resilience of large networks such as m ary n dimensional hypercubes

universality at the edge of the spectrum in wigner random matrices we prove universality at the edge for rescaled correlation functions of wigner random matrices in the limit n as a corollary we show that after proper rescaling the 1th 2nd 3rd etc eigenvalues of wigner random hermitian resp real symmetric matrix weakly converge to the distributions established by tracy and widom in g u e g o e cases

painleve formulas of the limiting distributions for nonnull complex sample covariance matrices in a recent study of large non null sample covariance matrices a new sequence of functions gener alizing the gue tracy widom distribution of random matrix theory was obtained this paper derives painleve formulas of these functions and use them to prove that they are indeed distribution functions applications of these new distribution functions to last passage percolation queues in tandem and to tally asymmetric simple exclusion process are also discussed as a part of the proof a representation of orthogonal polynomials on the unit circle in terms of an operator on a discrete set is presented

stable subspace tracking algorithm based on a signed urv decomposition subspace estimation and tracking are of fundamental importance in many signal processing algorithms the class of schur subspace estimators provides a complete parametrization of all principal subspace estimates defined as the column spans of corresponding low rank matrix approximants that lie within a specified 2 norm distance of a given matrix the parametrization is found in terms of a two sided hyperbolic decomposition hyperbolic urv or hurv which can be computed using hyperbolic rotations unfortunately such rotations are commonly associated with numerical instabilities in this paper we present a numerically stable non iterative algorithm to compute the hurv called the signed urv surv algorithm we show that this algorithm implicitly imposes certain constraints on the hurv such that important norm bounds that guarantee stability are satisfied the constraints also restrict the parametrization of the subspace estimate such that it becomes close to the principal subspace provided by the svd which is a special case within this class the complexity of the algorithm is of the same order as that of a qr update updating and downdating are of the same complexity and are both numerically stable surv is proven to provide rank estimates consistent with the svd with the same rank threshold it can replace an svd where only subspace estimation is needed typical applications would e g be the detection of the number of signals in array signal processing and subspace estimation for source separation and interference mitigation such as the first step in music and esprit type algorithms simulation results demonstrate the numerical stability and confirm that this algorithm provides exact rank estimates and good principal subspace estimates as compared to the svd

on stabilization of 2d roesser models this note is devoted to the stabilization of 2d roesser models which are discrete continuous or mixed continuous discrete a recent linear matrix inequalities lmis necessary and sufficient condition for stability of such models is used to derive a quasi non conservative technique for state feedback stabilization

geometric representation of high dimension low sample size data summary high dimension low sample size data are emerging in various areas of science we find a common structure underlying many such data sets by using a non standard type of asymptotics the dimension tends to while the sample size is fixed our analysis shows a tendency for the data to lie deterministically at the vertices of a regular simplex essentially all the randomness in the data appears only as a random rotation of this simplex this geometric representation is used to obtain several new statistical insights

an improved and explicit surrogate variable analysis procedure by coefficient adjustment unobserved environmental demographic and technical factors canadversely affect the estimation and testing of the effects ofprimary variables surrogate variable analysis proposed to tacklethis problem has been widely used in genomic studies to estimatehidden factors that are correlated with the primary variables surrogate variable analysis performs principal component analysiseither on a subset of features or on all features but weightingeach differently however existing approaches may fail to identifyhidden factors that are strongly correlated with the primaryvariables and the extra step of feature selection and weightcalculation makes the theoretical investigation of surrogatevariable analysis challenging in this paper we propose an improvedsurrogate variable analysis using all measured features that has anatural connection with restricted least squares which allows us tostudy its theoretical properties simulation studies and real dataanalysis show that the method is competitive with state of the artmethods

conditional connectivity of star graph networks under embedding restriction the n dimensional star graph s n is one of the most attractive interconnection networks of large scale multiprocessor systems the k embedding restricted edge connectivity h k s n z k s n of s n is defined to be the cardinality of a minimum subset of edges nodes if any whose deletion disconnects s n and each node of the remaining components lies in an undamaged k dimensional substar s k in this paper we investigate the k embedding restricted edge connectivity of s n and determine the values of h k s n and z k s n for some k s

penalized discriminant analysis fisher s linear discriminant analysis lda is a popular data analytic tool for studying the relationship between a set of predictors and a categorical response in this paper we describe a penalized version of lda it is designed for situations in which there are many highly correlated predictors such as those obtained by discretizing a function or the grey scale values of the pixels in a series of images in cases such as these it is natural efficient and sometimes essential to impose a spatial smoothness constraint on the coefficients both for improved prediction performance and interpretability we cast the classification problem into a regression framework via optimal scoring using this our proposal facilitates the use of any penalized regression technique in the classification setting the technique is illustrated with examples in speech recognition and handwritten character recognition

finite sample approximation results for principal component analysis a matrix perturbation approach principal component analysis pca is a standard tool for dimensional reduction of a set of n observations samples each with p variables in this paper using a matrix perturbation approach we study the nonasymptotic relation between the eigenvalues and eigenvectors of pca computed on a finite sample of size n and those of the limiting population pca as n oo as in machine learning we present a finite sample theorem which holds with high probability for the closeness between the leading eigenvalue and eigenvector of sample pca and population pca under a spiked covariance model in addition we also consider the relation between finite sample pca and the asymptotic results in the joint limit p n with p n c we present a matrix perturbation view of the phase transition phenomenon and a simple linear algebra based derivation of the eigenvalue and eigenvector overlap in this asymptotic limit moreover our analysis also applies for finite p n where we show that although there is no sharp phase transition as in the infinite case either as a function of noise level or as a function of sample size n the eigenvector of sample pca may exhibit a sharp loss of tracking suddenly losing its relation to the true eigenvector of the population pca matrix this occurs due to a crossover between the eigenvalue due to the signal and the largest eigenvalue due to noise whose eigenvector points in a random direction

deterministic parallel analysis an improved method for selecting factors and principal components factor analysis and principal component analysis are used in many application areas the first step choosing the number of components remains a serious challenge our work proposes improved methods for this important problem one of the most popular state of the art methods is parallel analysis pa which compares the observed factor strengths with simulated strengths under a noise only model the paper proposes improvements to pa we first derandomize it proposing deterministic pa which is faster and more reproducible than pa both pa and deterministic pa are prone to a shadowing phenomenon in which a strong factor makes it difficult to detect smaller but more interesting factors we propose deflation to counter shadowing we also propose to raise the decision threshold to improve estimation accuracy we prove several consistency results for our methods and test them in simulations we also illustrate our methods on data from the human genome diversity project where they significantly improve the accuracy

convergence and prediction of principal component scores in high dimensional settings a number of settings arise in which it is of interest to predict principal component pc scores for new observations using data from an initial sample in this paper we demonstrate that naive approaches to pc score prediction can be substantially biased towards 0 in the analysis of large matrices this phenomenon is largely related to known inconsistency results for sample eigenvalues and eigenvectors as both dimensions of the matrix increase for the spiked eigenvalue model for random matrices we expand the generality of these results and propose bias adjusted pc score prediction in addition we compute the asymptotic correlation coefficient between pc scores from sample and population eigenvectors simulation and real data examples from the genetics literature show the improved bias and numerical properties of our estimators

brief paper generalized eigenvalue based stability tests for 2 d linear systems necessary and sufficient conditions this paper studies the stability of 2 d dynamic systems we consider systems characterized by 2 d polynomials and 2 d state space descriptions for each description we derive necessary and sufficient stability conditions which all require only the computation of a constant matrix pencil the stability of the underlying system can then be determined by inspecting the generalized eigenvalues of the matrix pencil the results consequently yield 2 d stability tests that can be checked both efficiently and with high precision additionally frequency sweeping tests are also obtained which complement the matrix pencil tests and are likely to be more advantageous analytically

the high dimension low sample size geometric representation holds under mild conditions summary high dimension low small sample size datasets have different geometrical properties from those of traditional low dimensional data in their asymptotic study regarding increasing dimensionality with a fixed sample size hall et al 2005 showed that each data vector is approximately located on the vertices of a regular simplex in a high dimensional space a perhaps unappealing aspect of their result is the underlying assumption which requires the variables viewed as a time series to be almost independent we establish an equivalent geometric representation under much milder conditions using asymptotic properties of sample covariance matrices we discuss implications of the results such as the use of principal component analysis in a high dimensional space extension to the case of nonindependent samples and also the binary classification problem