mkdv and its birkhoff coordinates abstract we show that the modified korteweg de vries equation with periodic boundary conditions admits global birkhoff coordinates on any soblev space h n with n 1 the construction of these coordinates involves a new lax pair for mkdv

canonical property of the miura maps between the mkp and kp hierarchies continuous and discrete apart from the case of the kp hierarchy all known miura maps between integrable hamiltonian systems had been proven to be canonical the remaining kp case is settled below as a corollary it is shown that the kp hierarchy is a factor hierarchy of the mkp one with the kernel consisting of a single scalar field a discrete mkp hierarchy and the associated miura map are constructed and the latter is shown to be canonical as well as in the continuous case this implies that one can extend the discrete kp hierarchy by a single new field into an extended discrete kp hierarchy in such a way that the extended discrete miura map mkp ekp is a canonical isomorphism

covariance regularization by thresholding this paper considers regularizing a covariance matrix of p variables estimated from n observations by hard thresholding we show that the thresholded estimate is consistent in the operator norm as long as the true covariance matrix is sparse in a suitable sense the variables are gaussian or sub gaussian and log p n 0 and obtain explicit rates the results are uniform over families of covariance matrices which satisfy a fairly natural notion of sparsity we discuss an intuitive resampling scheme for threshold selection and prove a general cross validation result that justifies this approach we also compare thresholding to other covariance estimators in simulations and on an example from climate data 1 introduction estimation of covariance matrices is important in a number of areas of statistical analysis including dimension reduction by principal component analysis pca classification by linear or quadratic discriminant analysis lda and qda establishing independence and conditional independence relations in the context of graphical models and setting confidence intervals on linear functions of the means of the components in recent years many application areas where these tools are used have been dealing with very high dimensional datasets and sample sizes can be very small relative to dimension examples include genetic data brain imaging spectroscopic imaging climate data and many others it is well known by now that the empirical covariance matrix for samples of size n from a p variate gaussian distribution np p is not a good estimator of the population covariance if p is large many results in random matrix theory illustrate this from the classical mary law 29 to the more recent work of johnstone and his students on the theory of the largest eigenvalues 12 23 30 and associated eigenvectors 24 however with the exception of a method for estimating the covariance spectrum 11 these probabilistic results do not offer alternatives to the sample covariance matrix alternative estimators for large covariance matrices have therefore attracted a lot of attention recently two broad classes of covariance estimators have emerged those that rely on a natural ordering among variables and assume that variables

nonlinear shrinkage estimation of large integrated covariance matrices integrated covariance matrices arise in intra day models of asset returns which allow volatility to change across the trading day when the number of assets is large the natural estimator of such a matrix suffers from bias contributed from extreme eigenvalues we introduce a novel nonlinear shrinkage estimator for the integrated covariance matrix which shrinks the extreme eigenvalues of a realized covariance matrix back to an acceptable level and enjoys a certain asymptotic efficiency when the number of assets is of the same order as the number of data points novel maximum exposure and actual risk bounds are derived when our estimator is used in constructing the minimum variance portfolio compared to other methods our estimator performs favorably in both simulations and a real data analysis

nonparametric eigenvalue regularized precision or covariance matrix estimator we introduce nonparametric regularization of the eigenvalues of a sample covariance matrix through splitting of the data nercome and prove that nercome enjoys asymptotic optimal nonlinear shrinkage of eigenvalues with respect to the frobenius norm one advantage of nercome is its computational speed when the dimension is not too large we prove that nercome is positive definite almost surely as long as the true covariance matrix is so even when the dimension is larger than the sample size with respect to the stein s loss function the inverse of our estimator is asymptotically the optimal precision matrix estimator asymptotic efficiency loss is defined through comparison with an ideal estimator which assumed the knowledge of the true covariance matrix we show that the asymptotic efficiency loss of nercome is almost surely 0 with a suitable split location of the data we also show that all the aforementioned optimality holds for data with a factor structure our method avoids the need to first estimate any unknowns from a factor model and directly gives the covariance or precision matrix estimator which can be useful when factor analysis is not the ultimate goal we compare the performance of our estimators with other methods through extensive simulations and real data analysis

singular integral equation analysis of flange mounted rectangular waveguide radiators the authors analyze rigorously single and twin radiating waveguides by means of a singular integral equation approach which includes the edge condition on the apertures from the start the above inclusion has an important bearing on convergence and matrix size enabling highly accurate solutions to be obtained with few test functions typically two to four this becomes particularly important in the case of multiple coupled radiators where matrix sizes increase as the product of the number of radiators times the number of test functions theoretical and experimental results are compared for the two important cases of two radiators with parallel narrow walls and with parallel broad walls and are found to be in very good agreement

estimation of a covariance matrix using the reference prior estimation of a covariance matrix sum is a notoriously difficult problem the standard unbiased estimator can be substantially suboptimal we approach the problem from a noninformative prior bayesian perspective developing the reference noninformative prior for a covariance matrix and obtaining expressions for the resulting bayes estimators these expressions involve the computation of high dimensional posterior expectations which is done using a recent markov chain simulation tool the hit and run sampler frequentist risk comparisons with previously suggested estimators are also given and determination of the accuracy of the estimators is addressed

covariance matrix selection and estimation via penalised normal likelihood summary we propose a nonparametric method for identifying parsimony and for producing a statistically efficient estimator of a large covariance matrix we reparameterise a covariance matrix through the modified cholesky decomposition of its inverse or the one step ahead predictive representation of the vector of responses and reduce the nonintuitive task of modelling covariance matrices to the familiar task of model selection and estimation for a sequence of regression models the cholesky factor containing these regression coefficients is likely to have many off diagonal elements that are zero or close to zero penalised normal likelihoods in this situation with l1 and l2 penalities are shown to be closely related to tibshirani s 1996 lasso approach and to ridge regression adding either penalty to the likelihood helps to produce more stable estimators by introducing shrinkage to the elements in the cholesky factor while because of its singularity the l1 penalty will set some elements to zero and produce interpretable models an algorithm is developed for computing the estimator and selecting the tuning parameter the proposed maximum penalised likelihood estimator is illustrated using simulation and a real dataset involving estimation of a 102 x 102 covariance matrix

condition number regularized covariance estimation estimation of high dimensional covariance matrices is known to be a difficult problem has many applications and is of current interest to the larger statistics community in many applications including so called the large p small n setting the estimate of the covariance matrix is required to be not only invertible but also well conditioned although many regularization schemes attempt to do this none of them address the ill conditioning problem directly in this paper we propose a maximum likelihood approach with the direct goal of obtaining a well conditioned estimator no sparsity assumption on either the covariance matrix or its inverse are are imposed thus making our procedure more widely applicable we demonstrate that the proposed regularization scheme is computationally efficient yields a type of steinian shrinkage estimator and has a natural bayesian interpretation we investigate the theoretical properties of the regularized covariance estimator comprehensively including its regularization path and proceed to develop an approach that adaptively determines the level of regularization that is required finally we demonstrate the performance of the regularized estimator in decision theoretic comparisons and in the financial portfolio optimization setting the proposed approach has desirable properties and can serve as a competitive procedure especially when the sample size is small and when a well conditioned estimator is required

hub discovery in partial correlation graphs one of the most important problems in large scale inference problems is the identification of variables that are highly dependent on several other variables when dependence is measured by partial correlations these variables identify those rows of the partial correlation matrix that have several entries with large magnitudes i e hubs in the associated partial correlation graph this paper develops theory and algorithms for discovering such hubs from a few observations of these variables we introduce a hub screening framework in which the user specifies both a minimum partial correlation rho and a minimum degree delta to screen the vertices the choice of rho and delta can be guided by our mathematical expressions for the phase transition correlation threshold rho c governing the average number of discoveries they can also be guided by our asymptotic expressions for familywise discovery rates under the assumption of large number p of variables fixed number n of multivariate samples and weak dependence under the null hypothesis that the dispersion covariance matrix is sparse these limiting expressions can be used to enforce familywise error constraints and to rank the discoveries in order of increasing statistical significance for n ll p the computational complexity of the proposed partial correlation screening method is low and is therefore highly scalable thus it can be applied to significantly larger problems than previous approaches the theory is applied to discovering hubs in a high dimensional gene microarray dataset

flexible covariance estimation in graphical gaussian models in this paper we propose a class of bayes estimators for the covariance matrix of graphical gaussian models markov with respect to a decomposable graph g working with the w pg family defined by letac and massam ann statist 35 2007 1278 1323 we derive closed form expressions for bayes estimators under the entropy and squared error losses the w pg family includes the classical inverse of the hyper inverse wishart but has many more shape parameters thus allowing for flexibility in differentially shrinking various parts of the covariance matrix moreover using this family avoids recourse to mcmc often infeasible in high dimensional problems we illustrate the performance of our estimators through a collection of numerical examples where we explore frequentist risk properties and the efficacy of graphs in the estimation of high dimensional covariance structures

high dimensional covariance matrix estimation using a factor model abstract high dimensionality comparable to sample size is common in many statistical problems we examine covariance matrix estimation in the asymptotic framework that the dimensionality p tends to as the sample size n increases motivated by the arbitrage pricing theory in finance a multi factor model is employed to reduce dimensionality and to estimate the covariance matrix the factors are observable and the number of factors k is allowed to grow with p we investigate the impact of p and k on the performance of the model based covariance matrix estimator under mild assumptions we have established convergence rates and asymptotic normality of the model based estimator its performance is compared with that of the sample covariance matrix we identify situations under which the factor approach increases performance substantially or marginally the impacts of covariance matrix estimation on optimal portfolio allocation and portfolio risk assessment are studied the asymptotic results are supported by a thorough simulation study

operator norm consistent estimation of large dimensional sparse covariance matrices estimating covariance matrices is a problem of fundamental importance in multivariate statistics in practice it is increasingly frequent to work with data matrices x of dimension n x p where p and n are both large results from random matrix theory show very clearly that in this setting standard estimators like the sample covariance matrix perform in general very poorly in this large n large p setting it is sometimes the case that practitioners are willing to assume that many elements of the population covariance matrix are equal to 0 and hence this matrix is sparse we develop an estimator to handle this situation the estimator is shown to be consistent in operator norm when for instance we have p n as n oo in other words the largest singular value of the difference between the estimator and the population covariance matrix goes to zero this implies consistency of all the eigenvalues and consistency of eigenspaces associated to isolated eigenvalues we also propose a notion of sparsity for matrices that is compatible with spectral analysis and is independent of the ordering of the variables

nonstandard drinfeld sokolov reduction subject to some conditions the input data for the drinfeld sokolov construction of kdv type hierarchies is a quadruplet where the are gradations of a loop algebra and is a semisimple element of the nonzero grade a new sufficient condition on the quadruplet under which the construction works is proposed and examples are presented the proposal relies on splitting the grade zero part of into a vector space direct sum of two subalgebras this permits one to interpret certain gelfand dickey type systems associated with a nonstandard splitting of the algebra of pseudodifferential operators in the drinfeld sokolov framework

a multiple testing approach to the regularisation of large sample correlation matrices abstract this paper proposes a regularisation method for the estimation of large covariance matrices that uses insights from the multiple testing m t literature the approach tests the statistical significance of individual pair wise correlations and sets to zero those elements that are not statistically significant taking account of the multiple testing nature of the problem the effective p values of the tests are set as a decreasing function of n the cross section dimension the rate of which is governed by the nature of dependence of the underlying observations and the relative expansion rates of n and t the time dimension in this respect the method specifies the appropriate thresholding parameter to be used under gaussian and non gaussian settings the m t estimator of the sample correlation matrix is shown to be consistent in the spectral and frobenius norms and in terms of support recovery so long as the true covariance matrix is sparse the performance of the proposed m t estimator is compared to a number of other estimators in the literature using monte carlo experiments it is shown that the m t estimator performs well and tends to outperform the other estimators particularly when n is larger than t

design free estimation of variance matrices abstract this paper introduces a new method for estimating variance matrices starting from the orthogonal decomposition of the sample variance matrix we exploit the fact that orthogonal matrices are never ill conditioned and therefore focus on improving the estimation of the eigenvalues we estimate the eigenvectors from just a fraction of the data then use them to transform the data into approximately orthogonal series that deliver a well conditioned estimator by construction even when there are fewer observations than dimensions we also show that our estimator has lower error norms than the traditional one our estimator is design free we make no assumptions on the distribution of the random sample or on any parametric structure the variance matrix may have simulations confirm our theoretical results and they also show that our simple estimator does very well in comparison with other existing methods

regularized estimation of large covariance matrices this paper considers estimating a covariance matrix of p variables from n observations by either banding the sample covariance matrix or estimating a banded version of the inverse of the covariance we show that these estimates are consistent in the operator norm as long as logp 2 n 0 and obtain explicit rates the results are uniform over some fairly natural well conditioned families of covariance matrices we also introduce an analogue of the gaussian white noise model and show that if the population covariance is embeddable in that model and well conditioned then the banded approximations produce consistent estimates of the eigenvalues and associated eigenvectors of the covariance matrix the results can be extended to smooth versions of banding and to non gaussian distributions with su ciently short tails a resampling approach is proposed for choosing the banding parameter in practice this approach is illustrated numerically on both simulated and real data

nonconcave penalized likelihood with a diverging number of parameters a class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by fan and li to simultaneously estimate parameters and select important variables they demonstrated that this class of procedures has an oracle property when the number of parameters is finite however in most model selection problems the number of parameters should be large and grow with the sample size in this paper some asymptotic properties of the nonconcave penalized likelihood are established for situations in which the number of parameters tends to as the sample size increases under regularity conditions we have established an oracle property and the asymptotic normality of the penalized likelihood estimators furthermore the consistency of the sandwich formula of the covariance matrix is demonstrated nonconcave penalized likelihood ratio statistics are discussed and their asymptotic distributions under the null hypothesis are obtained by imposing some mild conditions on the penalty functions the asymptotic results are augmented by a simulation study and the newly developed methodology is illustrated by an analysis of a court case on the sexual discrimination of salary

on the geometry of darboux transformations for the kp hierarchy and its connection with the discrete kp hierarchy we tackle the problem of interpreting the darboux transformation for the kp hierarchy and its relations with the modified kp hierarchy from a geometric point of view this is achieved by introducing the concept of a darboux covering we construct a darboux covering of the kp equations and obtain a new hierarchy of equations which we call the darboux kp hierarchy dkp we employ the dkp equations to discuss the relationships among the kp equations the modified kp equations and the discrete kp equations our approach also handles the various reductions of the kp hierarchy we show that the kp hierarchy is a projection of the dkp the mkp hierarchy is a dkp restriction to a suitable invariant submanifold and that the discrete kp equations are obtained as iterations of the dkp ones

wishart distributions for decomposable covariance graph models gaussian covariance graph models encode marginal independence among the components of a multivariate random vector by means of a graph g these models are distinctly different from the traditional concentration graph models often also referred to as gaussian graphical models or covariance selection models since the zeros in the parameter are now reflected in the covariance matrix as compared to the concentration matrix 1 the parameter space of interest for covariance graph models is the cone p g of positive definite matrices with fixed zeros corresponding to the missing edges of g as in letac and massam ann statist 35 2007 1278 1323 we consider the case where g is decomposable in this paper we construct on the cone p g a family of wishart distributions which serve a similar purpose in the covariance graph setting as those constructed by letac and massam ann statist 35 2007 1278 1323 and dawid and lauritzen ann statist 21 1993 1272 1317 do in the concentration graph setting we proceed to undertake a rigorous study of these covariance wishart distributions and derive several deep and useful properties of this class first they form a rich conjugate family of priors with multiple shape parameters for covariance graph models second we show how to sample from these distributions by using a block gibbs sampling algorithm and prove convergence of this block gibbs sampler development of this class of distributions enables bayesian inference which in turn allows for the estimation of e even in the case when the sample size is less than the dimension of the data i e when n p otherwise not generally possible in the maximum likelihood framework third we prove that when g is a homogeneous graph our covariance priors correspond to standard conjugate priors for appropriate directed acyclic graph dag models this correspondence enables closed form expressions for normalizing constants and expected values and also establishes hyper markov properties for our class of priors we also note that when g is homogeneous the family iw qg of letac and massam ann statist 35 2007 1278 1323 is a special case of our covariance wishart distributions fourth and finally we illustrate the use of our family of conjugate priors on real and simulated data

a nonparametric eigenvalue regularized integrated covariance matrix estimator for asset return data abstract in high frequency data analysis the extreme eigenvalues of a realized covariance matrix are biased when its dimension p is large relative to the sample size n furthermore with non synchronous trading and contamination of microstructure noise we propose a nonparametrically eigenvalue regularized integrated covariance matrix estimator nerive which does not assume specific structures for the underlying integrated covariance matrix we show that nerive is positive definite in probability with extreme eigenvalues shrunk nonlinearly under the high dimensional framework p n c 0 we also prove that in portfolio allocation the minimum variance optimal weight vector constructed using nerive has maximum exposure and actual risk upper bounds of order p 1 2 incidentally the same maximum exposure bound is also satisfied by the theoretical minimum variance portfolio weights all these results hold true also under a jump diffusion model for the log price processes with jumps removed using the wavelet method proposed in fan and wang 2007 they are further extended to accommodate the existence of pervasive factors such as a market factor under the setting p 3 2 n c 0 the practical performance of nerive is illustrated by comparing to the usual two scale realized covariance matrix as well as some other nonparametric alternatives using different simulation settings and a real data set

generalized network formulation application to flange mounted radiating waveguides electromagnetic linear field problems can be rigorously and systematically formulated in terms of linear networks use of the equivalence theorem permits the decomposition of the computational domain into sub domains with common interfaces in each sub domain the basic building blocks for a linear network representation are provided by tellegen s theorem and by the two alternative representations of the green s function tellegen s theorem provides the basis for expressing field at interfaces in a consistent way the eigenfunction expansion of the green s function provides a resonant type equivalent circuit useful for expressing the field inside a sub domain while the green s function direct solution emphasizes a transmission line network in particular a spherical transmission line provides the network representation of radiation problems in this paper the generalized network formulation is applied to the problem of radiation from flange mounted waveguides while this problem has been already solved with a variety of approaches the advantage of the generalized network formulation is that while comprising the previously developed approaches it also allows rigorous derivation of network representations in particular it is shown that by expressing the field in the half space in terms of spherical waves the physically matched solutions provide in some cases advantages for numerical computations and for network representations

nonlinear shrinkage estimation of large dimensional covariance matrices many statistical applications require an estimate of a covariance matrix and or its inverse when the matrix dimension is large compared to the sample size which happens frequently the sample covariance matrix is known to perform poorly and may suffer from ill conditioning there already exists an extensive literature concerning improved estimators in such situations in the absence of further knowledge about the structure of the true covariance matrix the most successful approach so far arguably has been shrinkage estimation shrinking the sample covariance matrix to a multiple of the identity by taking a weighted average of the two turns out to be equivalent to linearly shrinking the sample eigenvalues to their grand mean while retaining the sample eigenvectors our paper extends this approach by considering nonlinear transformations of the sample eigenvalues we show how to construct an estimator that is asymptotically equivalent to an oracle estimator suggested in previous work as demonstrated in extensive monte carlo simulations the resulting bona fide estimator can result in sizeable improvements over the sample covariance matrix and also over linear shrinkage

generalized scattering matrix analysis of a class of finite arrays of coupled antennas by using 3 d fem and spherical mode expansion a rigorous method for characterizing in terms of a multimode scattering matrix a finite array of antennas where each antenna can be described by means of spherical waves is presented in this paper the procedure provides the impedance coupling and radiating characteristics of the arrays and comprises two steps first the generalized scattering matrix gsm of each single antenna is numerically calculated over a wide band of frequencies for this purpose we use a previously developed methodology that combines the domain segmentation technique the three dimensional finite element method 3d fem spherical mode expansion and a reduced order model obtained using a symmetric matrix pade spl acute via lanczos sympvl algorithm second the overall gsm of the finite array is calculated starting from the gsm of each antenna and using rotation and translation of spherical waves a closed form expression for the overall gsm is given and different examples are shown in order to validate the proposed method

mathematics of dispersive water waves a commuting hierarchy of dispersive water wave equations makes a three hamiltonian system which belongs to a general class of nonstandard integrable systems whose theory is developed the modified water wave hierarchy is a bi hamiltonian system its modification bifurcates the water wave hierarchy and the hierarchies of the korteweg de vries and the modified korteweg de vries equations as well as the classical miura map are given new representations through various specializations of nonstandard systems

high dimensional covariance matrix estimation in approximate factor models the variance covariance matrix plays a central role in the inferential theories of high dimensional factor models in finance and economics popular regularization methods of directly exploiting sparsity are not directly applicable to many financial problems classical methods of estimating the covariance matrices are based on the strict factor models assuming independent idiosyncratic components this assumption however is restrictive in practical applications by assuming sparse error covariance matrix we allow the presence of the cross sectional correlation even after taking out common factors and it enables us to combine the merits of both methods we estimate the sparse covariance using the adaptive thresholding technique as in cai and liu j amer statist assoc 106 2011 672 684 taking into account the fact that direct observations of the idiosyncratic components are unavailable the impact of high dimensionality on the covariance matrix estimation based on the factor structure is then studied

newton s method on the complex exponential function we show that when newton s method is applied to the product of a polynomial and the exponential function in the complex plane the basins of attraction of roots have finite area

shrinkage estimators for covariance matrices estimation of covariance matrices in small samples has been studied by many authors standard estimators like the unstructured maximum likelihood estimator ml or restricted maximum likelihood reml estimator can be very unstable with the smallest estimated eigenvalues being too small and the largest too big a standard approach to more stably estimating the matrix in small samples is to compute the ml or reml estimator under some simple structure that involves estimation of fewer parameters such as compound symmetry or independence however these estimators will not be consistent unless the hypothesized structure is correct if interest focuses on estimation of regression coefficients with correlated or longitudinal data a sandwich estimator of the covariance matrix may be used to provide standard errors for the estimated coefficients that are robust in the sense that they remain consistent under misspecification of the covariance structure with large matrices however the inefficiency of the sandwich estimator becomes worrisome we consider here two general shrinkage approaches to estimating the covariance matrix and regression coefficients the first involves shrinking the eigenvalues of the unstructured ml or reml estimator the second involves shrinking an unstructured estimator toward a structured estimator for both cases the data determine the amount of shrinkage these estimators are consistent and give consistent and asymptotically efficient estimates for regression coefficients simulations show the improved operating characteristics of the shrinkage estimators of the covariance matrix and the regression coefficients in finite samples the final estimator chosen includes a combination of both shrinkage approaches i e shrinking the eigenvalues and then shrinking toward structure we illustrate our approach on a sleep eeg study that requires estimation of a 24 x 24 covariance matrix and for which inferences on mean parameters critically depend on the covariance estimator chosen we recommend making inference using a particular shrinkage estimator that provides a reasonable compromise between structured and unstructured estimators

penalized normal likelihood and ridge regularization of correlation and covariance matrices high dimensionality causes problems in various areas of statistics a particular situation that rarely has been considered is the testing of hypotheses about multivariate regression models in which

a sieve m theorem for bundled parameters in semiparametric models with application to the efficient estimation in a linear model for censored data in many semiparametric models that are parameterized by two types of parameters a euclidean parameter of interest and an infinite dimensional nuisance parameter the two parameters are bundled together i e the nuisance parameter is an unknown function that contains the parameter of interest as part of its argument for example in a linear regression model for censored survival data the unspecified error distribution function involves the regression coefficients motivated by developing an efficient estimating method for the regression parameters we propose a general sieve m theorem for bundled parameters and apply the theorem to deriving the asymptotic theory for the sieve maximum likelihood estimation in the linear regression model for censored survival data the numerical implementation of the proposed estimating method can be achieved through the conventional gradient based search algorithms such as the newton raphson algorithm we show that the proposed estimator is consistent and asymptotically normal and achieves the semiparametric efficiency bound simulation studies demonstrate that the proposed method performs well in practical settings and yields more efficient estimates than existing estimating equation based methods illustration with a real data example is also provided

estimation of a covariance matrix under stein s loss on decrit la technique generale de stein pour ameliorer l estimateur sans biais invariant le meilleur et l estimateur minimax de la matrice de covariance normale

miura map between lattice kadomtsev petviashvili and its modification is canonical we consider the miura map between the lattice kadomtsev petviashvili hierarchy and the lattice modified kp hierarchy and prove that the map is canonical not only between the first hamiltonian structures but also between the second hamiltonian structures

factor modeling for high dimensional time series inference for the number of factors this paper deals with the factor modeling for high dimensional time series based on a dimension reduction viewpoint under stationary settings the inference is simple in the sense that both the number of factors and the factor loadings are estimated in terms of an eigenanalysis for a nonnegative definite matrix and is therefore applicable when the dimension of time series is on the order of a few thousands asymptotic properties of the proposed method are investigated under two settings i the sample size goes to infinity while the dimension of time series is fixed and ii both the sample size and the dimension of time series go to infinity together in particular our estimators for zero eigenvalues enjoy faster convergence or slower divergence rates hence making the estimation for the number of factors easier in particular when the sample size and the dimension of time series go to infinity together the estimators for the eigenvalues are no longer consistent however our estimator for the number of the factors which is based on the ratios of the estimated eigenvalues still works fine furthermore this estimation shows the so called blessing of dimensionality property in the sense that the performance of the estimation may improve when the dimension of time series increases a two step procedure is investigated when the factors are of different degrees of strength numerical illustration with both simulated and real data is also reported

partial correlation estimation by joint sparse regression models this article features online supplementary material in this article we propose a computationally efficient approach space sparse partial correlation estimation for selecting nonzero partial correlations under the high dimension low sample size setting this method assumes the overall sparsity of the partial correlation matrix and employs sparse regression techniques for model fitting we illustrate the performance of space by extensive simulation studies it is shown that space performs well in both nonzero partial correlation selection and the identification of hub variables and also outperforms two existing methods we then apply space to a microarray breast cancer dataset and identify a set of hub genes that may provide important insights on genetic regulatory networks finally we prove that under a set of suitable assumptions the proposed procedure is asymptotically consistent in terms of model selection and parameter estimation

sparsistency and rates of convergence in large covariance matrix estimation this paper studies the sparsistency and rates of convergence for estimating sparse covariance and precision matrices based on penalized likelihood with nonconvex penalty functions here sparsistency refers to the property that all parameters that are zero are actually estimated as zero with probability tending to one depending on the case of applications sparsity priori may occur on the covariance matrix its inverse or its cholesky decomposition we study these three sparsity exploration problems under a unified framework with a general penalty function we show that the rates of convergence for these problems under the frobenius norm are of order s n log p n n 1 2 where s n is the number of nonzero elements p n is the size of the covariance matrix and n is the sample size this explicitly spells out the contribution of high dimensionality is merely of a logarithmic factor the conditions on the rate with which the tuning parameter n goes to 0 have been made explicit and compared under different penalties as a result for the l 1 penalty to guarantee the sparsistency and optimal rate of convergence the number of nonzero elements should be small sn o pn at most among o pn2 parameters for estimating sparse covariance or correlation matrix sparse precision or inverse correlation matrix or sparse cholesky factor where sn is the number of the nonzero elements on the off diagonal entries on the other hand using the scad or hard thresholding penalty functions there is no such a restriction

wishart distributions for decomposable graphs when considering a graphical gaussian model n g markov with respect to a decomposable graph g the parameter space of interest for the precision parameter is the cone p g of positive definite matrices with fixed zeros corresponding to the missing edges of g the parameter space for the scale parameter of n g is the cone q g dual to p g of incomplete matrices with submatrices corresponding to the cliques of g being positive definite in this paper we construct on the cones q g and p g two families of wishart distributions namely the type i and type ii wisharts they can be viewed as generalizations of the hyper wishart and the inverse of the hyper inverse wishart as defined by dawid and lauritzen ann statist 21 1993 1272 1317 we show that the type i and ii wisharts have properties similar to those of the hyper and hyper inverse wishart indeed the inverse of the type ii wishart forms a conjugate family of priors for the covariance parameter of the graphical gaussian model and is strong directed hyper markov for every direction given to the graph by a perfect order of its cliques while the type i wishart is weak hyper markov moreover the inverse type ii wishart as a conjugate family presents the advantage of having a multidimensional shape parameter thus offering flexibility for the choice of a prior both type i and ii wishart distributions depend on multivariate shape parameters a shape parameter is acceptable if and only if it satisfies a certain eigenvalue property we show that the sets of acceptable shape parameters for a noncomplete g have dimension equal to at least one plus the number of cliques in g these families as conjugate families are richer than the traditional diaconis ylvisaker conjugate families which all have a shape parameter set of dimension one a decomposable graph which does not contain a three link chain as an induced subgraph is said to be homogeneous in this case our wisharts are particular cases of the wisharts on homogeneous cones as defined by andersson and wojnar j theoret probab 17 2004 781 818 and the dimension of the shape parameter set is even larger than in the nonhomogeneous case it is indeed equal to the number of cliques plus the number of distinct minimal separators using the model where g is a three link chain we show by computing a 7 tuple integral that in general we cannot expect the shape parameter sets to have dimension larger than the number of cliques plus one

large scale correlation screening this article addresses the problem of screening for variables with high correlations in high dimensional data in which there can be many fewer samples than variables we focus on threshold based correlation screening methods for three related applications screening for variables with large correlations within a single treatment autocorrelation screening screening for variables with large cross correlations over two treatments cross correlation screening and screening for variables that have persistently large autocorrelations over two treatments persistent correlation screening the novelty of correlation screening is that it identifies a smaller number of variables that are highly correlated with others compared with identifying a number of correlation parameters correlation screening suffers from a phase transition phenomenon as the correlation threshold decreases the number of discoveries increases abruptly we obtain asymptotic expressions for the mean number of discoveries and the phase t

generalized thresholding of large covariance matrices we propose a new class of generalized thresholding operators that combine thresholding with shrinkage and study generalized thresholding of the sample covariance matrix in high dimensions generalized thresholding of the covariance matrix has good theoretical properties and carries almost no computational burden we obtain an explicit convergence rate in the operator norm that shows the tradeoff between the sparsity of the true model dimension and the sample size and shows that generalized thresholding is consistent over a large class of models as long as the dimension p and the sample size n satisfy log p n 0 in addition we show that generalized thresholding has the sparsistency property meaning it estimates true zeros as zeros with probability tending to 1 and under an additional mild condition is sign consistent for nonzero elements we show that generalized thresholding covers as special cases hard and soft thresholding smoothly clipped absolute deviation and adaptive lasso and comp

nonparametric estimation of large covariance matrices of longitudinal data summary estimation of an unstructured covariance matrix is difficult because of its positivedefiniteness constraint this obstacle is removed by regressing each variable on its predecessors so that estimation of a covariance matrix is shown to be equivalent to that of estimating a sequence of varying coefficient and varying order regression models our framework is similar to the use of increasing order autoregressive models in approximating the covariance matrix or the spectrum of a stationary time series as an illustration we adopt fan zhang s 2000 two step estimation of functional linear models and propose nonparametric estimators of covariance matrices which are guaranteed to be positive definite for parsimony a suitable order for the sequence of auto regression models is found using penalised likelihood criteria like aic and bic some asymptotic results for the local polynomial estimators of components of a covariance matrix are established two longitudinal datasets are analysed to illustrate the methodology a simulation study reveals the advantage of the nonparametric covariance estimator over the sample covariance matrix for large covariance matrices

on the miura map between the dispersionless kp and dispersionless modified kp hierarchies the miura map between the dispersionless kp and dispersionless modified kp hierarchies is investigated it is shown that the miura map is canonical with respect to their bi hamiltonian structures moreover inspired by the works of takasaki and takebe the twistor construction of solution structure for the dispersionless modified kp hierarchy is given

model selection through sparse maximum likelihood estimation for multivariate gaussian or binary data we consider the problem of estimating the parameters of a gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse our approach is to solve a maximum likelihood problem with an added l1 norm penalty term the problem as formulated is convex but the memory requirements and complexity of existing interior point methods are prohibitive for problems with more than tens of nodes we present two new algorithms for solving problems with at least a thousand nodes in the gaussian case our first algorithm uses block coordinate descent and can be interpreted as recursive l1 norm penalized regression our second algorithm based on nesterov s first order method yields a complexity estimate with a better dependence on problem size than existing interior point methods using a log determinant relaxation of the log partition function wainwright and jordan 2006 we show that these same algorithms can be used to solve an approximate sparse maximum likelihood problem for the binary case we test our algorithms on synthetic data as well as on gene expression and senate voting records data

canonical miura maps between the modified kp and kp hierarchies we investigate the hamiltonian nature of two miura maps between the modified kp and kp hierarchies we show that they are canonical in the sense that the bi hamiltonian structure of the modified kp hierarchy is mapped to the bi hamiltonian structure of the kp hierarchy