distribution free consistent independence tests via center outward ranks and signs this article investigates the problem of testing independence of two random vectors of general dimensions for this we give for the first time a distribution free consistent test our approach com

a categorification of the boson fermion correspondence via representation theory of sl in recent years different aspects of categorification of the boson fermion correspondence have been studied in this paper we propose a categorification of the boson fermion correspondence based on the category of tensor modules of the lie algebra sl of finitary infinite matrices by mathbb t we denote the category of polynomial tensor sl modules there is a natural creation functor mathcal t n mathbb t to mathbb t m mapsto n otimes m quad m n in mathbb t the key idea of the paper is to employ the entire category mathbb t of tensor sl modules in order to define the annihilation functor mathcal d n mathbb t to mathbb t corresponding to mathcal t n we show that the relations allowing one to express fermions via bosons arise from relations in the cohomology of complexes of linear endofunctors on mathbb t

estimating functions of probability distributions from a finite set of samples this paper addresses the problem of estimating a function of a probability distribution from a finite set of samples of that distribution a bayesian analysis of this problem is presented the optimal properties of the bayes estimators are discussed and as an example of the formalism closed form expressions for the bayes estimators for the moments of the shannon entropy function are derived then numerical results are presented that compare the bayes estimator to the frequency counts estimator for the shannon entropy we also present the closed form estimators all derived elsewhere for the mutual information mathrm ensuremath chi 2 covariance and some other statistics c 1995 the american physical society

the hellinger correlation in this paper the defining properties of any valid measure of the dependence between two continuous random variables are revisited and complemented with two original ones shown to imply other usu

consistent distribution free k sample and independence tests for univariate random variables a popular approach for testing if two univariate random variables are statistically independent consists of partitioning the sample space into bins and evaluating a test statistic on the binned data the partition size matters and the optimal partition size is data dependent while for detecting simple relationships coarse partitions may be best for detecting complex relationships a great gain in power can be achieved by considering finer partitions we suggest novel consistent distribution free tests that are based on summation or maximization aggregation of scores over all partitions of a fixed size we show that our test statistics based on summation can serve as good estimators of the mutual information moreover we suggest regularized tests that aggregate over all partition sizes and prove those are consistent too we provide polynomial time algorithms which are critical for computing the suggested test statistics efficiently we show that the power of the regularized tests is excellent compared to existing tests and almost as powerful as the tests based on the optimal yet unknown in practice partition size in simulations as well as on a real data example

bayesian inference for a covariance matrix a flexible class of prior distributions is proposed for the covariance matrix of a multivariate normal distribution yielding much more general hierarchical and empirical bayes smoothing and inference when compared with a conjugate analysis involving an inverted wishart distribution a likelihood approximation is obtained for the matrix logarithm of the covariance matrix via bellman s iterative solution to a volterra integral equation exact and approximate bayesian empirical and hierarchical bayesian estimation and finite sample inference techniques are developed some risk and asymptotic frequency properties are investigated a subset of the project talent american high school data is analyzed applications and extensions to multivariate analysis including a generalized linear model for covariance matrices are indicated

consistent inference of probabilities for reproducible experiments the need for inducing a probability distribution from partial data and the complementary problem of the analysis of an observed distribution in terms of fewer relevant variables occur in many branches of physics for reproducible experiments consistency conditions which must be satisfied by any algorithm for inferring a discrete probability distribution with given averages are formulated the only consistent algorithm is the one leading to the distribution of maximal entropy subject to the given constraints

estimation of mutual information using kernel density estimators mutual information is useful for investigating the dependence between two experimental time series it is often used to establish an appropriate time delay in phase portrait reconstruction from time series data a histogram based approach has been used so far to estimate the probabilities it is shown here that kernel density estimation of the probability density functions needed in estimating the average mutual information across two coordinates can be more effective than the histogram method of fraser and swinney phys rev a 33 1134 1986

on the boltzmann equation for the lorentz gas we consider the boltzmann grad limit for the lorentz or wind tree model we prove that if is a fixed configuration of scatterer centers belonging to a set of full measure with respect to the poisson distribution with parameter 0 then the evolution of an initial a c particle density tends in the boltzmann grad limit to the solution of the boltzmann equation for the model as an intermediate step we prove that the process of the free path lengths and impact parameters induced by the lebesgue measure on a small region tends to a limiting independent process

demystifying fixed k nearest neighbor information estimators estimating mutual information from independent identically distributed samples drawn from an unknown joint density function is a basic statistical problem of broad interest with multitudinous applications the most popular estimator is the one proposed by kraskov stogbauer and grassberger ksg in 2004 and is nonparametric and based on the distances of each sample to its k mathrm th nearest neighboring sample where k is a fixed small integer despite of its widespread use part of scientific software packages theoretical properties of this estimator have been largely unexplored in this paper we demonstrate that the estimator is consistent and also identify an upper bound on the rate of convergence of the ell 2 error as a function of a number of samples we argue that the performance benefits of the ksg estimator stems from a curious correlation boosting effect and build on this intuition to modify the ksg estimator in novel ways to construct a superior estimator as a by product of our investigations we obtain nearly tight rates of convergence of the ell 2 error of the well known fixed k nearest neighbor estimator of differential entropy by kozachenko and leonenko

bayesian entropy estimation for countable discrete distributions we consider the problem of estimating shannon s entropy h from discrete data in cases where the number of possible symbols is unknown or even countably infinite the pitman yor process a generalization of dirichlet process provides a tractable prior distribution over the space of countably infinite discrete distributions and has found major applications in bayesian non parametric statistics and machine learning here we show that it provides a natural family of priors for bayesian entropy estimation due to the fact that moments of the induced posterior distribution over h can be computed analytically we derive formulas for the posterior mean bayes least squares estimate and variance under dirichlet and pitman yor process priors moreover we show that a fixed dirichlet or pitman yor process prior implies a narrow prior distribution over h meaning the prior strongly determines the entropy estimate in the under sampled regime we derive a family of continuous measures for mixing pitman yor processes to produce an approximately flat prior over h we show that the resulting pitman yor mixture pym entropy estimator is consistent for a large class of distributions finally we explore the theoretical properties of the resulting estimator and show that it performs well both in simulation and in application to real data

estimation of the entropy based on its polynomial representation estimating entropy from empirical samples of finite size is of central importance for information theory as well as the analysis of complex statistical systems yet this delicate task is marred by intrinsic statistical bias here we decompose the entropy function into a polynomial approximation function and a remainder function the approximation function is based on a taylor expansion of the logarithm given n observations we give an unbiased linear estimate of the first n power series terms based on counting sets of k coincidences for the remainder function we use nonlinear bayesian estimation with a nearly flat prior distribution on the entropy that was developed by nemenman shafee and bialek our simulations show that the combined entropy estimator has reduced bias in comparison to other available estimators

estimating mutual information we present two classes of improved estimators for mutual information m x y from samples of random points distributed according to some joint probability density mu x y in contrast to conventional estimators based on binnings they are based on entropy estimates from k nearest neighbor distances this means that they are data efficient with k 1 we resolve structures down to the smallest possible scales adaptive the resolution is higher where data are more numerous and have minimal bias indeed the bias of the underlying entropy estimates is mainly due to nonuniformity of the density at the smallest resolved scale giving typically systematic errors which scale as functions of k n for n points numerically we find that both families become exact for independent distributions i e the estimator m x y vanishes up to statistical fluctuations if mu x y mu x mu y this holds for all tested marginal distributions and for all dimensions of x and y in addition we give estimators for redundancies between more than two random variables we compare our algorithms in detail with existing algorithms finally we demonstrate the usefulness of our estimators for assessing the actual independence of components obtained from independent component analysis ica for improving ica and for estimating the reliability of blind source separation

two constructions of affine lie algebra representations and boson fermion correspondence in quantum field theory we establish an isomorphism between the vertex and spinor representations of affine lie algebras for types dl 1 and dl 1 2 we also study decomposition of spinor representations using the infinite family of casimir operators and prove that they are either irreducible or have two irreducible components we show that the vertex and spinor constructions of the representations can be reformulated in the language of two dimensional quantum field theory in this physical context the two constructions yield the generalized sine gordon and thirring models respectively already in renormalized form the isomorphism of representations implies an equivalence of these two models which is known in quantum field theory as the boson fermion correspondence

mutual information functions versus correlation functions this paper studies one application of mutual information to symbolic sequences the mutual information functionm d this function is compared with the more frequently used correlation function d an exact relation betweenm d and d is derived for binary sequences for sequences with more than two symbols no such general relation exists in particular d 0 may or may not lead tom d 0 this linear but not general independence between symbols separated by a distance is studied for ternary sequences also included is the estimation of the finite size effect on calculating mutual information finally the concept of symbolic noise is discussed

on infinite volume mixing in the context of the long standing issue of mixing in infinite ergodic theory we introduce the idea of mixing for observables possessing an infinite volume average the idea is borrowed from statistical mechanics and appears to be relevant at least for extended systems with a direct physical interpretation we discuss the pros and cons of a few mathematical definitions that can be devised testing them on a prototypical class of infinite measure preserving dynamical systems namely the random walks

relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data commonly used dependence measures such as linear correlation cross correlogram or kendall s tau cannot capture the complete dependence structure in data unless the structure is restricted to linear periodic or monotonic mutual information mi has been frequently utilized for capturing the complete dependence structure including nonlinear dependence recently several methods have been proposed for the mi estimation such as kernel density estimators kde k nearest neighbors knn edgeworth approximation of differential entropy and adaptive partitioning of the xy plane however outstanding gaps in the current literature have precluded the ability to effectively automate these methods which in turn have caused limited adoptions by the application communities this study attempts to address a key gap in the literature specifically the evaluation of the above methods to choose the best method particularly in terms of their robustness for short and noisy data based on comparisons with the theoretical mi estimates which can be computed analytically as well with linear correlation and kendall s tau here we consider smaller data sizes such as 50 100 and 1 000 where this study considers 50 and 100 data points as very short and 1 000 as short we consider a broader class of functions specifically linear quadratic periodicmore and chaotic contaminated with artificial noise with varying noise to signal ratios the case studies presented here are motivated by domain consideration in the earth sciences where the data are short and noisy our results indicate kde as the best choice for very short data at relatively high noise to signal levels whereas the performance of knn is the best for short data at relatively low noise levels as well as for short data consistently across noise levels in addition the optimal smoothing parameter of a gaussian kernel appears to be the best choice for kde while three nearest neighbors appear optimal for knn thus in situations where the approximate data sizes are known in advance and exploratory data analysis and or domain knowledge can be used to provide a priori insights on the noise to signal ratios the results in the paper point to a way forward for automating the process of mi estimation less

copula index for detecting dependence and monotonicity between stochastic signals abstract this paper introduces a nonparametric copula based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals our index termed copula index for detecting dependence and monotonicity cim satisfies several desirable properties of measures of association including most of renyi s properties the data processing inequality dpi and consequently self equitability synthetic data simulations reveal that the statistical power of cim compares favorably to other state of the art measures of association that are proven to satisfy the dpi simulation results with real world data reveal cim s unique ability to detect the monotonicity structure among stochastic signals to find interesting dependencies in large datasets additionally simulations show that cim compares favorably to estimators of mutual information when discovering markov network structure

measuring dependence powerfully and equitably given a high dimensional data set we often wish to find the strongest relationships within it a common strategy is to evaluate a measure of dependence on every variable pair and retain the highest scoring pairs for follow up this strategy works well if the statistic used a has good power to detect non trivial relationships and b is equitable meaning that for some measure of noise it assigns similar scores to equally noisy relationships regardless of relationship type e g linear exponential periodic in this paper we define and theoretically characterize two new statistics that together yield an efficient approach for obtaining both power and equitability to do this we first introduce a new population measure of dependence and show three equivalent ways that it can be viewed including as a canonical smoothing of mutual information we then introduce an efficiently computable consistent estimator of our population measure of dependence and we empirically establish its equitability on a large class of noisy functional relationships this new statistic has better bias variance properties and better runtime complexity than a previous heuristic approach next we derive a second related statistic whose computation is a trivial side product of our algorithm and whose goal is powerful independence testing rather than equitability we prove that this statistic yields a consistent independence test and show in simulations that the test has good power against independence taken together our results suggest that these two statistics are a valuable pair of tools for exploratory data analysis

typical recurrence for the ehrenfest wind tree model we show that the typical wind tree model in the sense of baire is recurrent and has a dense set of periodic orbits the recurrence result also holds for the lorentz gas the typical lorentz gas in the sense of baire is recurrent these lorentz gases need not be of finite horizon

parametric inference in the large data limit using maximally informative models motivated by data rich experiments in transcriptional regulation and sensory neuroscience we consider the following general problem in statistical inference when exposed to a high dimensional signal s a system of interest computes a representation r of that signal which is then observed through a noisy measurement m from a large number of signals and measurements we wish to infer the filter that maps s to r however the standard method for solving such problems likelihood based inference requires perfect a priori knowledge of the noise function mapping r to m in practice such noise functions are usually known only approximately if at all and using an incorrect noise function will typically bias the inferred filter here we show that in the large data limit this need for a precharacterized noise function can be circumvented by searching for filters that instead maximize the mutual information i m r between observed measurements and predicted representations moreover if the correct filter lies within the space of filters being explored maximizing mutual information becomes equivalent to simultaneously maximizing every dependence measure that satisfies the data processing inequality it is important to note that maximizing mutual information will typically leave a small number of directions in parameter space unconstrained we term these directions diffeomorphic modes and present an equation that allows these modes to be derived systematically the presence of diffeomorphic modes reflects a fundamental and nontrivial substructure within parameter space one that is obscured by standard likelihood based inference

analyzing neural responses to natural signals maximally informative dimensions we propose a method that allows for a rigorous statistical analysis of neural responses to natural stimuli that are nongaussian and exhibit strong correlations we have in mind a model in which neurons are selective for a small number of stimulus dimensions out of a high dimensional stimulus space but within this subspace the responses can be arbitrarily nonlinear existing analysis methods are based on correlation functions between stimuli and responses but these methods are guaranteed to work only in the case of gaussian stimulus ensembles as an alternative to correlation functions we maximize the mutual information between the neural responses and projections of the stimulus onto low dimensional subspaces the procedure can be done iteratively by increasing the dimensionality of this subspace those dimensions that allow the recovery of all of the information between spikes and the full unprojected stimuli describe the relevant subspace if the dimensionality of the relevant subspace indeed is small it becomes feasible to map the neuron s input output function even under fully natural stimulus conditions these ideas are illustrated in simulations on model visual and auditory neurons responding to natural scenes and sounds respectively

the bayesian bootstrap the bayesian bootstrap is the bayesian analogue of the bootstrap instead of simulating the sampling distribution of a statistic estimating a parameter the bayesian bootstrap simulates the posterior distribution of the parameter operationally and inferentially the methods are quite similar because both methods of drawing inferences are based on somewhat peculiar model assumptions and the resulting inferences are generally sensitive to these assumptions neither method should be applied without some consideration of the reasonableness of these model assumptions in this sense neither method is a true bootstrap procedure yielding inferences unaided by external assumptions

infinite horizon lorentz tubes and gases recurrence and ergodic properties we construct classes of two dimensional aperiodic lorentz systems that have infinite horizon and are chaotic in the sense that they are poincare recurrent uniformly hyperbolic ergodic and the first return map to any scatterer is k mixing in the case of the lorentz tubes i e lorentz gases in a strip we define general measured families of systems emph ensembles for which the above properties occur with probability 1 in the case of the lorentz gases in the plane we define families endowed with a natural metric within which the set of all chaotic dynamical systems is uncountable and dense

partially monotonic decision trees abstract in multicriteria decision tasks certain features are linearly ordered according to the decision and are called criteria whereas others called regular attributes are not in practice regular attributes and criteria coexist in most classification tasks in this paper we propose a rank inconsistent rate that distinguishes attributes from criteria furthermore it represents the directions of the monotonic relationships between criteria and decisions we design a partially monotonic decision tree algorithm to extract decision rules for partially monotonic classification tasks experimental results show that the proposed algorithm is effective and efficient

reply to reshef et al falsifiability or bust the term equitability was introduced by reshef et al in ref 1 to describe measures of statistical dependence that give similar scores to equally noisy relationships of different types their paper also introduced a new statistic the maximal information coefficient mic that was said to satisfy this equitability criterion there has since been much interest in mic due primarily to its claimed equitability 2 3 however neither the original paper 1 nor follow up work 4 provided an unambiguous mathematical definition of equitability in particular the types of noise permissible in the noisy relationships used to define equitability were not described

functional associations at global brain level during perception of an auditory illusion by applying maximal information coefficient abstract maximal information coefficient mic is a recently introduced information theoretic measure of functional association with a promising potential of application to high dimensional complex data sets here we applied mic to reveal the nature of the functional associations between different brain regions during the perception of binaural beat bb bb is an auditory illusion occurring when two sinusoidal tones of slightly different frequency are presented separately to each ear and an illusory beat at the different frequency is perceived we recorded sixty four channels eeg from two groups of participants musicians and non musicians during the presentation of bb and systematically varied the frequency difference from 1 hz to 48 hz participants were also presented non binuaral beat nbb stimuli in which same frequencies were presented to both ears across groups as compared to nbb i bb conditions produced the most robust changes in the mic values at the whole brain level when the frequency differences were in the classical alpha range 8 12 hz and ii the number of electrode pairs showing nonlinear associations decreased gradually with increasing frequency difference between groups significant effects were found for bbs in the broad gamma frequency range 34 48 hz but such effects were not observed between groups during nbb altogether these results revealed the nature of functional associations at the whole brain level during the binaural beat perception and demonstrated the usefulness of mic in characterizing interregional neural dependencies

statistical validation of mutual information calculations comparison of alternative numerical algorithms given two time series x and y their mutual information i x y i y x is the average number of bits of x that can be predicted by measuring y and vice versa in the analysis of observational data calculation of mutual information occurs in three contexts identification of nonlinear correlation determination of an optimal sampling interval particularly when embedding data and in the investigation of causal relationships with directed mutual information in this contribution a minimum description length argument is used to determine the optimal number of elements to use when characterizing the distributions of x and y however even when using partitions of the x and y axis indicated by minimum description length mutual information calculations performed with a uniform partition of the xy plane can give misleading results this motivated the construction of an algorithm for calculating mutual information that uses an adaptive partition this algorithm also incorporates an explicit test of the statistical independence of x and y in a calculation that returns an assessment of the corresponding null hypothesis the previously published fraser swinney algorithm for calculating mutual information includes a sophisticated procedure for local adaptive control of the partitioning process when the fraser and swinney algorithm and the algorithm constructed here are compared they give very similar numerical results less than 4 difference in a typical application detailed comparisons are possible when x and y are correlated jointly gaussian distributed because an analytic expression for i x y can be derived for that case based on these tests three conclusions can be drawn first the algorithm constructed here has an advantage over the fraser swinney algorithm in providing an explicit calculation of the probability of the null hypothesis that x and y are independent second the fraser swinney algorithm is marginally the more accurate of the two algorithms when large data sets are used with smaller data sets however the fraser swinney algorithm reports structures that disappear when more data are available third the algorithm constructed here requires about 0 5 of the computation time required by the fraser swinney algorithm

fisher exact scanning for dependency abstractwe introduce a method called fisher exact scanning fes for testing and identifying variable dependency that generalizes fisher s exact test on 2 2 contingency tables to r c contingency tables and continuous sample spaces fes proceeds through scanning over the sample space using windows in the form of 2 2 tables of various sizes and on each window completing a fisher s exact test based on a factorization of fisher s multivariate hypergeometric mhg likelihood into the product of the univariate hypergeometric likelihoods we show that there exists a coarse to fine sequential generative representation for the mhg model in the form of a bayesian network which in turn implies the mutual independence up to deviation due to discreteness among the fisher s exact tests completed under fes this allows an exact characterization of the joint null distribution of the p values and gives rise to an effective inference recipe through simple multiple testing procedures such as sidak and bonferroni

a consistent multivariate test of association based on ranks of distances summary we consider the problem of detecting associations between random vectors of any dimension few tests of independence exist that are consistent against all dependent alternatives we propose a powerful test that is applicable in all dimensions and consistent against all alternatives the test has a simple form is easy to implement and has good power

reply to murrell et al noise matters the concept of statistical equitability plays a central role in the 2011 paper by reshef et al 1 formalizing equitability first requires formalizing the notion of a noisy functional relationship that is a relationship between two real variables x and y having the form y f x y f x where f is a function and is a noise term whether a dependence measure satisfies equitability strongly depends on what mathematical properties the noise term is allowed to have the narrower one s definition of noise the weaker the equitability criterion becomes unfortunately the allowed mathematical properties of is an issue

cleaning up the record on the maximal information coefficient and equitability although we appreciate kinney and atwal s interest in equitability and maximal information coefficient mic we believe they misrepresent our work we highlight a few of our main objections below fig 1 equitability of mic and mutual information under a range of noise models the equitability of mic and mutual information across a subset of noise models analyzed in refs 1 and 4 for each noise model the relationships tested are as in ref 4 in each regarding our original paper 1 kinney and atwal 2 state mic is said to satisfy not just the heuristic notion of equitability but also the mathematical criterion of r2 equitability the latter being their formalization of the heuristic notion that we introduced this statement is simply false we were explicit in our paper that our claims regarding mic s performance were based on large scale simulations we tested mic s equitability through simulations these show that for a large collection of test functions with varied sample sizes noise levels and noise models mic roughly equals the coefficient of determination r2 relative to each respective noiseless function although we mathematically proved several things about mic none of our claims imply that it satisfies kinney and atwal s r2 equitability which would require that mic exactly equal r2 in the infinite data limit thus their proof that no dependence measure can satisfy r2 equitability although interesting does not uncover any error in our work and their suggestion that it does is a gross misrepresentation kinney and atwal seem ready to toss out equitability as a useful criterion based on their theoretical result we argue however that regardless of whether perfect equitability is possible approximate notions of equitability remain the right goal for many data exploration settings just as the theory of np completeness does not suggest we stop thinking about np complete problems but instead that we look for approximations and solutions in restricted cases an impossibility result about perfect equitability provides focus for further research but does not mean that useful solutions are unattainable similarly as others have noted 3 kinney and atwal s proof requires a highly permissive noise model and so the attainability of r2 equitability under more limited noise models such as those in our work remains an open question finally the authors argue that mutual information is more equitable than mic however they provide as justification only a single noise model only at limiting sample sizes n 5 000 as we ve shown in follow up work 4 which they themselves cite but fail to address mic is more equitable than mutual information estimation under many other realistic noise models even at a sample size of 5 000 kinney and atwal have stated it matters how one defines noise 5 and a useful statistic must indeed be robust to a wide range of noise models equally importantly we ve established in both our original and follow up work that at sample size regimes less than 5 000 mic is more equitable than mutual information estimates across all noise models tested mic s superior equitability in these settings is not an artifact we neglected as kinney and atwal suggest but rather a weakness of mutual information estimation and an important consideration for practitioners we expect that the understanding of equitability and mic will improve over time and that better methods may arise however accurate representations of the work thus far will allow researchers in the area to most productively and collectively move forward

towards a categorical boson fermion correspondence abstract we construct a heisenberg counterpart of a clifford categorification it is a modification of khovanov s heisenberg categorification we relate generators of the heisenberg category with a complex of generators of the clifford category certain vertex operators associated to the clifford algebra are lifted to endofunctors of the fock space categorification

equitability mutual information and the maximal information coefficient how should one quantify the strength of association between two random variables without bias for relationships of a specific form despite its conceptual simplicity this notion of statistical equitability has yet to receive a definitive mathematical formalization here we argue that equitability is properly formalized by a self consistency condition closely related to data processing inequality mutual information a fundamental quantity in information theory is shown to satisfy this equitability criterion these findings are at odds with the recent work of reshef et al reshef dn et al 2011 science 334 6062 1518 1524 which proposed an alternative definition of equitability and introduced a new statistic the maximal information coefficient mic said to satisfy equitability in contradistinction to mutual information these conclusions however were supported only with limited simulation evidence not with mathematical arguments upon revisiting these claims we prove that the mathematical definition of equitability proposed by reshef et al cannot be satisfied by any nontrivial dependence measure we also identify artifacts in the reported simulation evidence when these artifacts are removed estimates of mutual information are found to be more equitable than estimates of mic mutual information is also observed to have consistently higher statistical power than mic we conclude that estimating mutual information provides a natural and often practical way to equitably quantify statistical associations in large datasets

the upward bias in measures of information derived from limited data samples extracting information measures from limited experimental samples such as those normally available when using data recorded in vivo from mammalian cortical neurons is known to be plagued by a systematic error which tends to bias the estimate upward we calculate here the average of the bias under certain conditions as an asymptotic expansion in the inverse of the size of the data sample the result agrees with numerical simulations and is applicable as an additive correction term to measurements obtained under such conditions moreover we discuss the implications for measurements obtained through other usual procedures

recurrence and higher ergodic properties for quenched random lorentz tubes in dimension bigger than two we consider the billiard dynamics in a non compact set of d that is constructed as a bi infinite chain of translated copies of the same d dimensional polytope a random configuration of semi dispersing scatterers is placed in each copy the ensemble of dynamical systems thus defined one for each global realization of the scatterers is called quenched random lorentz tube under some fairly general conditions we prove that every system in the ensemble is hyperbolic and almost every system is recurrent ergodic and enjoys some higher chaotic properties

r2 equitability is satisfiable kinney and atwal 1 make excellent points about mutual information the maximal information coefficient 2 3 and equitability one of their central claims however is that no nontrivial dependence measure can satisfy r 2 r2 equitability we argue that this is the result of a poorly constructed definition which we quote a dependence measure d x y d x y is r 2 r2 equitable if and only if when evaluated on a joint probability distribution p x y p x y that corresponds to a noisy functional relationship between two real random variables x and y the following relation holds d x y g r 2 f x y d x y g r2 f x y here g is a function that does not depend on p x y p x y and f is the function defining the noisy functional relationship i e y f x y f x

fast search local extremum for maximal information coefficient mic abstract maximal information coefficient mic is an indicator to explore the correlation between pairwise variables in large data sets and the accuracy of mic has an impact on the measure of dependence for each pair to improve the equitability in an acceptable run time in this paper an intelligent mic imic is proposed for optimizing the partition on the y axis to approximate the mic with good accuracy it is an iterative algorithm on quadratic optimization to generate a better characteristic matrix during the process the imic can quickly find out the local optimal value while using a lower number of iterations it produces results that are close to the true mic values by searching just n times rather than n 2 computations required for the previous method in the compared experiments of 169 indexes about 202 countries from world health organization who data set the proposed algorithm offers a better solution coupled with a reasonable run time for mic and good performance search for the extreme values in fewer iterations the imic develops the equitability keeping the satisfied accuracy with fast computational speed potentially benefitting the relationship exploration in big data

fi modules and stability for representations of symmetric groups in this paper we introduce and develop the theory of fi modules we apply this theory to obtain new theorems about the cohomology of the configuration space of n distinct ordered points on an arbitrary connected oriented manifold the diagonal coinvariant algebra on r sets of n variables the cohomology and tautological ring of the moduli space of n pointed curves the space of polynomials on rank varieties of n n matrices the subalgebra of the cohomology of the genus n torelli group generated by h1 and more the symmetric group sn acts on each of these vector spaces in most cases almost nothing is known about the characters of these representations or even their dimensions we prove that in each fixed degree the character is given for n large enough by a polynomial in the cycle counting functions that is independent of n in particular the dimension is eventually a polynomial in n in this framework representation stability in the sense of church farb for a sequence of sn representations is converted to a finite generation property for a single fi module

composite coefficient of determination and its application in ultrahigh dimensional variable screening in this article we propose to measure the dependence between two random variables through a composite coefficient of determination ccd of a set of nonparametric regressions these regressions ta

some estimates for 2 dimensional infinite and bounded dilute random lorentz gases we present a mostly rigorous approach to unbounded and bounded open dilute random lorentz gases relying on previous rigorous results on the dilute boltzmann grad limit we compute the asymptotics of the lyapunov exponent in the unbounded case for the bounded open case in a circular region we give here an incomplete rigorous analysis which gives the asymptotics for large radius of the escape rate and of the rescaled quasi invariant q i or quasi stationary measure we finally give a complete proof on existence and asymptotic properties of the q i measure in a one dimensional caricature

estimation of entropy and mutual information we present some new results on the nonparametric estimation of entropy and mutual information first we use an exact local expansion of the entropy function to prove almost sure consistency and central limit theorems for three of the most commonly used discretized information estimators the setup is related to grenander s method of sieves and places no assumptions on the underlying probability measure generating the data second we prove a converse to these consistency theorems demonstrating that a misapplication of the most common estimation techniques leads to an arbitrarily poor estimate of the true information even given unlimited data this inconsistency theorem leads to an analytical approximation of the bias valid in surprisingly small sample regimes and more accurate than the usual 1 n formula of miller and madow over a large region of parameter space the two most practical implications of these results are negative 1 information estimates in a certain data regime are likely contaminated by bias even if bias corrected estimators are used and 2 confidence intervals calculated by standard techniques drastically underestimate the error of the most common estimation methods finally we note a very useful connection between the bias of entropy estimators and a certain polynomial approximation problem by casting bias calculation problems in this approximation theory framework we obtain the best possible generalization of known asymptotic bias results more interesting this framework leads to an estimator with some nice properties the estimator comes equipped with rigorous bounds on the maximum error over all possible underlying probability distributions and this maximum error turns out to be surprisingly small we demonstrate the application of this new estimator on both real and simulated data