Central limit theorem

{{Mathematics}}
[[File:Galton box.jpg|left|thumb|180px|A [[Francis Galton|Galton]] box illustrates the central limit theorem for Bern(0.5), since the beans are roughly equally likely to be deflected to either side of the pegs.|alt=Beans in a Galton box forming the shape of the Gaussian density curve.]]<!--Alternatively, we could use Galton box.webm, which is animated-->
The '''central limit theorem''' is a [[Proof#Maths|theorem]] in [[Probability|probability]] theory that states that if you have several independent samples from a probability distribution with finite [[Standard deviation|variance]], then as the [[Sample size|sample size]] approaches [[infinity]], the sum and [[Mean|average]] of the samples approach a [[Gaussian distribution|normal distribution]]. Formally, it says that given a sequence of independent, identically distributed real-valued [[random]] variables <math>X_1, X_2, X_3, \dots</math> with mean <math>\mu</math> and variance <math>\sigma^2 < \infty</math>, if <math>\bar{X}_n = \frac{1}{n}\sum_{i=1}^{n}X_i</math> is the mean of the first n variables in the sequence, then <math>\sqrt{n}(\bar{X}_n - \mu)</math> converges to <math>N(0, \sigma^2)</math> in distribution as <math>n \rightarrow \infty</math>.<ref>[https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_probability/BS704_Probability12.html Central Limit Theorem]</ref> As a consequence, if n is large enough, <math>N(\mu, \frac{\sigma^2}{n})</math> will be a good approximation of the distribution of the sample mean even if the distribution of X is not close to normal.

==Applications==
The central limit theorem is often used to justify applying certain [[Statistics|statistical]] tests to analyze [[Experiment|experimental]] data. One of the earliest forms of the central limit theorem, the De Moivre-Laplace theorem, applied specifically to Bernoulli (binary) random variables.<ref>[https://www.math.utah.edu/~davar/math5010/summer2010/L7.pdf The binomial distribution, and a normal approximation]. Course materials for Math 5010, summer 2010, math.utah.edu.</ref> Today, experiments often use z-tests to compare the frequencies of binary outcomes. Margins of error in surveys are often based on the normal approximation justified by the central limit theorem.<ref>[https://towardsdatascience.com/election-poll-simulation-margin-of-error-and-central-limit-theorem-with-python-43f96909a4c6 Election Poll Simulation, Margin of Error and Central Limit Theorem with Python]</ref>

Another common statistical test for analyzing experimental data is called the {{wpl|t-test||,}} which is used to assess whether two independent sets of quantitative data have the same mean, or whether the mean of one set of data is equal to a predetermined value. One of the assumptions required for the t-test to be valid is that the data is normally distributed, but the central limit theorem allows this requirement to be relaxed if the datasets are large enough. A t-test statistic is a (continuous) function of the sample mean and sample variance of the dataset(s) involved in the test. The central limit theorem indicates that if the datasets are large enough and the data meets the assumptions of the central limit theorem, then the sample mean will be close to normal, as it would be with normally distributed data. In addition, since the observations in a dataset that meets the assumptions of the central limit theorem have finite variance, {{wpl|Consistency (statistics)|the sample variance of the dataset will approach the true variance as the sample size increases with probability 1}} due to the law of large numbers.<ref name=ttest>[https://thestatsgeek.com/2013/09/28/the-t-test-and-robustness-to-non-normality/ The t-test and robustness to non-normality], Jonathan Bartlett. September 28, 2013.</ref> Therefore, the distribution of the t-test statistic using non-normally distributed data that meets the conditions of the central limit theorem will be similar to that of normally distributed data for large sample sizes, and so the t-test can often be applied to quantitative data without first checking normality if the sample size is large enough.<ref name=ttest/>

==Use to "prove" the existence of God==
Abraham de Moivre proved the central limit theorem for the specific case of Bern(0.5), a binary random variable in which each outcome is equally likely (e.g. tossing a fair coin). He believed that this represented a proof of the existence of [[God]], on the basis that it shows that even random events ultimately converge to a predictable outcome over time, and so chance is not a threat to God's intentions.<ref>[https://idus.us.es/bitstream/handle/11441/84133/The_aftermath_of_Abraham_de_Moivre_s_Doctrine.pdf?sequence=1&isAllowed=y The aftermath of Abraham de Moivre's Doctrine of Chances and Annuities on Lives in 18th-century Europe], Ivo Schneider, ''Historia de la Probabilidad y la Estadística (IV)'', 2007.</ref>

There are several problems with this reasoning. First, the central limit theorem only applies in the limit as the number of chance outcomes approaches infinity. Phenomena in the real world will depend on finite chance events, and sometimes may not even depend on a large enough number of outcomes to apply the central limit theorem to. The normal approximation implied by the central limit theorem may be a good model for the annual rainfall in your city, but the weather tomorrow is still governed by [[Chaos theory|chaos]].<ref>[https://www.ecmwf.int/en/elibrary/16927-chaos-and-weather-prediction Chaos and Weather Prediction], Roberto Buizza, ''Meteorological Training Course Lecture Series'', 2002.</ref>

Second, the central limit theorem does not apply to every distribution. For example, the sample mean of any number of independent realizations from the {{wpl|Cauchy distribution}} (the quotient of two independent standard normal random variables) will also have a Cauchy distribution.<ref>[https://mathworld.wolfram.com/CauchyDistribution.html Cauchy Distribution], Eric Weisstein, ''MathWorld''.</ref> If the central limit theorem were a demonstration of divine [[omnipotence]], then that divine omnipotence would have exceptions. De Moivre himself had only proven the theorem for one specific case, meaning he had even less justification to regard it as proof of divinity.

Finally, even if the central limit theorem is regarded as showing that omnipotence is consistent with chance, it doesn't mean that an omnipotent deity ''must'' exist.

==See also==
*[[Probability]]
*[[Statistics]]
*[[Normal distribution]]
*[[Binomial theorem]]

==References==
{{reflist|2|80%}}

{{mathnav}}
[[Category:Statistics]]

Categories: Statistics