F - test - wikipedia F - test An F - test is any statistical test in which the test statistic has an F - distribution under the null hypothesis. It is most often used when comparing statistical models that have been fitted to a data set, in order to identify the model that best fits the population from which the data were sampled. Exact `` F - tests '' mainly arise when the models have been fitted to the data using least squares. The name was coined by George W. Snedecor, in honour of Sir Ronald A. Fisher. Fisher initially developed the statistic as the variance ratio in the 1920s. Contents 1 Common examples of F - tests 1.1 F - test of the equality of two variances 2 Formula and calculation 2.1 Multiple - comparison ANOVA problems 2.2 Regression problems 3 References 4 Further reading 5 External links Common examples of F - tests Common examples of the use of F - tests include the study of the following cases : The hypothesis that the means of a given set of normally distributed populations, all having the same standard deviation, are equal. This is perhaps the best - known F - test, and plays an important role in the analysis of variance ( ANOVA ). The hypothesis that a proposed regression model fits the data well. See Lack - of - fit sum of squares. The hypothesis that a data set in a regression analysis follows the simpler of two proposed linear models that are nested within each other. In addition, some statistical procedures, such as Scheffé 's method for multiple comparisons adjustment in linear models, also use F - tests. F - test of the equality of two Variances Main article : F - test of equality of variances The F - test is sensitive to non-normality. In the analysis of variance ( ANOVA ), alternative tests include Levene 's test, Bartlett 's test, and the Brown -- Forsythe test. However, when any of these tests are conducted to test the underlying assumption of homoscedasticity ( i.e. homogeneity of variance ), as a preliminary step to testing for mean effects, there is an increase in the experiment-wise Type I error rate. Formula and calculation Most F - tests arise by considering a decomposition of the variability in a collection of data in terms of sums of squares. The test statistic in an F - test is the ratio of two scaled sums of squares reflecting different sources of variability. These sums of squares are constructed so that the statistic tends to be greater when the null hypothesis is not true. In order for the statistic to follow the F - distribution under the null hypothesis, the sums of squares should be statistically independent, and each should follow a scaled χ2 - distribution. The latter condition is guaranteed if the data values are independent and normally distributed with a common variance. Multiple - comparison ANOVA problems The F - test in one - way analysis of variance is used to assess whether the expected values of a quantitative variable within several pre-defined groups differ from each other. For example, suppose that a medical trial compares four treatments. The ANOVA F - test can be used to assess whether any of the treatments is on average superior, or inferior, to the others versus the null hypothesis that all four treatments yield the same mean response. This is an example of an `` omnibus '' test, meaning that a single test is performed to detect any of several possible differences. Alternatively, we could carry out pairwise tests among the treatments ( for instance, in the medical trial example with four treatments we could carry out six tests among pairs of treatments ). The advantage of the ANOVA F - test is that we do not need to pre-specify which treatments are to be compared, and we do not need to adjust for making multiple comparisons. The disadvantage of the ANOVA F - test is that if we reject the null hypothesis, we do not know which treatments can be said to be significantly different from the others, nor, if the F - test is performed at level α, can we state that the treatment pair with the greatest mean difference is significantly different at level α. The formula for the one - way ANOVA F - test statistic is F = explained variance unexplained variance, ( displaystyle F = ( \frac ( \text ( explained variance ) ) ( \text ( unexplained variance ) ) ), ) or F = between - group variability within - group variability. ( displaystyle F = ( \frac ( \text ( between - group variability ) ) ( \text ( within - group variability ) ) ). ) The `` explained variance '', or `` between - group variability '' is ∑ i = 1 K n i ( Y  ̄ i ⋅ − Y  ̄ ) 2 / ( K − 1 ) ( displaystyle sum _ ( i = 1 ) ^ ( K ) n_ ( i ) ( ( \bar ( Y ) ) _ ( i cdot ) - ( \bar ( Y ) ) ) ^ ( 2 ) / ( K - 1 ) ) where Y  ̄ i ⋅ ( displaystyle ( \bar ( Y ) ) _ ( i cdot ) ) denotes the sample mean in the i - th group, n i ( displaystyle n_ ( i ) ) is the number of observations in the i - th group, Y  ̄ ( displaystyle ( \bar ( Y ) ) ) denotes the overall mean of the data, and K ( displaystyle K ) denotes the number of groups. The `` unexplained variance '', or `` within - group variability '' is ∑ i = 1 K ∑ j = 1 n i ( Y i j − Y  ̄ i ⋅ ) 2 / ( N − K ), ( displaystyle sum _ ( i = 1 ) ^ ( K ) sum _ ( j = 1 ) ^ ( n_ ( i ) ) left ( Y_ ( ij ) - ( \bar ( Y ) ) _ ( i cdot ) \right ) ^ ( 2 ) / ( N-K ), ) where Y i j ( displaystyle Y_ ( ij ) ) is the j observation in the i out of K ( displaystyle K ) groups and N ( displaystyle N ) is the overall sample size. This F - statistic follows the F - distribution with degrees of freedom d 1 = K − 1 ( displaystyle d_ ( 1 ) = K - 1 ) and d 2 = N − K ( displaystyle d_ ( 2 ) = N-K ) under the null hypothesis. The statistic will be large if the between - group variability is large relative to the within - group variability, which is unlikely to happen if the population means of the groups all have the same value. Note that when there are only two groups for the one - way ANOVA F - test, F = t 2 ( displaystyle F = t ^ ( 2 ) ) where t is the Student 's t ( displaystyle t ) statistic. Regression problems Further information : Stepwise regression Consider two models, 1 and 2, where model 1 is ' nested ' within model 2. Model 1 is the restricted model, and Model 2 is the unrestricted one. That is, model 1 has p parameters, and model 2 has p parameters, where p > p, and for any choice of parameters in model 1, the same regression curve can be achieved by some choice of the parameters of model 2. The model with more parameters will always be able to fit the data at least as well as the model with fewer parameters. Thus typically model 2 will give a better ( i.e. lower error ) fit to the data than model 1. But one often wants to determine whether model 2 gives a significantly better fit to the data. One approach to this problem is to use an F - test. If there are n data points to estimate parameters of both models from, then one can calculate the F statistic, given by F = ( RSS 1 − RSS 2 p 2 − p 1 ) ( RSS 2 n − p 2 ), ( displaystyle F = ( \frac ( left ( ( \frac ( ( \text ( RSS ) ) _ ( 1 ) - ( \text ( RSS ) ) _ ( 2 ) ) ( p_ ( 2 ) - p_ ( 1 ) ) ) \right ) ) ( left ( ( \frac ( ( \text ( RSS ) ) _ ( 2 ) ) ( n - p_ ( 2 ) ) ) \right ) ) ), ) where RSS is the residual sum of squares of model i. If the regression model has been calculated with weights, then replace RSS with χ, the weighted sum of squared residuals. Under the null hypothesis that model 2 does not provide a significantly better fit than model 1, F will have an F distribution, with ( p − p, n − p ) degrees of freedom. The null hypothesis is rejected if the F calculated from the data is greater than the critical value of the F - distribution for some desired false - rejection probability ( e.g. 0.05 ). The F - test is a Wald test. References Jump up ^ Lomax, Richard G. ( 2007 ). Statistical Concepts : A Second Course. p. 10. ISBN 0 - 8058 - 5850 - 4. Jump up ^ Box, G.E.P. ( 1953 ). `` Non-Normality and Tests on Variances ''. Biometrika. 40 ( 3 / 4 ) : 318 -- 335. doi : 10.1093 / biomet / 40.3 - 4.318. JSTOR 2333350. Jump up ^ Markowski, Carol A ; Markowski, Edward P. ( 1990 ). `` Conditions for the Effectiveness of a Preliminary Test of Variance ''. The American Statistician. 44 ( 4 ) : 322 -- 326. doi : 10.2307 / 2684360. JSTOR 2684360. Jump up ^ Sawilowsky, S. ( 2002 ). `` Fermat, Schubert, Einstein, and Behrens -- Fisher : The Probable Difference Between Two Means When σ ≠ σ ''. Journal of Modern Applied Statistical Methods. 1 ( 2 ) : 461 -- 472. Further reading Fox, Karl A. ( 1980 ). Intermediate Economic Statistics ( Second ed. ). New York : John Wiley & Sons. pp. 290 -- 310. ISBN 0 - 88275 - 521 - 8. Johnston, John ( 1972 ). Econometric Methods ( Second ed. ). New York : McGraw - Hill. pp. 35 -- 38. Kmenta, Jan ( 1986 ). Elements of Econometrics ( Second ed. ). New York : Macmillan. pp. 147 -- 148. ISBN 0 - 02 - 365070 - 2. Maddala, G.S. ; Lahiri, Kajal ( 2009 ). Introduction to Econometrics ( Fourth ed. ). Chichester : Wiley. pp. 155 -- 160. ISBN 978 - 0 - 470 - 01512 - 4. External links Testing utility of model -- F - test Table of F - test critical values Free calculator for F - testing The F - test for Linear Regression The F distribution and the basic principle behind ANOVAs Econometrics lecture ( topic : hypothesis testing ) on YouTube by Mark Thoma Statistics Outline Index Descriptive statistics Continuous data Center Mean arithmetic geometric harmonic Median Mode Dispersion Variance Standard deviation Coefficient of variation Percentile Range Interquartile range Shape Central limit theorem Moments Skewness Kurtosis L - moments Count data Index of dispersion Summary tables Grouped data Frequency distribution Contingency table Dependence Pearson product - moment correlation Rank correlation Spearman 's rho Kendall 's tau Partial correlation Scatter plot Graphics Bar chart Biplot Box plot Control chart Correlogram Fan chart Forest plot Histogram Pie chart Q -- Q plot Run chart Scatter plot Stem - and - leaf display Radar chart Data collection Study design Population Statistic Effect size Statistical power Sample size determination Missing data Survey methodology Sampling stratified cluster Standard error Opinion poll Questionnaire Controlled experiments Design control optimal Controlled trial Randomized Random assignment Replication Blocking Interaction Factorial experiment Uncontrolled studies Observational study Natural experiment Quasi-experiment Statistical inference Statistical theory Population Statistic Probability distribution Sampling distribution Order statistic Empirical distribution Density estimation Statistical model L space Parameter location scale shape Parametric family Likelihood ( monotone ) Location -- scale family Exponential family Completeness Sufficiency Statistical functional Bootstrap U V Optimal decision loss function Efficiency Statistical distance divergence Asymptotics Robustness Frequentist inference Point estimation Estimating equations Maximum likelihood Method of moments M - estimator Minimum distance Unbiased estimators Mean - unbiased minimum - variance Rao -- Blackwellization Lehmann -- Scheffé theorem Median unbiased Plug - in Interval estimation Confidence interval Pivot Likelihood interval Prediction interval Tolerance interval Resampling Bootstrap Jackknife Testing hypotheses 1 - & 2 - tails Power Uniformly most powerful test Permutation test Randomization test Multiple comparisons Parametric tests Likelihood - ratio Wald Score Specific tests Z - test ( normal ) Student 's t - test F - test Goodness of fit Chi - squared G - test Kolmogorov -- Smirnov Anderson -- Darling Lilliefors Jarque -- Bera Normality ( Shapiro -- Wilk ) Likelihood - ratio test Model selection Cross validation AIC BIC Rank statistics Sign Sample median Signed rank ( Wilcoxon ) Hodges -- Lehmann estimator Rank sum ( Mann -- Whitney ) Nonparametric anova 1 - way ( Kruskal -- Wallis ) 2 - way ( Friedman ) Ordered alternative ( Jonckheere -- Terpstra ) Bayesian inference Bayesian probability prior posterior Credible interval Bayes factor Bayesian estimator Maximum posterior estimator Correlation Regression analysis Correlation Pearson product - moment Partial correlation Confounding variable Coefficient of determination Regression analysis Errors and residuals Regression model validation Mixed effects models Simultaneous equations models Multivariate adaptive regression splines ( MARS ) Linear regression Simple linear regression Ordinary least squares General linear model Bayesian regression Non-standard predictors Nonlinear regression Nonparametric Semiparametric Isotonic Robust Heteroscedasticity Homoscedasticity Generalized linear model Exponential families Logistic ( Bernoulli ) / Binomial / Poisson regressions Partition of variance Analysis of variance ( ANOVA, anova ) Analysis of covariance Multivariate ANOVA Degrees of freedom Categorical / Multivariate / Time - series / Survival analysis Categorical Cohen 's kappa Contingency table Graphical model Log - linear model McNemar 's test Multivariate Regression Manova Principal components Canonical correlation Discriminant analysis Cluster analysis Classification Structural equation model Factor analysis Multivariate distributions Elliptical distributions Normal Time - series General Decomposition Trend Stationarity Seasonal adjustment Exponential smoothing Cointegration Structural break Granger causality Specific tests Dickey -- Fuller Johansen Q - statistic ( Ljung -- Box ) Durbin -- Watson Breusch -- Godfrey Time domain Autocorrelation ( ACF ) partial ( PACF ) Cross-correlation ( XCF ) ARMA model ARIMA model ( Box -- Jenkins ) Autoregressive conditional heteroskedasticity ( ARCH ) Vector autoregression ( VAR ) Frequency domain Spectral density estimation Fourier analysis Wavelet Whittle likelihood Survival Survival function Kaplan -- Meier estimator ( product limit ) Proportional hazards models Accelerated failure time ( AFT ) model First hitting time Hazard function Nelson -- Aalen estimator Test Log - rank test Applications Biostatistics Bioinformatics Clinical trials / studies Epidemiology Medical statistics Engineering statistics Chemometrics Methods engineering Probabilistic design Process / quality control Reliability System identification Social statistics Actuarial science Census Crime statistics Demography Econometrics National accounts Official statistics Population statistics Psychometrics Spatial statistics Cartography Environmental statistics Geographic information system Geostatistics Kriging Portal Commons WikiProject Retrieved from `` https://en.wikipedia.org/w/index.php?title=F-test&oldid=831184685 '' Categories : Analysis of variance Statistical ratios Statistical tests Talk Contents Interaction About Wikipedia Català Deutsch Español فارسی Français Italiano עברית Magyar Македонски Nederlands 日本 語 Русский Basa Sunda Türkçe Українська 中文 7 more Edit links This page was last edited on 19 March 2018, at 06 : 49. Text is available under the Creative Commons Attribution - ShareAlike License ; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia ® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization. About Wikipedia

Question: when do we use f test in statistics
Answer: most often used when comparing statistical models that have been fitted to a data set, in order to identify the model that best fits the population from which the data were sampled