Spearman 's rank correlation coefficient - wikipedia Spearman 's rank correlation coefficient A Spearman correlation of 1 results when the two variables being compared are monotonically related, even if their relationship is not linear. This means that all data - points with greater x-values than that of a given data - point will have greater y - values as well. In contrast, this does not give a perfect Pearson correlation. When the data are roughly elliptically distributed and there are no prominent outliers, the Spearman correlation and Pearson correlation give similar values. The Spearman correlation is less sensitive than the Pearson correlation to strong outliers that are in the tails of both samples. That is because Spearman 's rho limits the outlier to the value of its rank. In statistics, Spearman 's rank correlation coefficient or Spearman 's rho, named after Charles Spearman and often denoted by the Greek letter ρ ( displaystyle \rho ) ( rho ) or as r s ( displaystyle r_ ( s ) ), is a nonparametric measure of rank correlation ( statistical dependence between the ranking of two variables ). It assesses how well the relationship between two variables can be described using a monotonic function. The Spearman correlation between two variables is equal to the Pearson correlation between the rank values of those two variables ; while Pearson 's correlation assesses linear relationships, Spearman 's correlation assesses monotonic relationships ( whether linear or not ). If there are no repeated data values, a perfect Spearman correlation of + 1 or − 1 occurs when each of the variables is a perfect monotone function of the other. Intuitively, the Spearman correlation between two variables will be high when observations have a similar ( or identical for a correlation of 1 ) rank ( i.e. relative position label of the observations within the variable : 1st, 2nd, 3rd, etc. ) between the two variables, and low when observations have a dissimilar ( or fully opposed for a correlation of − 1 ) rank between the two variables. Spearman 's coefficient is appropriate for both continuous and discrete ordinal variables. Both Spearman 's ρ ( displaystyle \rho ) and Kendall 's τ ( displaystyle \tau ) can be formulated as special cases of a more general correlation coefficient. Contents 1 Definition and calculation 2 Related quantities 3 Interpretation 4 Example 5 Determining significance 6 Correspondence analysis based on Spearman 's rho 7 See also 8 References 9 Further reading 10 External links Definition and calculation The Spearman correlation coefficient is defined as the Pearson correlation coefficient between the ranked variables. For a sample of size n, the n raw scores X i, Y i ( displaystyle X_ ( i ), Y_ ( i ) ) are converted to ranks rg ⁡ X i, rg ⁡ Y i ( displaystyle operatorname ( rg ) X_ ( i ), operatorname ( rg ) Y_ ( i ) ), and r s ( displaystyle r_ ( s ) ) is computed from : r s = ρ rg X, rg Y = cov ⁡ ( rg X, rg Y ) σ rg X σ rg Y ( displaystyle r_ ( s ) = \rho _ ( operatorname ( rg ) _ ( X ), operatorname ( rg ) _ ( Y ) ) = ( \frac ( operatorname ( cov ) ( operatorname ( rg ) _ ( X ), operatorname ( rg ) _ ( Y ) ) ) ( sigma _ ( operatorname ( rg ) _ ( X ) ) sigma _ ( operatorname ( rg ) _ ( Y ) ) ) ) ) where ρ ( displaystyle \rho ) denotes the usual Pearson correlation coefficient, but applied to the rank variables. cov ⁡ ( rg X, rg Y ) ( displaystyle operatorname ( cov ) ( operatorname ( rg ) _ ( X ), operatorname ( rg ) _ ( Y ) ) ) is the covariance of the rank variables. σ rg X ( displaystyle sigma _ ( operatorname ( rg ) _ ( X ) ) ) and σ rg Y ( displaystyle sigma _ ( operatorname ( rg ) _ ( Y ) ) ) are the standard deviations of the rank variables. Only if all n ranks are distinct integers, it can be computed using the popular formula r s = 1 − 6 ∑ d i 2 n ( n 2 − 1 ). ( displaystyle r_ ( s ) = ( 1 - ( \frac ( 6 sum d_ ( i ) ^ ( 2 ) ) ( n ( n ^ ( 2 ) - 1 ) ) ) ). ) where d i = rg ⁡ ( X i ) − rg ⁡ ( Y i ) ( displaystyle d_ ( i ) = operatorname ( rg ) ( X_ ( i ) ) - operatorname ( rg ) ( Y_ ( i ) ) ), is the difference between the two ranks of each observation. n is the number of observations Identical values are usually each assigned fractional ranks equal to the average of their positions in the ascending order of the values, which is equivalent to averaging over all possible permutations. If ties are present in the data set, this equation yields incorrect results : Only if in both variables all ranks are distinct, then σ rg X σ rg Y = Var ⁡ rg X = Var ⁡ rg Y = n ( n 2 − 1 ) / 6 ( displaystyle sigma _ ( operatorname ( rg ) _ ( X ) ) sigma _ ( operatorname ( rg ) _ ( Y ) ) = operatorname ( Var ) ( operatorname ( rg ) _ ( X ) ) = operatorname ( Var ) ( operatorname ( rg ) _ ( Y ) ) = n ( n ^ ( 2 ) - 1 ) / 6 ) ( cf. tetrahedral number T n − 1 ( displaystyle T_ ( n - 1 ) ) ). The first equation -- normalizing by the standard deviation -- may even be used even when ranks are normalized to ( 0 ; 1 ) ( `` relative ranks '' ) because it is insensitive both to translation and linear scaling. This method should also not be used in cases where the data set is truncated ; that is, when the Spearman correlation coefficient is desired for the top X records ( whether by pre-change rank or post-change rank, or both ), the user should use the Pearson correlation coefficient formula given above. The standard error of the coefficient ( σ ) was determined by Pearson in 1907 and Gosset in 1920. It is σ r s = 0.6325 n − 1 ( displaystyle sigma _ ( r_ ( s ) ) = ( \frac ( 0.6325 ) ( sqrt ( n - 1 ) ) ) ) Related quantities Main article : Correlation and dependence There are several other numerical measures that quantify the extent of statistical dependence between pairs of observations. The most common of these is the Pearson product - moment correlation coefficient, which is a similar correlation method to Spearman 's rank, that measures the `` linear '' relationships between the raw numbers rather than between their ranks. An alternative name for the Spearman rank correlation is the `` grade correlation '' ; in this, the `` rank '' of an observation is replaced by the `` grade ''. In continuous distributions, the grade of an observation is, by convention, always one half less than the rank, and hence the grade and rank correlations are the same in this case. More generally, the `` grade '' of an observation is proportional to an estimate of the fraction of a population less than a given value, with the half - observation adjustment at observed values. Thus this corresponds to one possible treatment of tied ranks. While unusual, the term `` grade correlation '' is still in use. Interpretation Positive and negative Spearman rank correlations A positive Spearman correlation coefficient corresponds to an increasing monotonic trend between X and Y. A negative Spearman correlation coefficient corresponds to a decreasing monotonic trend between X and Y. The sign of the Spearman correlation indicates the direction of association between X ( the independent variable ) and Y ( the dependent variable ). If Y tends to increase when X increases, the Spearman correlation coefficient is positive. If Y tends to decrease when X increases, the Spearman correlation coefficient is negative. A Spearman correlation of zero indicates that there is no tendency for Y to either increase or decrease when X increases. The Spearman correlation increases in magnitude as X and Y become closer to being perfect monotone functions of each other. When X and Y are perfectly monotonically related, the Spearman correlation coefficient becomes 1. A perfect monotone increasing relationship implies that for any two pairs of data values X, Y and X, Y, that X − X and Y − Y always have the same sign. A perfect monotone decreasing relationship implies that these differences always have opposite signs. The Spearman correlation coefficient is often described as being `` nonparametric ''. This can have two meanings : First, a perfect Spearman correlation results when X and Y are related by any monotonic function. Contrast this with the Pearson correlation, which only gives a perfect value when X and Y are related by a linear function. The other sense in which the Spearman correlation is nonparametric in that its exact sampling distribution can be obtained without requiring knowledge ( i.e., knowing the parameters ) of the joint probability distribution of X and Y. Example In this example, the raw data in the table below is used to calculate the correlation between the IQ of a person with the number of hours spent in front of TV per week. IQ, X i ( displaystyle X_ ( i ) ) Hours of TV per week, Y i ( displaystyle Y_ ( i ) ) 106 7 86 0 100 27 101 50 99 28 103 29 97 20 113 12 112 6 110 17 Firstly, evaluate d i 2 ( displaystyle d_ ( i ) ^ ( 2 ) ). To do so use the following steps, reflected in the table below. Sort the data by the first column ( X i ( displaystyle X_ ( i ) ) ). Create a new column x i ( displaystyle x_ ( i ) ) and assign it the ranked values 1, 2, 3,... n. Next, sort the data by the second column ( Y i ( displaystyle Y_ ( i ) ) ). Create a fourth column y i ( displaystyle y_ ( i ) ) and similarly assign it the ranked values 1, 2, 3,... n. Create a fifth column d i ( displaystyle d_ ( i ) ) to hold the differences between the two rank columns ( x i ( displaystyle x_ ( i ) ) and y i ( displaystyle y_ ( i ) ) ). Create one final column d i 2 ( displaystyle d_ ( i ) ^ ( 2 ) ) to hold the value of column d i ( displaystyle d_ ( i ) ) squared. IQ, X i ( displaystyle X_ ( i ) ) Hours of TV per week, Y i ( displaystyle Y_ ( i ) ) rank x i ( displaystyle x_ ( i ) ) rank y i ( displaystyle y_ ( i ) ) d i ( displaystyle d_ ( i ) ) d i 2 ( displaystyle d_ ( i ) ^ ( 2 ) ) 86 0 0 0 97 20 6 − 4 16 99 28 8 − 5 25 100 27 7 − 3 9 101 50 5 10 − 5 25 103 29 6 9 − 3 9 106 7 7 16 110 17 8 5 9 112 6 9 7 49 113 12 10 6 36 With d i 2 ( displaystyle d_ ( i ) ^ ( 2 ) ) found, add them to find ∑ d i 2 = 194 ( displaystyle sum d_ ( i ) ^ ( 2 ) = 194 ). The value of n is 10. These values can now be substituted back into the equation : ρ = 1 − 6 ∑ d i 2 n ( n 2 − 1 ). ( displaystyle \rho = 1 - ( \frac ( 6 sum d_ ( i ) ^ ( 2 ) ) ( n ( n ^ ( 2 ) - 1 ) ) ). ) to give ρ = 1 − 6 × 194 10 ( 10 2 − 1 ) ( displaystyle \rho = 1 - ( \frac ( 6 \times 194 ) ( 10 ( 10 ^ ( 2 ) - 1 ) ) ) ) which evaluates to ρ = − 29 / 165 = − 0.175757575... with a P - value = 0.627188 ( using the t distribution ) Chart of the data presented. It can be seen that there might be a negative correlation, but that the relationship does not appear definitive. This low value shows that the correlation between IQ and hours spent watching TV is very low, although the negative value suggests that the longer the time spent watching television the lower the IQ. In the case of ties in the original values, this formula should not be used ; instead, the Pearson correlation coefficient should be calculated on the ranks ( where ties are given ranks, as described above ). Determining significance One approach to test whether an observed value of ρ is significantly different from zero ( r will always maintain − 1 ≤ r ≤ 1 ) is to calculate the probability that it would be greater than or equal to the observed r, given the null hypothesis, by using a permutation test. An advantage of this approach is that it automatically takes into account the number of tied data values there are in the sample, and the way they are treated in computing the rank correlation. Another approach parallels the use of the Fisher transformation in the case of the Pearson product - moment correlation coefficient. That is, confidence intervals and hypothesis tests relating to the population value ρ can be carried out using the Fisher transformation : F ( r ) = 1 2 ln ⁡ 1 + r 1 − r = artanh ⁡ ( r ). ( displaystyle F ( r ) = ( 1 over 2 ) ln ( 1 + r over 1 - r ) = operatorname ( artanh ) ( r ). ) If F ( r ) is the Fisher transformation of r, the sample Spearman rank correlation coefficient, and n is the sample size, then z = n − 3 1.06 F ( r ) ( displaystyle z = ( sqrt ( \frac ( n - 3 ) ( 1.06 ) ) ) F ( r ) ) is a z - score for r which approximately follows a standard normal distribution under the null hypothesis of statistical independence ( ρ = 0 ). One can also test for significance using t = r n − 2 1 − r 2 ( displaystyle t = r ( sqrt ( \frac ( n - 2 ) ( 1 - r ^ ( 2 ) ) ) ) ) which is distributed approximately as Student 's t distribution with n − 2 degrees of freedom under the null hypothesis. A justification for this result relies on a permutation argument. A generalization of the Spearman coefficient is useful in the situation where there are three or more conditions, a number of subjects are all observed in each of them, and it is predicted that the observations will have a particular order. For example, a number of subjects might each be given three trials at the same task, and it is predicted that performance will improve from trial to trial. A test of the significance of the trend between conditions in this situation was developed by E.B. Page and is usually referred to as Page 's trend test for ordered alternatives. Correspondence Analysis based on Spearman 's rho Classic correspondence analysis is a statistical method that gives a score to every value of two nominal variables. In this way the Pearson correlation coefficient between them is maximized. There exists an equivalent of this method, called grade correspondence analysis, which maximizes Spearman 's rho or Kendall 's tau. See also Statistics portal Kendall tau rank correlation coefficient Chebyshev 's sum inequality, rearrangement inequality ( These two articles may shed light on the mathematical properties of Spearman 's ρ. ) Distance correlation References Jump up ^ Scale types Jump up ^ Lehman, Ann ( 2005 ). Jmp For Basic Univariate And Multivariate Statistics : A Step - by - step Guide. Cary, NC : SAS Press. p. 123. ISBN 1 - 59047 - 576 - 3. Jump up ^ Myers, Jerome L. ; Well, Arnold D. ( 2003 ). Research Design and Statistical Analysis ( 2nd ed. ). Lawrence Erlbaum. p. 508. ISBN 0 - 8058 - 4037 - 0. Jump up ^ Dodge, Yadolah ( 2010 ). The Concise Encyclopedia of Statistics. Springer - Verlag New York. p. 502. ISBN 978 - 0 - 387 - 31742 - 7. Jump up ^ Yule, G. U. ; Kendall, M. G. ( 1968 ) ( 1950 ). An Introduction to the Theory of Statistics ( 14th ed. ). Charles Griffin & Co. p. 268. Jump up ^ Piantadosi, J. ; Howlett, P. ; Boland, J. ( 2007 ). `` Matching the grade correlation coefficient using a copula with maximum disorder ''. Journal of Industrial and Management Optimization. 3 ( 2 ) : 305 -- 312. Jump up ^ Choi, S.C. ( 1977 ). `` Tests of Equality of Dependent Correlation Coefficients ''. Biometrika. 64 ( 3 ) : 645 -- 647. doi : 10.1093 / biomet / 64.3. 645. Jump up ^ Fieller, E.C. ; Hartley, H.O. ; Pearson, E.S. ( 1957 ). `` Tests for rank correlation coefficients. I ''. Biometrika. 44 : 470 -- 481. doi : 10.1093 / biomet / 44.3 - 4.470. Jump up ^ Press ; Vettering ; Teukolsky ; Flannery ( 1992 ). Numerical Recipes in C : The Art of Scientific Computing ( 2nd ed. ). p. 640. Jump up ^ Kendall, M.G. ; Stuart, A. ( 1973 ). The Advanced Theory of Statistics, Volume 2 : Inference and Relationship. Griffin. ISBN 0 - 85264 - 215 - 6. ( Sections 31.19, 31.21 ) Jump up ^ Page, E.B. ( 1963 ). `` Ordered hypotheses for multiple treatments : A significance test for linear ranks ''. Journal of the American Statistical Association. 58 ( 301 ) : 216 -- 230. doi : 10.2307 / 2282965. Jump up ^ Kowalczyk, T. ; Pleszczyńska, E. ; Ruland, F., eds. ( 2004 ). Grade Models and Methods for Data Analysis with Applications for the Analysis of Data Populations. Studies in Fuzziness and Soft Computing. 151. Berlin Heidelberg New York : Springer Verlag. ISBN 978 - 3 - 540 - 21120 - 4. Further reading Corder, G.W. & Foreman, D.I. ( 2014 ). Nonparametric Statistics : A Step - by - Step Approach, Wiley. ISBN 978 - 1118840313. Daniel, Wayne W. ( 1990 ). `` Spearman rank correlation coefficient ''. Applied Nonparametric Statistics ( 2nd ed. ). Boston : PWS - Kent. pp. 358 -- 365. ISBN 0 - 534 - 91976 - 6. Spearman C ( 1904 ). `` The proof and measurement of association between two things ''. American Journal of Psychology. 15 : 72 -- 101. doi : 10.2307 / 1412159. Bonett DG, Wright, TA ( 2000 ). `` Sample size requirements for Pearson, Kendall, and Spearman correlations ''. Psychometrika. 65 : 23 -- 28. doi : 10.1007 / bf02294183. CS1 maint : Multiple names : authors list ( link ) Kendall MG ( 1970 ). Rank correlation methods ( 4th ed. ). London : Griffin. ISBN 978 - 0 - 852 - 6419 - 96. OCLC 136868. Hollander M, Wolfe DA ( 1973 ). Nonparametric statistical methods. New York : Wiley. ISBN 978 - 0 - 471 - 40635 - 8. OCLC 520735. Caruso JC, Cliff N ( 1997 ). `` Empirical size, coverage, and power of confidence intervals for Spearman 's Rho ''. Educational and Psychological Measurement. 57 : 637 -- 654. doi : 10.1177 / 0013164497057004009. External links Wikiversity has learning resources about Spearman 's rank correlation coefficient `` Understanding Correlation vs. Copulas in Excel '' by Eric Torkia, Technology Partnerz 2011 Table of critical values of ρ for significance with small samples Chapter 3 part 1 shows the formula to be used when there are ties An example of how to calculate Spearman 's Rho along with basic R code. Spearman 's Rank Correlation Coefficient -- Excel Guide : sample data and formulae for Excel, developed by the Royal Geographical Society. Spearman 's rank correlation : Simple notes for students with an example of usage by biologists and a spreadsheet for Microsoft Excel for calculating it ( a part of materials for a Research Methods in Biology course ). Statistics Outline Index Descriptive statistics Continuous data Center Mean arithmetic geometric harmonic Median Mode Dispersion Variance Standard deviation Coefficient of variation Percentile Range Interquartile range Shape Central limit theorem Moments Skewness Kurtosis L - moments Count data Index of dispersion Summary tables Grouped data Frequency distribution Contingency table Dependence Pearson product - moment correlation Rank correlation Spearman 's rho Kendall 's tau Partial correlation Scatter plot Graphics Bar chart Biplot Box plot Control chart Correlogram Fan chart Forest plot Histogram Pie chart Q -- Q plot Run chart Scatter plot Stem - and - leaf display Radar chart Data collection Study design Population Statistic Effect size Statistical power Sample size determination Missing data Survey methodology Sampling stratified cluster Standard error Opinion poll Questionnaire Controlled experiments Design control optimal Controlled trial Randomized Random assignment Replication Blocking Interaction Factorial experiment Uncontrolled studies Observational study Natural experiment Quasi-experiment Statistical inference Statistical theory Population Statistic Probability distribution Sampling distribution Order statistic Empirical distribution Density estimation Statistical model L space Parameter location scale shape Parametric family Likelihood ( monotone ) Location -- scale family Exponential family Completeness Sufficiency Statistical functional Bootstrap U V Optimal decision loss function Efficiency Statistical distance divergence Asymptotics Robustness Frequentist inference Point estimation Estimating equations Maximum likelihood Method of moments M - estimator Minimum distance Unbiased estimators Mean - unbiased minimum - variance Rao -- Blackwellization Lehmann -- Scheffé theorem Median unbiased Plug - in Interval estimation Confidence interval Pivot Likelihood interval Prediction interval Tolerance interval Resampling Bootstrap Jackknife Testing hypotheses 1 - & 2 - tails Power Uniformly most powerful test Permutation test Randomization test Multiple comparisons Parametric tests Likelihood - ratio Wald Score Specific tests Z ( normal ) Student 's t - test Goodness of fit Chi - squared Kolmogorov -- Smirnov Anderson -- Darling Lilliefors Jarque -- Bera Normality ( Shapiro -- Wilk ) Likelihood - ratio test Model selection Cross validation AIC BIC Rank statistics Sign Sample median Signed rank ( Wilcoxon ) Hodges -- Lehmann estimator Rank sum ( Mann -- Whitney ) Nonparametric anova 1 - way ( Kruskal -- Wallis ) 2 - way ( Friedman ) Ordered alternative ( Jonckheere -- Terpstra ) Bayesian inference Bayesian probability prior posterior Credible interval Bayes factor Bayesian estimator Maximum posterior estimator Correlation Regression analysis Correlation Pearson product - moment Partial correlation Confounding variable Coefficient of determination Regression analysis Errors and residuals Regression model validation Mixed effects models Simultaneous equations models Multivariate adaptive regression splines ( MARS ) Linear regression Simple linear regression Ordinary least squares General linear model Bayesian regression Non-standard predictors Nonlinear regression Nonparametric Semiparametric Isotonic Robust Heteroscedasticity Homoscedasticity Generalized linear model Exponential families Logistic ( Bernoulli ) / Binomial / Poisson regressions Partition of variance Analysis of variance ( ANOVA, anova ) Analysis of covariance Multivariate ANOVA Degrees of freedom Categorical / Multivariate / Time - series / Survival analysis Categorical Cohen 's kappa Contingency table Graphical model Log - linear model McNemar 's test Multivariate Regression Manova Principal components Canonical correlation Discriminant analysis Cluster analysis Classification Structural equation model Factor analysis Multivariate distributions Elliptical distributions Normal Time - series General Decomposition Trend Stationarity Seasonal adjustment Exponential smoothing Cointegration Structural break Granger causality Specific tests Dickey -- Fuller Johansen Q - statistic ( Ljung -- Box ) Durbin -- Watson Breusch -- Godfrey Time domain Autocorrelation ( ACF ) partial ( PACF ) Cross-correlation ( XCF ) ARMA model ARIMA model ( Box -- Jenkins ) Autoregressive conditional heteroskedasticity ( ARCH ) Vector autoregression ( VAR ) Frequency domain Spectral density estimation Fourier analysis Wavelet Survival Survival function Kaplan -- Meier estimator ( product limit ) Proportional hazards models Accelerated failure time ( AFT ) model First hitting time Hazard function Nelson -- Aalen estimator Test Log - rank test Applications Biostatistics Bioinformatics Clinical trials / studies Epidemiology Medical statistics Engineering statistics Chemometrics Methods engineering Probabilistic design Process / quality control Reliability System identification Social statistics Actuarial science Census Crime statistics Demography Econometrics National accounts Official statistics Population statistics Psychometrics Spatial statistics Cartography Environmental statistics Geographic information system Geostatistics Kriging Portal Commons WikiProject Retrieved from `` https://en.wikipedia.org/w/index.php?title=Spearman%27s_rank_correlation_coefficient&oldid=801404677 '' Categories : Covariance and correlation Information retrieval evaluation Nonparametric statistics Statistical tests Hidden categories : All articles with unsourced statements Articles with unsourced statements from September 2015 CS1 maint : Multiple names : authors list Talk Contents Interaction About Wikipedia Català Čeština Deutsch Ελληνικά Español Euskara فارسی Français हिन्दी Italiano עברית Latviešu Nederlands 日本 語 Polski Português Simple English Slovenščina Suomi Svenska Türkçe Українська 中文 Edit links This page was last edited on 19 September 2017, at 13 : 27. Text is available under the Creative Commons Attribution - ShareAlike License ; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia ® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization. About Wikipedia

Question: • when is a spearman correlation meant to be used instead of a pearson correlation
Answer: assesses monotonic relationships (whether linear or not); Pearson's correlation assesses linear relationships, Spearman's correlation assesses monotonic relationships (whether linear or not)