|
|
| Line 1: |
Line 1: |
| [[Image:spearman fig1.svg|300px|right|thumb|A Spearman correlation of 1 results when the two variables being compared are monotonically related, even if their relationship is not linear. In contrast, this does not give a perfect Pearson correlation.]][[Image:spearman fig2.svg|300px|right|thumb|When the data are roughly elliptically distributed and there are no prominent outliers, the Spearman correlation and Pearson correlation give similar values.]]
| | That this person who wrote all of the article is called Leland but it's not this most masucline name presently. To go to [http://browse.Deviantart.com/?qh=§ion=&global=1&q=karaoke karaoke] is the thing which is why he loves most of nearly all. He art as a cashier. His wife and him live all through Massachusetts and he is bound to have everything that he needs there. He's not godd at design but consider want to check that website: http://prometeu.net<br><br>Look at my web page - clash of clans hack cydia ([http://prometeu.net mouse click the next web page]) |
| [[Image:spearman fig3.svg|300px|right|thumb|The Spearman correlation is less sensitive than the Pearson correlation to strong outliers that are in the tails of both samples. That is because Spearman's rho limits the outlier to the value of its rank.]] In [[statistics]], '''Spearman's rank correlation coefficient''' or '''Spearman's rho''', named after [[Charles Spearman]] and often denoted by the Greek letter [[rho (letter)|<math>\rho</math>]] (rho) or as <math>r_s</math>, is a [[non-parametric statistics|nonparametric]] measure of [[correlation and dependence|statistical dependence]] between two [[Variable (mathematics)#Applied statistics|variables]]. It assesses how well the relationship between two variables can be described using a [[monotonic]] function. If there are no repeated data values, a perfect Spearman correlation of +1 or −1 occurs when each of the variables is a perfect monotone function of the other.
| |
| Spearman's coefficient, like any correlation calculation, is appropriate for both [[continuous variable|continuous]] and [[discrete variable]]s, including [[Level_of_measurement#Ordinal_scale|ordinal]] variables.<ref>[[Level_of_measurement#Typology|Scale types]]</ref><ref>{{cite book |title=Jmp For Basic Univariate And Multivariate Statistics: A Step-by-step Guide |first=Ann |last=Lehman |location=Cary, NC |publisher=SAS Press |year=2005 |page=123 |isbn=1-59047-576-3 }}</ref>
| |
| | |
| ==Definition and calculation==
| |
| The Spearman correlation coefficient is defined as the [[Pearson product-moment correlation coefficient|Pearson correlation coefficient]] between the [[Ranking|ranked variables]].<ref name="myers2003">{{Cite book | last1=Myers | first1=Jerome L. | first2=Arnold D. |last2= Well | title=Research Design and Statistical Analysis | publisher=Lawrence Erlbaum | year=2003 | edition=2nd | isbn=0-8058-4037-0 | pages=508}}</ref> For a sample of size ''n'', the ''n'' [[raw score]]s <math>X_i, Y_i</math> are converted to ranks <math>x_i, y_i</math>, and ρ is computed from these:
| |
| | |
| :<math> \rho = \frac{\sum_i(x_i-\bar{x})(y_i-\bar{y})}{\sqrt{\sum_i (x_i-\bar{x})^2 \sum_i(y_i-\bar{y})^2}}</math>
| |
| | |
| Identical values (rank ties or value duplicates) are assigned a rank equal to the average of their positions in the ascending order of the values. In the table below, notice how the rank of values that are the same is the mean of what their ranks would otherwise be:
| |
| | |
| {|class="wikitable"
| |
| !Variable <math>X_i</math> !! Position in the ascending order !! Rank <math>x_i</math>
| |
| |-
| |
| |0.8||1||1
| |
| |-
| |
| |1.2||2||<math>\frac{2+3}{2}=2.5\ </math>
| |
| |-
| |
| |1.2||3||<math>\frac{2+3}{2}=2.5\ </math>
| |
| |-
| |
| |2.3||4||4
| |
| |-
| |
| |18||5||5
| |
| |}
| |
| | |
| In applications where duplicate values (ties) are known to be absent, a simpler procedure can be used to calculate ρ.<ref name="myers2003"/><ref>{{cite book |last=Maritz |first=J. S. |year=1981 |title=Distribution-Free Statistical Methods |publisher=Chapman & Hall |isbn=0-412-15940-6 |page=217 }}</ref> Differences <math>d_i = x_i - y_i</math> between the ranks of each observation on the two variables are calculated, and ρ is given by:
| |
| | |
| :<math> \rho = 1- {\frac {6 \sum d_i^2}{n(n^2 - 1)}}.</math>
| |
| | |
| Note that this latter method should not be used in cases where the data set is truncated; that is, when the Spearman correlation coefficient is desired for the top X records (whether by pre-change rank or post-change rank, or both), the user should use the Pearson correlation coefficient formula given above.
| |
| | |
| The standard error of the coefficient (''σ'') was determined by Pearson in 1907 and Gosset in 1920. It is
| |
| | |
| : <math> \sigma = \frac{ 0.6325 }{ ( n - 1 )^{ \frac{ 1 }{ 2 } } } </math>
| |
| | |
| ==Related quantities==
| |
| {{Main|Correlation and dependence}}
| |
| | |
| There are several other numerical measures that quantify the extent of [[statistical dependence]] between pairs of observations. The most common of these is the [[Pearson product-moment correlation coefficient]], which is a similar correlation method to Spearman's rank, that measures the “linear” relationships between the raw numbers rather than between their ranks.
| |
| | |
| An alternative name for the Spearman [[rank correlation]] is the “grade correlation”;<ref name="Yule and Kendall">{{cite book |last=Yule |first=G. U. |last2=Kendall |first2=M. G. |year=1950 |title=An Introduction to the Theory of Statistics |edition=14th |year=1968 |publisher=Charles Griffin & Co. |page=268 }}</ref> in this, the “rank” of an observation is replaced by the “grade”. In continuous distributions, the grade of an observation is, by convention, always one half less than the rank, and hence the grade and rank correlations are the same in this case. More generally, the “grade” of an observation is proportional to an estimate of the fraction of a population less than a given value, with the half-observation adjustment at observed values. Thus this corresponds to one possible treatment of tied ranks. While unusual, the term “grade correlation” is still in use.<ref>{{cite journal |last=Piantadosi |first=J. |last2=Howlett |first2=P. |last3=Boland |first3=J. |year=2007 |title=Matching the grade correlation coefficient using a copula with maximum disorder |journal=Journal of Industrial and Management Optimization |volume=3 |issue=2 |pages=305–312 |doi= |url=http://aimsciences.org/journals/pdfs.jsp?paperID=2265&mode=abstract }}</ref>
| |
| | |
| ==Interpretation==
| |
| {| style="float: right; HSPACE=10"
| |
| |+ Positive and negative Spearman rank correlations
| |
| |-
| |
| | [[Image:spearman fig5.svg|300px|left|thumb|A positive Spearman correlation coefficient corresponds to an increasing monotonic trend between ''X'' and ''Y''.]]
| |
| | [[Image:spearman fig4.svg|300px|right|thumb|A negative Spearman correlation coefficient corresponds to a decreasing monotonic trend between ''X'' and ''Y''.]]
| |
| |}
| |
| | |
| The sign of the Spearman correlation indicates the direction of association between ''X'' (the independent variable) and ''Y'' (the dependent variable). If ''Y'' tends to increase when ''X'' increases, the Spearman correlation coefficient is positive. If ''Y'' tends to decrease when ''X'' increases, the Spearman correlation coefficient is negative. A Spearman correlation of zero indicates that there is no tendency for ''Y'' to either increase or decrease when ''X'' increases. The Spearman correlation increases in magnitude as ''X'' and ''Y'' become closer to being perfect monotone functions of each other. When ''X'' and ''Y'' are perfectly monotonically related, the Spearman correlation coefficient becomes 1. A perfect monotone increasing relationship implies that for any two pairs of data values ''X''<sub>''i''</sub>, ''Y''<sub>''i''</sub> and ''X''<sub>''j''</sub>, ''Y''<sub>''j''</sub>, that ''X''<sub>''i''</sub> − ''X''<sub>''j''</sub> and ''Y''<sub>''i''</sub> − ''Y''<sub>''j''</sub> always have the same sign. A perfect monotone decreasing relationship implies that these differences always have opposite signs.
| |
| | |
| The Spearman correlation coefficient is often described as being "nonparametric". This can have two meanings. First, the fact that a perfect Spearman correlation results when ''X'' and ''Y'' are related by any [[monotonic function]] can be contrasted with the Pearson correlation, which only gives a perfect value when ''X'' and ''Y'' are related by a linear function. The other sense in which the Spearman correlation is nonparametric in that its exact sampling distribution can be obtained without requiring knowledge (''i.e.'', knowing the parameters) of the joint [[probability distribution]] of ''X'' and ''Y''.
| |
| | |
| ==Example==
| |
| In this example, we will use the raw data in the table below to calculate the correlation between the [[IQ]] of a person with the number of hours spent in front of [[TV]] per week.
| |
| {| class="wikitable"
| |
| |-
| |
| |[[IQ]], <math>X_i</math>
| |
| |Hours of [[TV]] per week, <math>Y_i</math>
| |
| |-
| |
| |106
| |
| |7
| |
| |-
| |
| |86
| |
| |0
| |
| |-
| |
| |100
| |
| |27
| |
| |-
| |
| |101
| |
| |50
| |
| |-
| |
| |99
| |
| |28
| |
| |-
| |
| |103
| |
| |29
| |
| |-12
| |
| |97
| |
| |20
| |
| |-
| |
| |113
| |
| |12
| |
| |-
| |
| |112
| |
| |6
| |
| |-
| |
| |110
| |
| |17
| |
| |}
| |
| | |
| First, we must find the value of the term <math>d^2_i</math>. To do so we use the following steps, reflected in the table below.
| |
| # Sort the data by the first column (<math>X_i</math>). Create a new column <math>x_i</math> and assign it the ranked values 1,2,3,...''n''.
| |
| # Next, sort the data by the second column (<math>Y_i</math>). Create a fourth column <math>y_i</math> and similarly assign it the ranked values 1,2,3,...''n''.
| |
| # Create a fifth column <math>d_i</math> to hold the differences between the two rank columns (<math>x_i</math> and <math>y_i</math>).
| |
| # Create one final column <math>d^2_i</math> to hold the value of column <math>d_i</math> squared.
| |
| | |
| {| class="wikitable"
| |
| |-
| |
| |[[IQ]], <math>X_i</math>
| |
| |Hours of [[TV]] per week, <math>Y_i</math>
| |
| |rank <math>x_i</math>
| |
| |rank <math>y_i</math>
| |
| |<math>d_i</math>
| |
| |<math>d^2_i</math>
| |
| |-
| |
| |86
| |
| |0
| |
| |1
| |
| |1
| |
| |0
| |
| |0
| |
| |-
| |
| |97
| |
| |20
| |
| |2
| |
| |6
| |
| | −4
| |
| |16
| |
| |-
| |
| |99
| |
| |28
| |
| |3
| |
| |8
| |
| | −5
| |
| |25
| |
| |-
| |
| |100
| |
| |27
| |
| |4
| |
| |7
| |
| | −3
| |
| |9
| |
| |-
| |
| |101
| |
| |50
| |
| |5
| |
| |10
| |
| | −5
| |
| |25
| |
| |-
| |
| |103
| |
| |29
| |
| |6
| |
| |9
| |
| | −3
| |
| |9
| |
| |-
| |
| |106
| |
| |7
| |
| |7
| |
| |3
| |
| |4
| |
| |16
| |
| |-
| |
| |110
| |
| |17
| |
| |8
| |
| |5
| |
| |3
| |
| |9
| |
| |-
| |
| |112
| |
| |6
| |
| |9
| |
| |2
| |
| |7
| |
| |49
| |
| |-
| |
| |113
| |
| |12
| |
| |10
| |
| |4
| |
| |6
| |
| |36
| |
| |}
| |
| | |
| With <math>d^2_i</math> found, we can add them to find <math>\sum d_i^2 = 194</math>. The value of ''n'' is 10. So these values can now be substituted back into the equation,
| |
| | |
| :<math> \rho = 1- {\frac {6\times194}{10(10^2 - 1)}}</math>
| |
| | |
| which evaluates to ''ρ'' = -29/165 = −0.175757575...
| |
| with a [[P-value]] = 0.6864058 (using the [[Student's t-distribution|t distribution]])
| |
| | |
| This low value shows that the correlation between IQ and hours spent watching TV is very low. In the case of ties in the original values, this formula should not be used. Instead, the Pearson correlation coefficient should be calculated on the ranks (where ties are given ranks, as described above).
| |
| | |
| ==Determining significance==
| |
| One approach to testing whether an observed value of ρ is significantly different from zero (''r'' will always maintain −1 ≤ ''r'' ≤ 1) is to calculate the probability that it would be greater than or equal to the observed ''r'', given the [[null hypothesis]], by using a [[Resampling (statistics)#Permutation tests|permutation test]]. An advantage of this approach is that it automatically takes into account the number of tied data values there are in the sample, and the way they are treated in computing the rank correlation.
| |
| | |
| Another approach parallels the use of the [[Fisher transformation]] in the case of the Pearson product-moment correlation coefficient. That is, [[confidence intervals]] and [[hypothesis test]]s relating to the population value ρ can be carried out using the Fisher transformation:
| |
| | |
| : <math>F(r) = {1 \over 2}\ln{1+r \over 1-r} = \operatorname{arctanh}(r).</math> | |
| | |
| If ''F''(''r'') is the Fisher transformation of ''r'', the sample Spearman rank correlation coefficient, and ''n'' is the sample size, then
| |
| | |
| :<math>z = \sqrt{\frac{n-3}{1.06}}F(r)</math>
| |
| | |
| is a [[standard score|z-score]] for ''r'' which approximately follows a standard [[normal distribution]] under the [[null hypothesis]] of [[statistical independence]] (ρ = 0).<ref>{{cite journal |last=Choi |first=S. C. |year=1977 |title=Tests of Equality of Dependent Correlation Coefficients |journal=[[Biometrika]] |volume=64 |issue=3 |pages=645–647 |doi=10.1093/biomet/64.3.645 }}</ref><ref>{{cite journal |last=Fieller |first=E. C. |last2=Hartley |first2=H. O. |last3=Pearson |first3=E. S. |year=1957 |title=Tests for rank correlation coefficients. I |journal=Biometrika |volume=44 |issue= |pages=470–481 }}</ref>
| |
| | |
| One can also test for significance using
| |
| | |
| :<math>t = r \sqrt{\frac{n-2}{1-r^2}}</math>
| |
| | |
| which is distributed approximately as [[Student's t distribution]] with ''n'' − 2 degrees of freedom under the [[null hypothesis]].<ref>{{cite book |last=Press |last2=Vettering |last3=Teukolsky |last4=Flannery |year=1992 |title=Numerical Recipes in C: The Art of Scientific Computing |edition=2nd |page=640 }}</ref> A justification for this result relies on a permutation argument.<ref>{{cite book |last=Kendall |first=M. G. |last2=Stuart |first2=A. |year=1973 |title=The Advanced Theory of Statistics, Volume 2: Inference and Relationship |publisher=Griffin |isbn=0-85264-215-6 }} (Sections 31.19, 31.21)</ref>
| |
| | |
| A generalization of the Spearman coefficient is useful in the situation where there are three or more conditions, a number of subjects are all observed in each of them, and it is predicted that the observations will have a particular order. For example, a number of subjects might each be given three trials at the same task, and it is predicted that performance will improve from trial to trial. A test of the significance of the trend between conditions in this situation was developed by E. B. Page<ref>{{cite journal |author=Page, E. B. |title=Ordered hypotheses for multiple treatments: A significance test for linear ranks |journal=Journal of the American Statistical Association |volume=58 |pages=216–230 |year=1963 |doi=10.2307/2282965 |issue=301}}
| |
| </ref> and is usually referred to as [[Page's trend test]] for ordered alternatives.
| |
| | |
| ==Correspondence analysis based on Spearman's rho==
| |
| Classic [[correspondence analysis]] is a statistical method that gives a score to every value of two nominal variables. In this way the Pearson [[Pearson product-moment correlation coefficient|correlation coefficient]] between them is maximized.
| |
| | |
| There exists an equivalent of this method, called [[grade correspondence analysis]], which maximizes Spearman's rho or [[Kendall's tau]].<ref>{{cite book|last=Kowalczyk|first=T.|coauthors=Pleszczyńska E. , Ruland F. (eds.)| year=2004|title=Grade Models and Methods for Data Analysis with Applications for the Analysis of Data Populations|series=Studies in Fuzziness and Soft Computing |volume=151|publisher=Springer Verlag|location=Berlin Heidelberg New York|isbn=978-3-540-21120-4}}</ref>
| |
| | |
| ==See also==
| |
| {{Portal|Statistics}}
| |
| * [[Kendall tau rank correlation coefficient]]
| |
| * [[Chebyshev's sum inequality]], [[rearrangement inequality]] (These two articles may shed light on the mathematical properties of Spearman's ρ.)
| |
| | |
| ==References==
| |
| {{Reflist|30em}}
| |
| | |
| ===Further reading===
| |
| * {{Cite book |author=Corder GW, Foreman DI |title=Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach |location=Hoboken, N.J. |publisher=Wiley |year=2009 |isbn=978-0-470-4546-19 |oclc=276228975}}
| |
| * {{Cite journal |author=Spearman C |title=The proof and measurement of association between two things |journal=Amer. J. Psychol. |volume=15 |year=1904 |pages=72–101}}
| |
| * {{Cite book |author=Kendall MG |title=Rank correlation methods |location=London |publisher=Griffin |year=1970 |edition=4th |isbn=978-0-852-6419-96 |oclc=136868}}
| |
| * {{Cite book |author=Hollander M, Wolfe DA |title=Nonparametric statistical methods |location=New York |publisher=Wiley |year=1973 |isbn=978-0-471-40635-8 |oclc=520735}}
| |
| * {{Cite journal |author=Caruso JC, Cliff N |title=Empirical size, coverage, and power of confidence intervals for Spearman's Rho |journal=Ed. and Psy. Meas. |volume=57 |year=1997 |pages=637–654}}
| |
| | |
| ==External links==
| |
| {{Wikiversity}}
| |
| * [http://www.crystalballservices.com/Resources/ConsultantsCornerBlog/EntryId/73/Copulas-Vs-Correlation.aspx "Understanding Correlation vs. Copulas in Excel"] by Eric Torkia, Technology Partnerz 2011
| |
| *[http://www.sussex.ac.uk/Users/grahamh/RM1web/Rhotable.htm Table of critical values of ρ for significance with small samples]
| |
| *[http://www.maccery.com/maths Spearman's rank online calculator]
| |
| *[http://faculty.vassar.edu/lowry/webtext.html Chapter 3 part 1 shows the formula to be used when there are ties]
| |
| *[http://udel.edu/~mcdonald/statspearman.html Spearman's rank correlation]: Simple notes for students with an example of usage by biologists and a spreadsheet for [[Microsoft Excel]] for calculating it (a part of materials for a ''Research Methods in Biology'' course).
| |
| {{Statistics|descriptive}}
| |
| {{DEFAULTSORT:Spearman's Rank Correlation Coefficient}}
| |
| [[Category:Covariance and correlation]]
| |
| [[Category:Non-parametric statistics]]
| |
| [[Category:Statistical dependence]]
| |
| [[Category:Statistical tests]]
| |
| | |
| {{Link FA|pl}}
| |