|
|
| Line 1: |
Line 1: |
| {{Refimprove|date=September 2009}}
| | The name of the writer is Jayson. It's not a typical thing but what I like doing is to climb but I don't have the time lately. Alaska is where I've always been living. Invoicing is what I do for a living but I've usually needed my own company.<br><br>Here is my web page; [http://medialab.zendesk.com/entries/54181460-Will-You-Often-End-Up-Bored-Try-One-Of-These-Hobby-Ideas- psychic phone] |
| {{Regression bar}}
| |
| | |
| In [[econometrics]] and [[statistics]], a '''fixed effects model''' is a [[statistical model]] that represents the observed quantities in terms of explanatory variables that are treated as if the quantities were non-random. This is in contrast to [[random effects model]]s and [[mixed model]]s in which either all or some of the explanatory variables are treated as if they arise from random causes. Contrast this to the [[biostatistics]] definitions,<ref>{{cite book |first=Peter J. |last=Diggle |first2=Patrick |last2=Heagerty |first3=Kung-Yee |last3=Liang |first4=Scott L. |last4=Zeger |year=2002 |title=Analysis of Longitudinal Data |edition=2nd |location= |publisher=Oxford University Press |pages=169–171 |isbn=0-19-852484-6 }}</ref><ref>{{cite book |first=Garrett M. |last=Fitzmaurice |first2=Nan M. |last2=Laird |first3=James H. |last3=Ware |year=2004 |title=Applied Longitudinal Analysis |location=Hoboken |publisher=John Wiley & Sons |pages=326–328 |isbn=0-471-21487-6 }}</ref><ref>{{cite journal |first=Nan M. |last=Laird |first2=James H. |last2=Ware |year=1982 |title=Random-Effects Models for Longitudinal Data |journal=[[Biometrics (journal)|Biometrics]] |volume=38 |issue=4 |pages=963–974 |jstor=2529876 }}</ref> as biostatisticians use "fixed" and "random" effects to respectively refer to the population-average and subject-specific effects (and where the latter are generally assumed to be unknown, [[latent variables]]). Often the same structure of model, which is usually a [[linear regression]] model, can be treated as any of the three types depending on the analyst's viewpoint, although there may be a natural choice in any given situation.
| |
| | |
| In [[panel data]] analysis, the term '''fixed effects estimator''' (also known as the '''within estimator''') is used to refer to an [[estimator]] for the [[coefficient]]s in the regression model. If we assume fixed effects, we impose time independent effects for each entity that are possibly correlated with the regressors.
| |
| | |
| ==Qualitative description==
| |
| | |
| Such models assist in controlling for [[unobserved heterogeneity]] when this heterogeneity is constant over time and correlated with independent variables. This constant can be removed from the data through differencing, for example by taking a first difference which will remove any time invariant components of the model.
| |
| | |
| There are two common assumptions made about the individual specific effect, the random effects assumption and the fixed effects assumption. The random effects assumption (made in a [[random effects model]]) is that the individual specific effects are uncorrelated with the independent variables. The fixed effect assumption is that the individual specific effect is correlated with the independent variables. If the random effects assumption holds, the random effects model is more [[Efficiency (statistics)|efficient]] than the fixed effects model. However, if this assumption does not hold (i.e., if the [[Durbin–Watson statistic|Durbin–Watson test]] fails), the random effects model is not [[Consistency (statistics)|consistent]].
| |
| | |
| ==Formal description==
| |
| Consider the linear unobserved effects model for <math>N</math> observations and <math>T</math> time periods:
| |
| :<math>y_{it} = X_{it}\mathbf{\beta}+\alpha_{i}+u_{it}</math> for <math>t=1,..,T</math> and <math>i=1,...,N</math>
| |
| where <math>y_{it}</math> is the dependent variable observed for individual <math>i</math> at time | |
| <math>t,</math> <math>X_{it}</math> is the time-variant <math>1\times k</math> regressor matrix, <math>\alpha_{i}</math> is the unobserved time-invariant individual effect and <math>u_{it}</math> is the [[Errors and residuals in statistics|error term]]. Unlike <math>X_{it}</math>, <math>\alpha_{i}</math> cannot be observed by the econometrician. Common examples for time-invariant effects <math>\alpha_{i}</math> are innate ability for individuals or historical and institutional factors for countries.
| |
| | |
| Unlike the [[Random effects model|Random effects]] (RE) model where the unobserved <math>\alpha_{i}</math> is independent of <math>x_{it}</math> for all <math>t=1,...,T</math>, the FE model allows <math>\alpha_{i}</math> to be correlated with the regressor matrix <math>x_{it}</math>. [[Exogeneity|Strict exogeneity]], however, is still required.
| |
| | |
| Since <math>\alpha_{i}</math> is not observable, it cannot be directly [[control variable|controlled]] for. The FE model eliminates <math>\alpha_{i}</math> by demeaning the variables using the ''within'' transformation:
| |
| :<math>y_{it}-\overline{y_{i}}=\left(X_{it}-\overline{X_{i}}\right) \beta+ \left( \alpha_{i} - \overline{\alpha_{i}} \right ) + \left( u_{it}-\overline{u_{i}}\right) = \ddot{y_{it}}=\ddot{X_{it}} \beta+\ddot{u_{it}}</math>
| |
| where <math>\overline{X_{i}}=\frac{1}{T}\sum\limits_{t=1}^{T}X_{it}</math> and <math>\overline{u_{i}}=\frac{1}{T}\sum\limits_{t=1}^{T}u_{it}</math>. Since <math>\alpha_{i}</math> is constant, <math>\overline{\alpha_{i}}=\alpha_{i}</math> and hence the effect is eliminated. The FE estimator <math>\hat{\beta}_{FE}</math> is then obtained by an OLS regression of <math>\ddot{y}</math> on <math>\ddot{X}</math>.
| |
| | |
| Another alternative to the ''within'' transformation is to add a dummy variable for each individual <math>i</math>. This is numerically, but not computationally, equivalent to the fixed effect model and only works if <math>T,</math> the number of time observations per individual, is much larger than the
| |
| number of individuals in the panel.
| |
| | |
| == Equality of Fixed Effects (FE) and First Differences (FD) estimators when T=2 ==
| |
| For the special two period case (<math>T=2</math>), the FE estimator and the [[First-Difference Estimator|FD estimator]] are numerically equivalent. This is because the FE estimator effectively "doubles the data set" used in the FD estimator. To see this, establish that the fixed effects estimator is:
| |
| <math>
| |
| {FE}_{T=2}= \left[ (x_{i1}-\bar x_{i}) (x_{i1}-\bar x_{i})' +
| |
| (x_{i2}-\bar x_{i}) (x_{i2}-\bar x_{i})' \right]^{-1}\left[
| |
| (x_{i1}-\bar x_{i}) (y_{i1}-\bar y_{i}) + (x_{i2}-\bar x_{i}) (y_{i2}-\bar y_{i})\right]
| |
| </math>
| |
| | |
| Since each <math>(x_{i1}-\bar x_{i})</math> can be re-written as <math>(x_{i1}-\dfrac{x_{i1}+x_{i2}}{2})=\dfrac{x_{i1}-x_{i2}}{2} </math>, we'll re-write the line as:
| |
| | |
| <math> {FE}_{T=2}= \left[\sum_{i=1}^{N} \dfrac{x_{i1}-x_{i2}}{2} \dfrac{x_{i1}-x_{i2}}{2} ' + \dfrac{x_{i2}-x_{i1}}{2} \dfrac{x_{i2}-x_{i1}}{2} ' \right]^{-1} \left[\sum_{i=1}^{N} \dfrac{x_{i1}-x_{i2}}{2} \dfrac{y_{i1}-y_{i2}}{2} + \dfrac{x_{i2}-x_{i1}}{2} \dfrac{y_{i2}-y_{i1}}{2} \right]</math>
| |
| | |
| :<math>= \left[\sum_{i=1}^{N} 2 \dfrac{x_{i2}-x_{i1}}{2} \dfrac{x_{i2}-x_{i1}}{2} ' \right]^{-1} \left[\sum_{i=1}^{N} 2 \dfrac{x_{i2}-x_{i1}}{2} \dfrac{y_{i2}-y_{i1}}{2} \right]</math>
| |
| :<math>= 2\left[\sum_{i=1}^{N} (x_{i2}-x_{i1})(x_{i2}-x_{i1})' \right]^{-1} \left[\sum_{i=1}^{N} \frac{1}{2} (x_{i2}-x_{i1})(y_{i2}-y_{i1}) \right]</math>
| |
| :<math> = \left[\sum_{i=1}^{N} (x_{i2}-x_{i1})(x_{i2}-x_{i1})' \right]^{-1} \sum_{i=1}^{N} (x_{i2}-x_{i1})(y_{i2}-y_{i1}) ={FD}_{T=2}</math>
| |
| | |
| ==Hausman–Taylor method==
| |
| | |
| Need to have more than one time-variant regressor (<math>X</math>) and time-invariant
| |
| regressor (<math>Z</math>) and at least one <math>X</math> and one <math>Z</math> that are uncorrelated with
| |
| <math>\alpha_{i}</math>.
| |
| | |
| Partition the <math>X</math> and <math>Z</math> variables such that <math>
| |
| \begin{array}
| |
| [c]{c}
| |
| X=[\underset{TN\times K1}{X_{1it}}\vdots\underset{TN\times K2}{X_{2it}}]\\
| |
| Z=[\underset{TN\times G1}{Z_{1it}}\vdots\underset{TN\times G2}{Z_{2it}}]
| |
| \end{array}
| |
| </math> where <math>X_{1}</math> and <math>Z_{1}</math> are uncorrelated with <math>\alpha_{i}</math>. Need <math>K1>G2</math>.
| |
| | |
| Estimating <math> \gamma </math> via OLS on <math>\widehat{di}=Z_{i}\gamma+\varphi_{it}</math> using <math>X_1</math> and <math>Z_1</math> as instruments yields a consistent estimate.
| |
| | |
| ==Testing fixed effects (FE) vs. random effects (RE)==
| |
| | |
| We can test whether a model is appropriate using a [[Hausman test]].
| |
| | |
| : <math>H_{0}</math>: <math>\alpha_{i}\perp X_{it},Z_{i}</math>
| |
| | |
| : <math>H_{a}</math>: <math>\alpha_{i}\not \perp X_{it},Z_{i}</math>
| |
| | |
| If <math>H_{0}</math> is true, both <math>\widehat{\beta}_{RE}</math> and <math>\widehat{\beta}_{FE}</math> are
| |
| consistent, but only <math>\widehat{\beta}_{RE}</math> is efficient. If <math>H_{a}</math> is true,
| |
| <math>\widehat{\beta}_{FE}</math> is consistent and <math>\widehat{\beta}_{RE}</math> is not.
| |
| | |
| : <math>\widehat{Q}=</math> <math>\widehat{\beta}_{RE}-\widehat{\beta}_{FE}</math>
| |
| | |
| : <math>\widehat{HT}=T\widehat{Q}^{\prime}[Var(\widehat{\beta}_{FE})-Var(\widehat | |
| {\beta}_{RE})]^{-1}\widehat{Q}\sim\chi_{K}^{2}</math> where <math>K=\dim(Q)</math>
| |
| | |
| The Hausman test is a specification test so a large test statistic might be
| |
| indication that there might be Errors in Variables (EIV) or our model is
| |
| misspecified. If the FE assumption is true, we should find that <math>\widehat
| |
| {\beta}_{LD}\approx\widehat{\beta}_{FD}\approx\widehat{\beta}_{FE}</math>.
| |
| | |
| A simple heuristic is that if <math>\left\vert \widehat{\beta}_{LD}\right\vert
| |
| >\left\vert \widehat{\beta}_{FE}\right\vert >\left\vert \widehat{\beta}
| |
| _{FD}\right\vert </math> there could be EIV.
| |
| | |
| ==Steps in Fixed Effects Model for sample data==
| |
| | |
| # Calculate group and grand means
| |
| # Calculate k=number of groups, n=number of observations per group, N=total number of observations (k x n)
| |
| # Calculate SS-total (or total variance) as: (Each score - Grand mean)^2 then summed
| |
| # Calculate SS-treat (or treatment effect) as: (Each group mean- Grand mean)^2 then summed x n
| |
| # Calculate SS-error (or error effect) as (Each score - Its group mean)^2 then summed
| |
| # Calculate df-total: N-1, df-treat: k-1 and df-error k(n-1)
| |
| # Calculate Mean Square MS-treat: SS-treat/df-treat, then MS-error: SS-error/df-error
| |
| # Calculate obtained f value: MS-treat/MS-error
| |
| # Use F-table or probability function, to look up critical f value with a certain significance level
| |
| # Conclude as to whether treatment effect significantly affects the variable of interest
| |
| | |
| ==See also==
| |
| * [[Random effects model]]
| |
| * [[Mixed model]]
| |
| | |
| ==Notes==
| |
| {{reflist}}
| |
| | |
| ==References==
| |
| * {{cite book |title=Plane Answers to Complex Questions: The Theory of Linear Models|last=Christensen|first=Ronald|location=New York|publisher=Springer|year=2002| edition=Third|isbn=0-387-95361-2}}
| |
| * {{cite book |last=Gujarati |first=Damodar N. |last2=Porter |first2=Dawn C. |chapter=Panel Data Regression Models |title=Basic Econometrics |location=Boston |publisher=McGraw-Hill |year=2009 |edition=Fifth international |isbn=978-007-127625-2 |pages=591–616 }}
| |
| * {{cite book |last=Wooldridge |first=Jeffrey M. |year=2013 |chapter=Fixed Effects Estimation |pages=466–474 |title=Introductory Econometrics: A Modern Approach |location=Mason, OH |publisher=South-Western |edition=Fifth international |isbn=978-1-111-53439-4 }}
| |
| | |
| ==External links==
| |
| *[http://teaching.sociology.ul.ie/DCW/confront/node45.html Fixed and random effects models]
| |
| * [http://www.southampton.ac.uk/~cpd/anovas/datasets/index.htm Examples of all ANOVA and ANCOVA models with up to three treatment factors, including randomized block, split plot, repeated measures, and Latin squares, and their analysis in R]
| |
| | |
| [[Category:Estimation theory]]
| |
| [[Category:Analysis of variance]]
| |
| [[Category:Regression analysis]]
| |
| | |
| [[de:Lineare Paneldatenmodelle]]
| |
| [[es:Modelo de efectos fijos]]
| |
| [[ja:固定効果モデル]]
| |