Lewis structure

In statistics, deviance is a quality of fit statistic for a model that is often used for statistical hypothesis testing. It is a generalization of the idea of using the sum of squared residuals in ordinary least squares to cases where model-fitting is achieved by maximum likelihood.

Definition

The deviance for a model M₀, based on a dataset y, is defined as:

$D(y)=-2(\log (p(y|{\hat{\theta }}_0))-\log (p(y|{\hat{\theta }}_s)\left)\right).$

Here ${\hat{\theta }}_0$ denotes the fitted values of the parameters in the model M₀, while ${\hat{\theta }}_s$ denotes the fitted parameters for the "full model" (or "saturated model"): both sets of fitted values are implicitly functions of the observations y. Here the full model is a model with a parameter for every observation so that the data are fitted exactly. This expression is simply −2 times the log-likelihood ratio of the reduced model compared to the full model. The deviance is used to compare two models – in particular in the case of generalized linear models where it has a similar role to residual variance from ANOVA in linear models (RSS).

Suppose in the framework of the GLM, we have two nested models, M₁ and M₂. In particular, suppose that M₁ contains the parameters in M₂, and k additional parameters. Then, under the null hypothesis that M₂ is the true model, the difference between the deviances for the two models follows an approximate chi-squared distribution with k-degrees of freedom.

Some usage of the term "deviance" can be confusing. According to Collett:

"the quantity $-2\log (p(y|{\hat{\theta }}_0))$ is sometimes referred to as a deviance. This is [...] inappropriate, since unlike the deviance used in the context of generalized linear modelling, $-2\log (p(y|{\hat{\theta }}_0))$ does not measure deviation from a model that is a perfect fit to the data." However, since the principal use is in the form of the difference of the deviances of two models, this confusion in definition is unimportant.

See also

• Pearson's chi-squared test, an alternative quality of fit statistic for generalized linear models for count data.
• Hosmer-Lemeshow test, a quality of fit statistic that can be used for binary data.
• Akaike information criterion
• Deviance information criterion
• Peirce's criterion
• Discrepancy function

Notes

43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.

References

• 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
  
  My blog: http://www.primaboinca.com/view_profile.php?userid=5889534

• 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
  
  My blog: http://www.primaboinca.com/view_profile.php?userid=5889534

External links

• Generalized Linear Models - Edward F. Connor
• Lectures notes on Deviance