Conservative extension: Difference between revisions

From formulasearchengine
Jump to navigation Jump to search
en>Pit-trout
Clarified definition of model-theoretic conservativity, making explicit that "extension" is assumed.
en>Yobot
m WP:CHECKWIKI error fixes using AWB
 
Line 1: Line 1:
{{lowercase}}
Luke is actually a superstar in the generating and also the occupation development to start with next to his  [http://lukebryantickets.flicense.com luke bryan vip tickets] third studio recording, And , may be the evidence. He burst open on the scene in 2002 along with his funny combination of straight down-house convenience, movie star very good seems and lyrics, is defined t in a major way. The latest record  Top on the nation graph or chart and #2 on the pop maps, producing it the 2nd top debut at that time of 2005 for the region musician. <br><br>The boy of the , understands persistence and dedication are important elements when it comes to a prosperous  career- . His initial recording, Stay Me, generated the most notable  strikes “All My Buddies “Country and Say” Man,” although his  energy, Doin’  Point, located the singer-about three straight No. 9 single men and women:  Else Getting in touch with Is really a Fantastic Factor.<br><br>In the slip of 2004, Concert tour: Luke  & that had an outstanding selection of , such as Metropolitan. “It’s almost like you’re receiving a   authorization to go to a higher level, affirms these designers which were an element of   [http://www.hotelsedinburgh.org luke bryan concert tickets 2014] the Concert toursover in a larger degree of artists.” It twisted as one of the most successful  trips in   [http://lukebryantickets.neodga.com kid cudi tickets] its ten-calendar year historical past.<br><br>My web-site; [http://lukebryantickets.pyhgy.com luke bryan tickets on sale dates]
{{Probability distribution|
  name      =von Mises|
  type      =density|
  pdf_image =[[File:VonMises distribution PDF.png|325px|Plot of the von Mises PMF]]<br /><small>The support is chosen to be [&minus;{{pi}},{{pi}}] with μ&nbsp;=&nbsp;0</small>|
  cdf_image  =[[File:VonMises distribution CDF.png|325px|Plot of the von Mises CMF]]<br /><small>The support is chosen to be [&minus;{{pi}},{{pi}}] with μ&nbsp;=&nbsp;0</small>|
  parameters =<math>\mu</math> real<br><math>\kappa>0</math>|
  support    =<math>x\in</math> any interval of length 2π|
  pdf        =<math>\frac{e^{\kappa\cos(x-\mu)}}{2\pi I_0(\kappa)}</math>|
  cdf        =(not analytic – see text)|
  mean      =<math>\mu</math>|
  median    =<math>\mu</math>|
  mode      =<math>\mu</math>|
  variance  =<math>\textrm{var}(x)=1-I_1(\kappa)/I_0(\kappa)</math> (circular)|
  skewness  =|
  kurtosis  =|
  entropy    =<math>-\kappa\frac{I_1(\kappa)}{I_0(\kappa)}+\ln[2\pi I_0(\kappa)]</math> (differential)|
  mgf        =|
  char      =<math>\frac{I_{|n|}(\kappa)}{I_0(\kappa)}e^{i n \mu}</math>|
}}
 
In [[probability theory]] and [[directional statistics]], the '''[[Richard von Mises|von Mises]] distribution''' (also known as the '''circular normal distribution''' or '''Tikhonov distribution''') is a continuous [[probability distribution]] on the [[circle]]. It is a close approximation to the [[wrapped normal distribution]], which is the circular analogue of the [[normal distribution]]. A freely diffusing angle <math>\theta</math> on a circle is a wrapped normally distributed random variable with an unwrapped variance that grows linearly in time. On the other hand, the von Mises distribution is the stationary distribution of a drift and diffusion process on the circle in a harmonic potential, i.e. with a preferred orientation.<ref name="Risken89">{{cite book |title=The Fokker–Planck Equation |last=Risken |first=H. |year=1989|publisher=Springer |location= |isbn=978-3-540-61530-9 |url=http://www.amazon.com/dp/354061530X}}</ref> The von Mises distribution is the [[Maximum entropy probability distribution|maximum entropy distribution]] for a given expectation value of <math>z=e^{i\theta}</math>. The von Mises distribution is a special case of the [[von Mises–Fisher distribution]] on the ''N''-dimensional sphere.
 
== Definition ==
The von Mises probability density function for the angle ''x'' is given by:<ref name="Mardia99">{{cite book |title=Directional Statistics |last=Mardia |first=Kantilal |authorlink=Kantilal Mardia |coauthors=Jupp, Peter E. |year=1999|publisher=Wiley |location= |isbn=978-0-471-95333-3 |url=http://www.amazon.com/dp/0471953334 |accessdate=2011-07-19}}</ref>
 
:<math>f(x\mid\mu,\kappa)=\frac{e^{\kappa\cos(x-\mu)}}{2\pi I_0(\kappa)}</math>
 
where ''I''<sub>0</sub>(''x'') is the modified [[Bessel function]] of order 0.
 
The parameters μ and 1/κ are analogous to μ and ''σ''<sup>2</sup> (the mean and variance) in the normal distribution:
* μ is a measure of location (the distribution is clustered around μ), and
* κ is a measure of concentration (a reciprocal measure of [[statistical dispersion|dispersion]], so 1/κ is analogous to ''σ''<sup>2</sup>).
** If κ is zero, the distribution is uniform, and for small κ, it is close to uniform.
** If κ is large, the distribution becomes very concentrated about the angle μ with κ being a measure of the concentration. In fact, as κ increases, the distribution approaches a normal distribution in ''x''&nbsp; with mean μ and variance&nbsp;1/κ.
 
The probability density can be expressed as a series of Bessel functions (see Abramowitz and Stegun [http://www.math.sfu.ca/~cbm/aands/page_376.htm §9.6.34])
 
: <math> f(x\mid\mu,\kappa) = \frac{1}{2\pi}\left(1+\frac{2}{I_0(\kappa)} \sum_{j=1}^\infty I_j(\kappa) \cos[j(x-\mu)]\right) </math>
 
where ''I''<sub>''j''</sub>(''x'') is the modified [[Bessel function]] of order ''j''.
 
The cumulative distribution function is not analytic and is best found by integrating the above series. The indefinite integral of the probability density is:
 
:<math>\Phi(x\mid\mu,\kappa)=\int f(t\mid\mu,\kappa)\,dt =\frac{1}{2\pi}\left(x + \frac{2}{I_0(\kappa)} \sum_{j=1}^\infty I_j(\kappa) \frac{\sin[j(x-\mu)]}{j}\right). </math>
 
The cumulative distribution function will be a function of the lower limit of
integration ''x''<sub>0</sub>:
 
:<math>F(x\mid\mu,\kappa)=\Phi(x\mid\mu,\kappa)-\Phi(x_0\mid\mu,\kappa).\,</math>
 
== Moments ==
The moments of the von Mises distribution are usually calculated as the moments of ''z'' = ''e''<sup>''ix''</sup> rather than the angle ''x'' itself. These moments are referred to as "circular moments". The variance calculated from these moments is referred to as the "circular variance". The one exception to this is that the "mean" usually refers to the argument of the circular mean, rather than the circular mean itself.
 
The ''n''th raw moment of ''z'' is:
 
:<math>m_n=\langle z^n\rangle=\int_\Gamma z^n\,f(x|\mu,\kappa)\,dx</math>
:<math>= \frac{I_{|n|}(\kappa)}{I_0(\kappa)}e^{i n \mu}</math>
 
where the integral is over any interval <math>\Gamma</math> of length 2π. In calculating the above integral, we use the fact that ''z''<sup>''n''</sup> = cos(''n''x)&nbsp;+&nbsp;i&nbsp;sin(''nx'') and the Bessel function identity (See Abramowitz and Stegun [http://www.math.sfu.ca/~cbm/aands/page_376.htm §9.6.19]):
 
:<math>I_n(\kappa)=\frac{1}{\pi}\int_0^\pi e^{\kappa\cos(x)}\cos(nx)\,dx.</math>
 
The mean of ''z''&nbsp; is then just
 
:<math>m_1= \frac{I_1(\kappa)}{I_0(\kappa)}e^{i\mu}</math>
 
and the "mean" value of ''x'' is then taken to be the argument μ. This is the "average" direction of the angular random variables. The variance of ''z'', or the circular variance of ''x'' is:
 
:<math>\textrm{var}(x)= 1-E[\cos(x-\mu)]
= 1-\frac{I_1(\kappa)}{I_0(\kappa)}.</math>
 
== Limiting behavior ==
In the limit of large κ the distribution becomes a [[normal distribution]]
 
:<math>\lim_{\kappa\rightarrow\infty}
f(x\mid\mu,\kappa)=\frac 1 {\sigma\sqrt{2\pi}} \exp\left[\dfrac{-(x-\mu)^2}{2\sigma^2}\right]</math>
 
where σ<sup>2</sup> = 1/κ. In the limit of small κ it becomes a [[uniform distribution (continuous)|uniform distribution]]:
 
:<math>\lim_{\kappa\rightarrow 0}f(x\mid\mu,\kappa)=\mathrm{U}(x)</math>
 
where the interval for the uniform distribution ''U''(''x'') is the chosen interval of length 2π.
 
== Estimation of parameters ==
A series of ''N'' measurements <math>z_n=e^{i\theta_n}</math> drawn from a von Mises distribution may be used to estimate certain parameters of the distribution. (Borradaile, 2003) The average of the series <math>\overline{z}</math> is defined as
 
:<math>\overline{z}=\frac{1}{N}\sum_{n=1}^N z_n</math>
 
and its expectation value will be just the first moment:
 
:<math>\langle\overline{z}\rangle=\frac{I_1(\kappa)}{I_0(\kappa)}e^{i\mu}.</math>
 
In other words, <math>\overline{z}</math> is an [[unbiased estimator]] of the first moment. If we assume that the mean <math>\mu</math> lies in the interval <math>[-\pi,\pi)</math>, then Arg<math>(\overline{z})</math> will be a (biased) estimator of the mean <math>\mu</math>.
 
Viewing the <math>z_n</math> as a set of vectors in the complex plane, the <math>\bar{R}^ 2</math> statistic is the square of the length of the averaged vector:
 
:<math>\bar{R}^ 2=\overline{z}\,\overline{z^*}=\left(\frac{1}{N}\sum_{n=1}^N \cos\theta_n\right)^2+\left(\frac{1}{N}\sum_{n=1}^N \sin\theta_n\right)^2</math>
 
and its expectation value is:
 
:<math>\langle \bar{R}^2\rangle=\frac{1}{N}+\frac{N-1}{N}\,\frac{I_1(\kappa)^2}{I_0(\kappa)^2}.</math>
 
In other words, the statistic
 
:<math>R_e^2=\frac{N}{N-1}\left(\bar{R}^2-\frac{1}{N}\right)</math>
 
will be an unbiased estimator of <math>\frac{I_1(\kappa)^2}{I_0(\kappa)^2}\,</math> and solving the equation <math>R_e=\frac{I_1(\kappa)}{I_0(\kappa)}\,</math> for <math>\kappa\,</math> will yield a (biased) estimator of <math>\kappa\,</math>. In analogy to the linear case, the solution to the equation <math>\bar{R}=\frac{I_1(\kappa)}{I_0(\kappa)}\,</math> will yield the [[Maximum likelihood|maximum likelihood estimate]] of <math>\kappa\,</math> and both will be equal in the limit of large ''N''. For approximate solution to <math>\kappa\,</math> refer to [[von Mises–Fisher distribution]].
 
== Distribution of the mean ==
The [[Directional statistics|distribution of the sample mean]] <math>\overline{z} = \bar{R}e^{i\overline{\theta}}</math> for the von Mises distribution is given by:<ref name="Jam">{{cite book |title=Topics in Circular Statistics |last=Jammalamadaka |first=S. Rao |authorlink= |coauthors=Sengupta, A. |year=2001 |publisher=World Scientific Publishing Company |location= |isbn=978-981-02-3778-3 |url=http://www.amazon.com/dp/9810237782#reader_9810237782 |accessdate=2010-03-03}}</ref>
 
:<math>
P(\bar{R},\bar{\theta})\,d\bar{R}\,d\bar{\theta}=\frac{1}{ (2\pi I_0(k))^N}\int_\Gamma \prod_{n=1}^N \left( e^{\kappa\cos(\theta_n-\mu)} d\theta_n\right) = \frac{e^{\kappa N\bar{R}\cos(\bar{\theta}-\mu)}}{I_0(\kappa)^N}\left(\frac{1}{(2\pi)^N}\int_\Gamma \prod_{n=1}^N d\theta_n\right)
</math>
 
where ''N'' is the number of measurements and <math>\Gamma\,</math> consists of intervals of <math>2\pi</math> in the variables, subject to the constraint that <math>\bar{R}</math> and <math>\bar{\theta}</math> are constant, where <math>\bar{R}</math> is the mean resultant:
 
:<math>
\bar{R}^2=|\bar{z}|^2= \left(\frac{1}{N}\sum_{n=1}^N \cos(\theta_n) \right)^2 + \left(\frac{1}{N}\sum_{n=1}^N \sin(\theta_n) \right)^2
</math>
 
and <math>\overline{\theta}</math> is the mean angle:
 
:<math>
\overline{\theta}=\mathrm{Arg}(\overline{z}). \,
</math>
 
Note that product term in parentheses is just the distribution of the mean for a [[circular uniform distribution]].<ref name="Jam"/>
 
== Entropy ==
 
The [[Entropy (information theory)|information entropy]] of the Von Mises distribution is defined as:<ref name="Mardia99"/>
 
:<math>H = -\int_\Gamma f(\theta;\mu,\kappa)\,\ln(f(\theta;\mu,\kappa))\,d\theta\,</math>
 
where <math>\Gamma</math> is any interval of length <math>2\pi</math>. The logarithm of the density of the Von Mises distribution is straightforward:
 
:<math>\ln(f(\theta;\mu,\kappa))=-\ln(2\pi I_0(\kappa))+ \kappa \cos(\theta)\,</math>
 
The characteristic function representation for the Von Mises distribution is:
 
:<math>f(\theta;\mu,\kappa) =\frac{1}{2\pi}\left(1+2\sum_{n=1}^\infty\phi_n\cos(n\theta)\right)</math>
 
where <math>\phi_n= I_{|n|}(\kappa)/I_0(\kappa)</math>. Substituting these expressions into the entropy integral, exchanging the order of integration and summation, and using the orthogonality of the cosines, the entropy may be written:
 
:<math>H = \ln(2\pi I_0(\kappa))-\kappa\phi_1 = \ln(2\pi I_0(\kappa))-\kappa\frac{I_1(\kappa)}{I_0(\kappa)}</math>
 
For <math>\kappa=0</math>, the von Mises distribution becomes the [[circular uniform distribution]] and the entropy attains its maximum value of <math>\ln(2\pi)</math>.
 
==See also==
* [[Bivariate von Mises distribution]]
* [[Directional statistics]]
* [[Von Mises–Fisher distribution]]
* [[Kent distribution]]
 
== References ==
<references/>
* Abramowitz, M. and Stegun, I. A.  (ed.), [[Abramowitz and Stegun|Handbook of Mathematical Functions]], National Bureau of Standards, 1964; reprinted Dover Publications, 1965. ISBN 0-486-61272-4
* "Algorithm AS 86: The von Mises Distribution Function", Mardia, Applied Statistics, 24, 1975 (pp.&nbsp;268–272).
* "Algorithm 518, Incomplete Bessel Function I0: The von Mises Distribution", Hill, ACM Transactions on Mathematical Software, Vol. 3, No. 3, September 1977, Pages 279–284.
* Best, D. and Fisher, N. (1979). Efficient simulation of the von Mises distribution. Applied Statistics, 28, 152–157.
* Evans, M., Hastings, N., and Peacock, B., "von Mises Distribution". Ch. 41 in Statistical Distributions, 3rd ed. New York. Wiley 2000.
* Fisher, Nicholas I., Statistical Analysis of Circular Data. New York. Cambridge 1993.
* "Statistical Distributions", 2nd. Edition, Evans, Hastings, and Peacock, John Wiley and Sons, 1993, (chapter 39). ISBN 0-471-55951-2
* {{cite book |title=Statistics of Earth Science Data |last=Borradaile |first=Graham |year=2003 |publisher=Springer |isbn=978-3-540-43603-4 |url=http://books.google.com/books?id=R3GpDglVOSEC&printsec=frontcover&source=gbs_navlinks_s#v=onepage&q=&f=false |accessdate=31 Dec 2009}}
 
{{ProbDistributions|directional}}
 
{{DEFAULTSORT:Von Mises Distribution}}
[[Category:Continuous distributions]]
[[Category:Directional statistics]]
[[Category:Exponential family distributions]]
[[Category:Probability distributions]]

Latest revision as of 15:00, 10 November 2014

Luke is actually a superstar in the generating and also the occupation development to start with next to his luke bryan vip tickets third studio recording, And , may be the evidence. He burst open on the scene in 2002 along with his funny combination of straight down-house convenience, movie star very good seems and lyrics, is defined t in a major way. The latest record Top on the nation graph or chart and #2 on the pop maps, producing it the 2nd top debut at that time of 2005 for the region musician.

The boy of the , understands persistence and dedication are important elements when it comes to a prosperous career- . His initial recording, Stay Me, generated the most notable strikes “All My Buddies “Country and Say” Man,” although his energy, Doin’ Point, located the singer-about three straight No. 9 single men and women: Else Getting in touch with Is really a Fantastic Factor.”

In the slip of 2004, Concert tour: Luke & that had an outstanding selection of , such as Metropolitan. “It’s almost like you’re receiving a authorization to go to a higher level, affirms these designers which were an element of luke bryan concert tickets 2014 the Concert toursover in a larger degree of artists.” It twisted as one of the most successful trips in kid cudi tickets its ten-calendar year historical past.

My web-site; luke bryan tickets on sale dates