Curve fitting: Difference between revisions

From formulasearchengine
Jump to navigation Jump to search
en>Dicklyon
dash fix
en>Billinghurst
Undid revision 596725894 by 24.130.168.37 (talk), Wikipedia:External links are added according to the guidance
Line 1: Line 1:
{{Refimprove|date=December 2009}}
Hi there. My title is Sophia Meagher although it is not the title on my birth certificate. Invoicing is my profession. To climb is something I really enjoy performing. Mississippi is where her home is but her spouse desires them to transfer.<br><br>Here is my website - [http://mogulacademy.org/members/kandikaiser/activity/145827/ love psychic]
In [[physics]] and [[probability theory]], '''mean field theory''' ('''MFT''' also known as '''self-consistent field theory''') studies the behavior of large and complex [[stochastic]] models by studying a simpler model. Such models consider a large number of small interacting individual components which interact with each other. The effect of all the other individuals on any given individual is approximated by a single averaged effect, thus reducing a [[many-body problem]] to a [[one-body problem]].
 
The ideas first appeared in physics in the work of [[Pierre Curie]]<ref>{{cite doi|10.1007/s10955-009-9814-1}}</ref> and [[Pierre Weiss]] to describe [[phase transitions]].<ref>{{cite journal | title = L'hypothèse du champ moléculaire et la propriété ferromagnétique | first = Pierre | last = Weiss | authorlink = Pierre Weiss | journal = J. Phys. Theor. Appl. | volume = 6 | issue = 1 | year= 1907 | pages= 661-690 | url = http://hal.archives-ouvertes.fr/jpa-00241247/en }}</ref>
Approaches inspired by these ideas have seen applications in [[epidemic model]]s,<ref>{{cite doi|10.1109/QEST.2007.8}}</ref> [[queueing theory]],<ref>{{cite doi|10.1007/BF01055703}}</ref> computer network performance and [[mean field game theory|game theory]].<ref>{{cite doi|10.1007/s11537-007-0657-8}}</ref>
 
A [[many-body system]] with interactions is generally very difficult to solve exactly, except for extremely simple cases ([[random field]] theory, 1D [[Ising model]]). The n-body system is replaced by a 1-body problem with a chosen good external field. The external field replaces the interaction of all the other particles to an arbitrary particle.  The great difficulty (e.g. when computing the [[partition function (statistical mechanics)|partition function]] of the system) is the treatment of [[combinatorics]] generated by the interaction terms in the [[Hamiltonian mechanics|Hamiltonian]] when summing over all states. The goal of mean field theory is to resolve these combinatorial problems. MFT is known under a great many names and guises. Similar techniques include [[Bragg–Williams approximation]], models on [[Bethe lattice]], [[Landau theory]], [[Pierre–Weiss approximation]], [[Flory–Huggins solution theory]], and [[Scheutjens–Fleer theory]].
 
The main idea of MFT is to replace all interactions to any one body with an average or effective interaction, sometimes called a ''molecular field''.<ref>{{cite book|last=Chaikin|first=P. M.  |first2=T. C. |last2=Lubensky |title=Principles of condensed matter physics|year=2007|publisher=Cambridge University Press|location=Cambridge|isbn=978-0-521-79450-3|edition=4th print}}</ref>  This reduces any multi-body problem into an effective one-body problem.  The ease of solving MFT problems means that some insight into the behavior of the system can be obtained at a relatively low cost. 
 
In [[Classical field theory|field theory]], the Hamiltonian may be expanded in terms of the magnitude of fluctuations around the mean of the field.  In this context, MFT can be viewed as the "zeroth-order" expansion of the Hamiltonian in fluctuations.  Physically, this means an MFT system has no fluctuations, but this coincides with the idea that one is replacing all interactions with a "mean field".  Quite often, in the formalism of fluctuations, MFT provides a convenient launch-point to studying first or second order fluctuations. 
 
In general, dimensionality plays a strong role in determining whether a mean-field approach will work for any particular problem.  In MFT, many interactions are replaced by one effective interaction.  Then it naturally follows that if the field or particle exhibits many interactions in the original system, MFT will be more accurate for such a system.  This is true in cases of high dimensionality, or when the Hamiltonian includes long-range forces.  The [[Ginzburg criterion]] is the formal expression of how fluctuations render MFT a poor approximation, depending upon the number of spatial dimensions in the system of interest.
 
While MFT arose primarily in the field of [[statistical mechanics]], it has more recently been applied elsewhere, for example in [[inference]], [[graphical models]] theory, neuroscience, and [[artificial intelligence]].
 
==Formal approach==
The formal basis for mean field theory is the [[Helmholtz free energy#Bogoliubov inequality|Bogoliubov inequality]]. This inequality states that the [[thermodynamic free energy|free energy]] of a system with Hamiltonian
 
:<math>\mathcal{H}=\mathcal{H}_{0}+\Delta \mathcal{H}</math>
 
has the following upper bound:
 
:<math>F \leq F_{0} \ \stackrel{\mathrm{def}}{=}\  \langle \mathcal{H} \rangle_{0} -T S_{0}</math>
 
where <math> S_{0}</math> is the [[entropy]] and where the average is taken over the equilibrium ensemble of the reference system with Hamiltonian <math>\mathcal{H}_{0}</math>. In the special case that the reference Hamiltonian is that of a non-interacting system and can thus be written as
 
:<math>\mathcal{H}_{0}=\sum_{i=1}^{N}h_{i}\left( \xi_{i}\right)</math>
 
where <math>\left(\xi_{i}\right) </math> is shorthand for the [[degrees of freedom (physics and chemistry)|degrees of freedom]] of the individual components of our statistical system (atoms, spins and so forth). One can consider sharpening the upper bound by minimizing the right hand side of the inequality. The minimizing reference system is then the "best" approximation to the true system using non-correlated degrees of freedom, and is known as the '''mean field approximation'''.
 
For the most common case that the target Hamiltonian contains only pairwise interactions, ''i.e.,''
 
:<math>\mathcal{H}=\sum_{(i,j)\in \mathcal{P}}V_{i,j}\left( \xi_{i},\xi_{j}\right)</math>
 
where <math>\mathcal{P}</math> is the set of pairs that interact, the minimizing procedure can be carried out formally. Define <math>{\rm Tr}_{i}f(\xi_{i})</math> as the generalized sum of the observable <math>f</math> over the degrees of freedom of the single component (sum for discrete variables, integrals for continuous ones). The approximating free energy is given by
:{|
|-
|<math>F_{0} = \,\!</math>
|<math>{\rm Tr}_{1,2,..,N}\mathcal{H}(\xi_{1},\xi_{2},...,\xi_{N})P^{(N)}_{0}(\xi_{1},\xi_{2},...,\xi_{N})</math>
|-
|
|<math>+kT \,{\rm Tr}_{1,2,..,N}P^{(N)}_{0}(\xi_{1},\xi_{2},...,\xi_{N})\log P^{(N)}_{0}(\xi_{1},\xi_{2},...,\xi_{N})</math>
|}
 
where <math>P^{(N)}_{0}(\xi_{1},\xi_{2},...,\xi_{N})</math> is the probability to find the reference system in the state specified by the variables <math>(\xi_{1},\xi_{2},...,\xi_{N})</math>. This probability is given by the normalized [[Boltzmann factor]]
:<math>P^{(N)}_{0}(\xi_{1},\xi_{2},...,\xi_{N})=\frac{1}{Z^{(N)}_{0}}e^{-\beta \mathcal{H}_{0}(\xi_{1},\xi_{2},...,\xi_{N})}=\prod_{i=1}^{N}\frac{1}{Z_{0}}e^{-\beta h_{i}\left( \xi_{i}\right)}
\ \stackrel{\mathrm{def}}{=}\  \prod_{i=1}^{N} P^{(i)}_{0}(\xi_{i})</math>
where <math> Z_0 </math> is the [[Partition function (statistical mechanics)|partition function]].  Thus
:<math>F_{0}=\sum_{(i,j)\in\mathcal{P}} {\rm Tr}_{i,j}V_{i,j}\left( \xi_{i},\xi_{j}\right)P^{(i)}_{0}(\xi_{i})P^{(j)}_{0}(\xi_{j})+
kT \sum_{i=1}^{N} {\rm Tr}_{i} P^{(i)}_{0}(\xi_{i}) \log P^{(i)}_{0}(\xi_{i}).</math>
In order to minimize we take the derivative with respect to the single degree-of-freedom probabilities <math>P^{(i)}_{0}</math> using a [[Lagrange multiplier]] to ensure proper normalization. The end result is the set of self-consistency equations
:<math>P^{(i)}_{0}(\xi_{i})=\frac{1}{Z_{0}}e^{-\beta h_{i}^{MF}(\xi_{i})}\qquad i=1,2,..,N</math>
where the mean field is given by
:<math>h_{i}^{MF}(\xi_{i})=\sum_{\{j|(i,j)\in\mathcal{P}\}} {\rm Tr}_{j}V_{i,j}\left( \xi_{i},\xi_{j}\right)P^{(j)}_{0}(\xi_{j}).</math>
 
==Applications==
Mean field theory can be applied to a number of physical systems so as to study phenomena such as [[phase transitions]].<ref name=Stanley>{{cite book |title=Introduction to phase transitions and critical phenomena |author=HE Stanley|publisher=Oxford University Press|chapter=Mean field theory of magnetic phase transitions |isbn=0-19-505316-8 |year=1971 }}
 
</ref>
 
===Ising Model===
Consider the [[Ising model]] on an ''N''-dimensional cubic lattice. The Hamiltonian is given by
:<math> H = -J \sum_{\langle i,j\rangle} s_i s_{j}  - h \sum_i s_i</math>
where the <math> \sum_{\langle i,j\rangle} </math> indicates summation over the pair of nearest neighbors <math>\langle i,j\rangle </math>, and <math>s_i = \pm 1 </math>
and <math>s_j</math> are neighboring Ising spins.
 
Let us transform our spin variable by introducing the fluctuation from its mean value <math> m_i \equiv \langle s_i\rangle </math>.
We may rewrite the Hamiltonian:
 
:<math> H = -J \sum_{\langle i,j \rangle} (m_i + \delta s_i ) (m_j + \delta s_j)  - h \sum_i s_i</math>
 
where we define <math> \delta s_i \equiv  s_i - m_i </math>; this is the ''fluctuation'' of the spin.
If we expand the right hand side, we obtain one term that is entirely dependent on the mean values of the spins, and independent of the spin configurations.  This is the trivial term, which does not affect the [[partition function (statistical mechanics)|partition function]] of the system.  The next term is the one involving the product of the
mean value of the spin and the fluctuation value.  Finally, the last term involves a product of two fluctuation values. 
 
The mean-field approximation consists in neglecting this second order fluctuation term. These fluctuations are enhanced at low dimensions, making MFT a better approximation for high dimensions.
 
:<math> H \approx H^{MF} \equiv -J \sum_{\langle i,j \rangle} (m_i m_j +m_i \delta s_j + m_j \delta s_i ) - h \sum_i s_i</math>
 
Again, the summand can be reexpanded. In addition, we expect that the mean value of each spin is site-independent, since the Ising chain is translationally invariant. This yields
 
:<math> H^{MF} = -J \sum_{\langle i,j \rangle} \left( m^2 + 2m(s_i-m) \right) - h \sum_i s_i</math>
 
The summation over neighboring spins can be rewritten as <math> \sum_{\langle i,j\rangle} = \frac{1}{2} \sum_i \sum_{j\in nn(i)}</math> where <math>nn(i)</math> means 'nearest-neighbor of <math>i</math>' and the <math>1/2</math> prefactor avoids double-counting, since each bond participates in two spins. Simplifying leads to the final expression
:<math> H^{MF}= \frac{J m^2 N z}{2}- \underbrace{(h+m J z)}_{h^{eff}} \sum_i s_i </math>
 
where <math>z</math> is the [[coordination number]]. At this point, the Ising Hamiltonian has been ''decoupled'' into a sum of one-body Hamiltonians with an ''effective mean-field'' <math>h^{eff}=h+J z m</math> which is the sum of the external field <math>h</math> and of the ''mean-field'' induced by the neighboring spins. It is worth noting that this mean field directly depends on the number of nearest neighbors and thus on the dimension of the system (for instance, for a hypercubic lattice of dimension <math> d</math>, <math> z = 2 d</math>).
 
Substituting this Hamiltonian into the partition function, and solving the effective 1D problem, we obtain
 
:<math> Z = e^{-\beta J m^2 N z /2} \left[2 \cosh\left(\frac{h+m J z}{k_BT} \right)\right]^{N} </math>
 
where <math> N </math> is the number of lattice sites.  This is a closed and exact expression for the partition function of the system.  We may obtain the free energy of the system, and calculate [[critical exponent]]s. In particular, we can obtain the magnetization <math>m</math> as a function of <math>h^{eff}</math>.
 
We thus have two equations between <math>m</math> and <math>h^{eff}</math>, allowing us to determine <math>m</math> as a function of temperature. This leads to the following observation:
* for temperatures greater than a certain value <math>T_c</math>, the only solution is <math>m=0</math>. The system is paramagnetic.
* for <math>T<T_c</math>, there are two non-zero solutions: <math> m = \pm m_0 </math>. The system is ferromagnetic.
 
<math>T_c</math> is given by the following relation: <math> T_c = \frac{J z}{k_B} </math>.
This shows that MFT can account for the ferromagnetic phase transition.
 
===Application to other systems===
Similarly, MFT can be applied to other types of Hamiltonian to study the metal-[[superconductor]] transition. In this case, the analog of the magnetization is the superconducting gap <math>\Delta</math>. Another example is the molecular field of a [[liquid crystal]] that emerges when the [[Laplacian]] of the director field is non-zero.
 
==Extension to Time-Dependent Mean Fields==
{{Main|Dynamical Mean Field Theory}}
 
In mean-field theory, the mean field appearing in the single-site problem is a scalar or vectorial time-independent quantity. However, this need not always be the case: in a variant of mean-field theory called [[Dynamical Mean Field Theory]] (DMFT), the mean-field becomes a time-dependent quantity. For instance, DMFT can be applied to the [[Hubbard model]] to study the metal-Mott insulator transition.
 
==See also==
*[[Dynamical Mean Field Theory]]
*[[Mean field game theory]]
* [[Generalized Epidemic Mean-Field Model]]
 
==References==
<references/>
 
{{DEFAULTSORT:Mean Field Theory}}
[[Category:Statistical mechanics]]
[[Category:Concepts in physics]]

Revision as of 05:15, 23 February 2014

Hi there. My title is Sophia Meagher although it is not the title on my birth certificate. Invoicing is my profession. To climb is something I really enjoy performing. Mississippi is where her home is but her spouse desires them to transfer.

Here is my website - love psychic