|
|
| Line 1: |
Line 1: |
| {{For|the recurrence relation|Logistic map}}
| | She is recognized by the name of Myrtle Shryock. For a whilst I've been in South Dakota and my parents reside close by. One of the things he enjoys most is ice skating but he is struggling to discover time for it. Hiring is his profession.<br><br>Feel free to surf to my web-site ... std testing at home ([http://facehack.ir/index.php?do=/profile-110/info/ click through the next article]) |
| [[File:Logistic-curve.svg|thumb|320px|right|Standard logistic sigmoid function]]
| |
| | |
| A '''logistic function''' or '''logistic curve''' is a common [[sigmoid function]], given its name (in reference to its S-shape) in 1844 or 1845 by [[Pierre François Verhulst]] who studied it in relation to population growth. A [[generalized logistic curve]] can model the "S-shaped" behaviour (abbreviated S-curve) of growth of some population ''P''. The initial stage of growth is approximately [[exponential growth|exponential]]; then, as saturation begins, the growth slows, and at maturity, growth stops.
| |
| | |
| The logistic function is the [[sigmoid curve]] with equation:
| |
| | |
| <!-- :<math>f(x) = \frac{1}{1 + \mathrm e^{-x}} \! </math> -->
| |
| :<math>f(x) = \frac{1}{1 + \mathrm e^{-x}} </math>
| |
| | |
| where ''e'' is [[Euler's number]].<ref>{{cite journal|first= Pierre-François |last=Verhulst |year= 1838| title = Notice sur la loi que la population poursuit dans son accroissement | journal = Correspondance mathématique et physique |volume = 10| pages = 113–121 |
| |
| url = http://books.google.com/?id=8GsEAAAAYAAJ&q=
| |
| | format = PDF| accessdate = 09/08/2009}}</ref> For values of ''x'' in the range of [[real number]]s from −∞ to +∞, the S-curve shown is obtained. In practice, due to the nature of the [[exponential function]] ''e''<sup>−''x''</sup>, it is often sufficient to compute ''x'' over a small range of real numbers such as [−6, +6].
| |
| | |
| The logistic function finds applications in a range of fields, including [[artificial neural network]]s, [[biology]], [[biomathematics]], [[demography]], [[economics]], [[chemistry]], [[mathematical psychology]], [[probability]], [[sociology]], [[political science]], and [[statistics]]. It has an easily calculated derivative:
| |
| | |
| : <math>\frac{d}{dx}f(x) = f(x)\cdot(1-f(x)).\,</math>
| |
| | |
| It also has the property that
| |
| | |
| : <math>1-f(x) = f(-x).\,</math>
| |
| | |
| Thus, the function <math>x \mapsto f(x) - 1/2</math> is [[Even and odd functions#Odd functions|odd]].
| |
| | |
| == Logistic differential equation ==
| |
| The logistic function is the solution of the simple first-order non-linear [[differential equation]]
| |
| | |
| :<math>\frac{d}{dx}f(x) = f(x)(1-f(x)) </math>
| |
| | |
| with [[boundary condition]] ''f''(0) = 1/2. This equation is the continuous version of the [[logistic map]].
| |
| | |
| The qualitative behavior is easily understood in terms of the [[phase line (mathematics)|phase line]]: the derivative is null when function is unit and the derivative is positive for ''f'' between 0 and 1, and negative for ''f'' above 1 or less than 0 (though negative populations do not generally accord with a physical model). This yields an unstable equilibrium at 0, and a stable equilibrium at 1, and thus for any function value greater than zero and less than unit, it grows to unit.
| |
| | |
| One may readily find the (symbolic) solution to be | |
| | |
| :<math>f(x)=\frac{e^{x}}{e^{x}+e^{x_0}}</math>
| |
| | |
| Choosing the constant of integration ''e''<sup>''x0''</sup> = 1 gives the other well-known form of the definition of the logistic curve
| |
| | |
| :<math>f(x) = \frac{e^x}{e^x + 1} \! = \frac{1}{1 + e^{-x}} \! </math>
| |
| | |
| More quantitatively, as can be seen from the analytical solution, the logistic curve shows early [[exponential growth]] for negative argument, which slows to linear growth of slope 1/4 for an argument near zero, then approaches one with an exponentially decaying gap.
| |
| | |
| The logistic function is the inverse of the natural [[logit]] function and so can be used to convert the logarithm of [[odds]] into a [[probability]]; the conversion from the [[log-likelihood ratio]] of two alternatives also takes the form of a logistic curve.
| |
| | |
| The logistic sigmoid function is related to the [[hyperbolic tangent]], A.p. by
| |
| | |
| :<math>2 \, f(x) = 1 + \tanh \left( \frac{x}{2} \right).</math>
| |
| | |
| ==In ecology: modeling population growth==
| |
| [[File:Pierre Francois Verhulst.jpg|right|thumb|150px|Pierre-François Verhulst (1804–1849)]]
| |
| A typical application of the logistic equation is a common model of [[population growth]], originally due to [[Pierre François Verhulst|Pierre-François Verhulst]] in 1838, where the rate of reproduction is proportional to both the existing population and the amount of available resources, all else being equal. The Verhulst equation was published after Verhulst had read [[Thomas Malthus]]' ''[[An Essay on the Principle of Population]]''. Verhulst derived his logistic equation to describe the self-limiting growth of a [[biology|biological]] population. The equation is also sometimes called the ''Verhulst-Pearl equation'' following its rediscovery in 1920. [[Alfred J. Lotka]] derived the equation again in 1925, calling it the ''law of population growth''.
| |
| | |
| Letting ''P'' represent population size (''N'' is often used in ecology instead) and ''t'' represent time, this model is formalized by the [[differential equation]]:
| |
| | |
| : <math>\frac{dP}{dt}=rP\left(1 - \frac{P}{K}\right)</math>
| |
| | |
| where the constant ''r'' defines the growth rate and ''K'' is the [[carrying capacity]].
| |
| | |
| In the equation, the early, unimpeded growth rate is modeled by the first term +''rP''. The value of the rate ''r'' represents the proportional increase of the population ''P'' in one unit of time. Later, as the population grows, the second term, which multiplied out is −''rP''<sup>2</sup>''/K'', becomes larger than the first as some members of the population ''P'' interfere with each other by competing for some critical resource, such as food or living space. This antagonistic effect is called the ''bottleneck'', and is modeled by the value of the parameter ''K''. The competition diminishes the combined growth rate, until the value of ''P'' ceases to grow (this is called ''maturity'' of the population).
| |
| | |
| Dividing both sides of the equation by ''K'' gives
| |
| | |
| : <math>\frac{d}{dt}\frac{P}{K}=r\frac{P}{K}\left(1 - \frac{P}{K}\right)</math>
| |
| | |
| Now setting <math>x=P/K</math> gives the differential equation
| |
| | |
| : <math>\frac{dx}{dt} = r x (1-x)</math>
| |
| | |
| For <math>r = 1</math> we have the particular case with which we started.
| |
| | |
| In [[ecology]], [[species]] are sometimes referred to as [[r/K selection theory|r-strategist or K-strategist]] depending upon the [[natural selection|selective]] processes that have shaped their [[Biological life cycle|life history]] strategies. The solution to the equation (with <math>P_0</math> being the initial population) is
| |
| | |
| :<math>P(t) = \frac{K P_0 e^{rt}}{K + P_0 \left( e^{rt} - 1\right)} </math>
| |
| | |
| where
| |
| | |
| :<math>\lim_{t\to\infty} P(t) = K.\,</math>
| |
| | |
| Which is to say that ''K'' is the limiting value of ''P'': the highest value that the population can reach given infinite time (or come close to reaching in finite time). It is important to stress that the carrying capacity is asymptotically reached independently of the initial value ''P''(0) > 0, also in case that ''P''(0) > ''K''.
| |
| | |
| === Time-varying carrying capacity ===
| |
| Since the environmental conditions influence the carrying capacity, as a consequence it can be time-varying: ''K''(''t'') > 0, leading to the following mathematical model:
| |
| | |
| : <math>\frac{dP}{dt}=rP\left(1 - \frac{P}{K(t)}\right)</math>
| |
| | |
| A particularly important case is that of carrying capacity that varies periodically with period ''T'':
| |
| | |
| : <math>K(t+T) = K(t).\,</math>
| |
| | |
| It can be shown that in such a case, independently from the initial value ''P''(0) > 0, ''P''(''t'') will tend to a unique periodic solution ''P''<sub>*</sub>(''t''), whose period is ''T''.
| |
| | |
| A typical value of ''T'' is one year: in such case ''K''(''t'') reflects periodical variations of weather conditions.
| |
| | |
| Another interesting generalization is to consider that the carrying capacity K(t) is a function of the population
| |
| at an earlier time, capturing a delay in the way population modifies its environment. This leads to a logistic
| |
| delay equation,<ref name="delay carrying">{{cite doi|10.1016/j.physd.2009.05.011}}</ref> which has a very rich behavior, with bistability in some parameter range, as well as a monotonic decay to zero, smooth exponential growth, punctuated unlimited growth (i.e., multiple S-shapes), punctuated growth or alternation to a stationary level, oscillatory approach to a stationary level, sustainable oscillations, finite-time singularities as well as finite-time death.
| |
| | |
| == In statistics and machine learning ==
| |
| | |
| === Logistic regression ===
| |
| | |
| Logistic functions are used in several roles in [[statistics]]. Firstly, they are the [[cumulative distribution function]] of the [[logistic distribution|logistic family of distributions]]. Secondly they are used in [[logistic regression]] to model how the probability ''p'' of an event may be affected by one or more [[explanatory variables]]: an example would be to have the model
| |
| | |
| : <math>p=P(a + bx)\,</math>
| |
| | |
| where ''x'' is the explanatory variable and ''a'' and ''b'' are model parameters to be fitted.
| |
| | |
| An important application of the logistic function is in the [[Rasch model]], used in [[item response theory]]. In particular, the Rasch model forms a basis for [[maximum likelihood]] estimation of the locations of objects or persons on a [[Continuum (theory)|continuum]], based on collections of categorical data, for example the abilities of persons on a continuum based on responses that have been categorized as correct and incorrect.
| |
| | |
| Logistic regression and other [[log-linear model]]s are also commonly used in [[machine learning]].
| |
| | |
| === Neural networks ===
| |
| | |
| Logistic functions are often used in [[neural network]]s to introduce [[nonlinearity]] in the model and/or to [[clamp meter|clamp]] signals to within a specified [[Range (mathematics)|range]]. A popular [[artificial neuron|neural net element]] computes a [[linear combination]] of its input signals, and applies a bounded logistic function to the result; this model can be seen as a "smoothed" variant of the classical [[perceptron|threshold neuron]].
| |
| | |
| <!-- A reason for its popularity in neural networks is because the logistic function satisfies the differential equation
| |
| | |
| :<math>y' = y(1-y).\,</math>
| |
| | |
| The right hand side is a low-degree polynomial. Furthermore, the polynomial has factors ''y'' and 1 − ''y'', both of which are simple to compute. Given ''y'' = sig(''t'') at a particular ''t'', the derivative of the logistic function at that ''t'' can be obtained by multiplying the two factors together. -->
| |
| A common choice for the activation or "squashing" functions, used to clip for large magnitudes to keep the response of the neural network bounded<ref name="Gershenfeld-1999">Gershenfeld 1999, p.150</ref> is
| |
| | |
| :<math>g(h) = \frac{1}{1 + e^{-2 \beta h}} \! </math>
| |
| | |
| which is a logistic function.
| |
| These relationships result in simplified implementations of [[artificial neural network]]s with [[artificial neuron]]s. Practitioners caution that sigmoidal functions which are [[antisymmetric]] about the origin (e.g. the [[hyperbolic tangent]]) lead to faster convergence when training networks with [[backpropagation]].<ref name="LeCun-1998">
| |
| {{Cite book
| |
| | author1 = LeCun, Y.
| |
| | author2 = Bottou, L.
| |
| | author3 = Orr, G.
| |
| | author4 = Muller, K.
| |
| | editor = Orr, G.
| |
| | editor2 = Muller, K.
| |
| | year = 1998
| |
| | title = Efficient BackProp
| |
| | work = Neural Networks: Tricks of the trade
| |
| | isbn = 3-540-65311-2
| |
| | publisher = Springer
| |
| | url = http://yann.lecun.com/exdb/publis/pdf/lecun-98b.pdf
| |
| | postscript = <!--None-->
| |
| }}
| |
| </ref>
| |
| | |
| A generalisation and extension of the logistic function to multiple inputs is the [[softmax activation function]].
| |
| | |
| == In medicine: modeling of growth of tumors ==
| |
| {{see also|Gompertz curve#Growth of tumors}}
| |
| Another application of logistic curve is in medicine, where the logistic differential equation is used to model the growth of tumors. This application can be considered an extension of the above mentioned use in the framework of ecology (see also the [[Generalized logistic curve]], allowing for more parameters). Denoting with ''X''(''t'') the size of the tumor at time ''t'', its dynamics are governed by:
| |
| | |
| : <math>X^{\prime}=r\left(1 - \frac{X}{K}\right)X</math>
| |
| | |
| which is of the type:
| |
| | |
| :<math>X^{\prime}=F\left(X\right)X, F^{\prime}(X) \le 0 </math>
| |
| | |
| where ''F''(''X'') is the proliferation rate of the tumor.
| |
| | |
| If a chemotherapy is started with a log-kill effect, the equation may be revised to be
| |
| | |
| :<math>X^{\prime}=r\left(1 - \frac{X}{K}\right)X - c(t)X, </math>
| |
| | |
| where ''c''(''t'') is the therapy-induced death rate. In the idealized case of very long therapy, ''c''(''t'') can be modeled as a periodic function (of period ''T'') or (in case of continuous infusion therapy) as a constant function, and one has that
| |
| | |
| :<math> \frac{1}{T}\int_{0}^{T}{c(t)\, dt} > r \rightarrow \lim_{t \rightarrow +\infty}x(t)=0 </math>
| |
| | |
| i.e. if the average therapy-induced death rate is greater than the baseline proliferation rate then there is the eradication of the disease. Of course, this is an oversimplified model of both the growth and the therapy (e.g. it does not take into account the phenomenon of clonal resistance).
| |
| | |
| == In chemistry: reaction models ==
| |
| The concentration of reactants and products in [[autocatalysis|autocatalytic reactions]] follow the logistic function.
| |
| | |
| == In physics: Fermi distribution ==
| |
| The logistic function determines the statistical distribution of fermions over the energy states of a system in thermal equilibrium. In particular, it is the distribution of the probabilities that each possible energy level is occupied by a fermion, according to [[Fermi function|Fermi–Dirac statistics]].
| |
| | |
| == In linguistics: language change ==
| |
| In linguistics, the logistic function can be used to model [[language change]]:<ref name="probabilistic linguistics">Bod, Hay, Jennedy (eds.) 2003, pp. 147–156</ref> an innovation that is at first marginal begins to spread more quickly with time, and then more slowly as it becomes more universally adopted.
| |
| | |
| ==In economics: diffusion of innovations==
| |
| The logistic function can be used to illustrate the progress of the [[Diffusion of innovations|diffusion of an innovation]] through its life cycle. Historically, when new products are introduced there is an intense amount of research and development which leads to dramatic improvements in quality and reductions in cost. This leads to a period of rapid industry growth. Some of the more famous examples are: railroads, incandescent light bulbs, [[electrification]], the [[Ford Model T]], air travel and computers.
| |
| Eventually, dramatic improvement and cost reduction opportunities are exhausted, the product or process are in widespread use with few remaining potential new customers, and markets become saturated.
| |
| | |
| Logistic analysis was used in papers by several researchers at the International Institute of Applied Systems Analysis ([[IIASA]]). These papers deal with the diffusion of various innovations, infrastructures and energy source substitutions and the role of work in the economy as well as with the long economic cycle. Long economic cycles were investigated by Robert Ayres (1989).<ref>{{Cite journal
| |
| | last1 = Ayres
| |
| | first1 = Robert
| |
| | author1-link = Robert Ayres (scientist)
| |
| | title =Technological Transformations and Long Waves
| |
| | year = 1989
| |
| | url = http://www.iiasa.ac.at/Admin/PUB/Documents/RR-89-001.pdf
| |
| | postscript = <!--None-->}}
| |
| </ref> Cesare Marchetti published on [[Kondratiev wave|long economic cycles]] and on diffusion of innovations.<ref>{{Cite journal
| |
| | last1 = Marchetti
| |
| | first1 = Cesare
| |
| | title = Pervasive Long Waves: Is Society Cyclotymic
| |
| | year = 1996
| |
| | url = http://www.agci.org/dB/PDFs/03S2_CMarchetti_Cyclotymic.pdf
| |
| | postscript = <!--None-->
| |
| }}
| |
| </ref><ref>{{Cite journal
| |
| | last1 = Marchetti
| |
| | first1 = Cesare
| |
| | title = Kondratiev Revisited-After One Cycle
| |
| | year = 1988
| |
| | url = http://www.cesaremarchetti.org/archive/scan/MARCHETTI-037.pdf
| |
| | postscript = <!--None-->
| |
| }}</ref> Arnulf Grübler’s book (1990) gives a detailed account of the diffusion of infrastructures including canals, railroads, highways and airlines, showing that their diffusion followed logistic shaped curves.<ref name="Grubler1990">{{Cite book
| |
| | last1 = Grübler
| |
| | first1 = Arnulf
| |
| | author1-link =
| |
| | title = The Rise and Fall of Infrastructures: Dynamics of Evolution and Technological Change in Transport
| |
| | year = 1990
| |
| |publisher=Physica-Verlag
| |
| |location= Heidelberg and New York
| |
| |isbn=
| |
| |pages=
| |
| | url = http://www.iiasa.ac.at/Admin/PUB/Documents/XB-90-704.pdf
| |
| | postscript = <!--None-->
| |
| }}</ref>
| |
| | |
| Carlota Perez used a logistic curve to illustrate the long ([[Kondratiev wave|Kondratiev]]) business cycle with the following labels: beginning of a technological era as ''irruption'', the ascent as ''frenzy'', the rapid build out as ''synergy'' and the completion as ''maturity''.<ref name="Perez2002">{{cite book |title= Technological Revolutions and Financial Capital: The Dynamics of Bubbles and Golden Ages
| |
| |last1=Perez
| |
| |first1= Carlota
| |
| |coauthors= |year=2002 |publisher= Edward Elgar Publishing Limited |location=UK |isbn=1-84376-331-1 |pages= |url= }}</ref>
| |
| | |
| ==In design in nature: spreading and collecting flows==
| |
| | |
| The logistic S-shaped history of areas and volumes filled by spreading or collecting flows was predicted based on the [[Constructal law]] of design and evolution in nature.<ref>{{cite journal|last=Bejan|first=Adrian|coauthors=Lorente, S.|title=The constructal law origin of the logistics S curve|journal=Journal of Applied Physics|year=2011|volume=110|issue=024901}}</ref><ref>{{cite journal|last=Bejan|first=Adrian|coauthors=Lorente, S|title=The physics of spreading ideas|journal=International Journal of Heat and Mass Transfer|year=2012|volume= 55|pages=802–807}}</ref> The natural phenomenon of S-curves everywhere is the universal tendency of natural flow systems (animate or inanimate) to morph and to generate designs that flow more easily and offer greater access over time.
| |
| | |
| ==Double logistic function==
| |
| [[File:dsigmoid.png|200px|right|thumb|Double logistic sigmoid curve]]
| |
| | |
| The double logistic is a function similar to the logistic function with numerous applications {{Citation needed|date=March 2012}}. Its general formula is:
| |
| | |
| :<math> f(x) = \mathrm{sgn}(x-d) \, \Bigg(1-\exp\bigg(-\bigg(\frac{x-d}{s}\bigg)^2\bigg)\Bigg), </math>
| |
| | |
| where ''d'' is its centre and ''s'' is the steepness factor. Here "sgn" represents the [[sign function]].
| |
| | |
| It is based on the [[Gaussian curve]] and graphically it is similar to two identical logistic sigmoids bonded together at the point ''x'' = ''d''.
| |
| | |
| One of its applications is non-linear [[Normalization (statistics)|normalization]] of a sample, as it has the property of eliminating [[outlier]]s.
| |
| | |
| == See also ==
| |
| <div style="-moz-column-count:2; column-count:2;">
| |
| * [[Constructal law]]
| |
| * [[Diffusion of innovations]]
| |
| * [[Generalised logistic curve]]
| |
| * [[Gompertz curve]]
| |
| * [[Heaviside step function]]
| |
| * [[Hubbert curve]]
| |
| * [[Logistic distribution]]
| |
| * [[Logistic map]]
| |
| * [[Logistic regression]]
| |
| * [[Star model|Logistic smooth-transmission model]]
| |
| * [[Logit]]
| |
| * [[Log-likelihood ratio]]
| |
| * [[Malthusian growth model]]
| |
| * [[r/K selection theory]]
| |
| * [[Shifted Gompertz distribution]]
| |
| * [[Tipping point (sociology)]]</div>
| |
| | |
| == Notes ==
| |
| {{Reflist|2}}
| |
| | |
| == References ==
| |
| <div class='references-normal'>
| |
| <ol type="1">
| |
| <li>
| |
| {{cite book
| |
| | author = Jannedy, Stefanie; Bod, Rens; Hay, Jennifer
| |
| | year = 2003
| |
| | title =Probabilistic Linguistics
| |
| | isbn = 0-262-52338-8
| |
| | publisher = MIT Press
| |
| | location = Cambridge, Massachusetts
| |
| }}</li>
| |
| <li>
| |
| {{cite book
| |
| | author = Gershenfeld, Neil A.
| |
| | year = 1999
| |
| | title =The Nature of Mathematical Modeling
| |
| | isbn = 978-0-521-57095-4
| |
| | publisher = Cambridge University Press
| |
| | location = Cambridge, UK
| |
| | oclc =
| |
| }}</li>
| |
| <li>
| |
| {{cite book
| |
| | author = Kingsland, Sharon E.
| |
| | title = Modeling nature: episodes in the history of population ecology
| |
| | publisher = University of Chicago Press
| |
| | location = Chicago
| |
| | year = 1995
| |
| | pages =
| |
| | isbn = 0-226-43728-0
| |
| | oclc =
| |
| | doi =
| |
| | accessdate =
| |
| }}</li>
| |
| <li>
| |
| {{MathWorld |title=Logistic Equation |urlname=LogisticEquation}}
| |
| </li>
| |
| <references/>
| |
| </div>
| |
| | |
| == External links ==
| |
| * L.J. Linacre, [http://rasch.org/rmt/rmt64k.htm Why logistic ogive and not autocatalytic curve?], accessed 2009-09-12.
| |
| * http://luna.cas.usf.edu/~mbrannic/files/regression/Logistic.html
| |
| * [http://8020world.com/jcmendez/2007/04/business/modeling-market-adoption-in-excel-with-a-simplified-s-curve Modeling Market Adoption in Excel with a simplified s-curve]
| |
| * {{MathWorld |title=Sigmoid Function |urlname= SigmoidFunction}}
| |
| * [http://jsxgraph.uni-bayreuth.de/wiki/index.php/Logistic_process Online experiments with JSXGraph]
| |
| * [http://www.sciencedaily.com/releases/2011/07/110720151541.htm Esses are everywhere.]
| |
| * [http://www.sciencecodex.com/seeing_the_scurve_in_everything Seeing the s-curve is everything.]
| |
| | |
| {{DEFAULTSORT:Logistic Function}}
| |
| [[Category:Special functions]]
| |
| [[Category:Differential equations]]
| |
| [[Category:Population]]
| |
| [[Category:Demography]]
| |
| [[Category:Curves]]
| |
| [[Category:Population ecology]]
| |