Linear regression: Difference between revisions
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
{{distinguish|linear model of innovation}} | |||
{{merge|Linear predictor function|discuss=Talk:Linear predictor function#Proposed merge with Linear model|date=January 2014}} | |||
In [[statistics]], the term '''linear model''' is used in different ways according to the context. The most common occurrence is in connection with regression models and the term is often taken as synonymous with [[linear regression]] model. However, the term is also used in [[time series analysis]] with a different meaning. In each case, the designation "linear" is used to identify a subclass of models for which substantial reduction in the complexity of the related [[statistical theory]] is possible. | |||
==Linear regression models== | |||
For the regression case, the [[statistical model]] is as follows. Given a (random) sample <math> (Y_i, X_{i1}, \ldots, X_{ip}), \, i = 1, \ldots, n </math> the relation between the observations ''Y<sub>i</sub>'' and the [[independent variables]] ''X<sub>ij</sub>'' is formulated as | |||
:<math>Y_i = \beta_0 + \beta_1 \phi_1(X_{i1}) + \cdots + \beta_p \phi_p(X_{ip}) + \varepsilon_i \qquad i = 1, \ldots, n </math> | |||
where <math> \phi_1, \ldots, \phi_p </math> may be nonlinear functions. In the above, the quantities ''ε<sub>i</sub>'' are random variables representing errors in the relationship. The "linear" part of the designation relates to the appearance of the [[regression coefficient]]s, ''β<sub>j</sub>'' in a linear way in the above relationship. Alternatively, one may say that the predicted values corresponding to the above model, namely | |||
:<math>\hat{Y}_i = \beta_0 + \beta_1 \phi_1(X_{i1}) + \cdots + \beta_p \phi_p(X_{ip}) \qquad (i = 1, \ldots, n), </math> | |||
are linear functions of the ''β<sub>j</sub>''. | |||
Given that estimation is undertaken on the basis of a [[least squares]] analysis, estimates of the unknown parameters ''β<sub>j</sub>'' are determined by minimising a sum of squares function | |||
:<math>S = \sum_{i = 1}^n \left(Y_i - \beta_0 - \beta_1 \phi_1(X_{i1}) - \cdots - \beta_p \phi_p(X_{ip})\right)^2 .</math> | |||
From this, it can readily be seen that the "linear" aspect of the model means the following: | |||
:*the function to be minimised is a quadratic function of the ''β<sub>j</sub>'' for which minimisation is a relatively simple problem; | |||
:*the derivatives of the function are linear functions of the ''β<sub>j</sub>'' making it easy to find the minimising values; | |||
:*the minimising values ''β<sub>j</sub>'' are linear functions of the observations ''Y<sub>i</sub>''; | |||
:*the minimising values ''β<sub>j</sub>'' are linear functions of the random errors ''ε<sub>i</sub>'' which makes it relatively easy to determine the statistical properties of the estimated values of ''β<sub>j</sub>''. | |||
==Time series models== | |||
An example of a linear time series model is an [[autoregressive moving average model]]. Here the model for values {''X<sub>t</sub>''} in a time series can be written in the form | |||
:<math> X_t = c + \varepsilon_t + \sum_{i=1}^p \varphi_i X_{t-i} + \sum_{i=1}^q \theta_i \varepsilon_{t-i}.\,</math> | |||
where again the quantities ''ε<sub>t</sub>'' are random variables representing [[Innovation (signal processing)|innovations]] which are new random effects that appear at a certain time but also affect values of ''X'' at later times. In this instance the use of the term "linear model" refers to the structure of the above relationship in representing ''X<sub>t</sub>'' as a linear function of past values of the same time series and of current and past values of the innovations.<ref>Priestley, M.B. (1988) ''Non-linear and Non-stationary time series analysis'', Academic Press. ISBN 0-12-564911-8</ref> This particular aspect of the structure means that it is relative simple to derive relations for the mean and [[covariance]] properties of the time series. Note that here the "linear" part of the term "linear model" is not referring to the coefficients ''φ<sub>i</sub>'' and ''θ<sub>i</sub>'', as it would be in the case of a regression model, which looks structurally similar. | |||
==Other uses in statistics== | |||
There are some other instances where "nonlinear model" is used to contrast with a linearly structured model, although the term "linear model" is not usually applied. One example of this is [[nonlinear dimensionality reduction]]. | |||
==See also== | |||
* [[General linear model]] | |||
* [[Linear system]] | |||
* [[Statistical model]] | |||
==References== | |||
<references/> | |||
{{Statistics}} | |||
[[Category:Statistical models]] | |||
[[Category:Time series models]] | |||
[[Category:Regression analysis]] | |||
[[Category:Statistical terminology]] | |||
[[ar:نموذج الانحدار الخطي]] | |||
[[de:Lineares Modell]] | |||
[[fr:Modèle linéaire]] | |||
Revision as of 00:57, 29 January 2014
2011 Acura TSX Sport Wagon-There are just some of us all around who would never drive an suv or a minivan but need something practical for family duties. The Acura TSX is one in all my favorite cars in sedan form but I felt that the wagon deserved special mention for bringing luxury, style, class and driving fun into the family transportation segment.
When my hubby brought this finding to the eye of the Ft. Wayne Indiana Toyota dealer, i was told that they would look into the matter. After wasting 7 days before actually doing everything to change this lease, i was told exercises, diet tips too newer. The salesman never offered us this wonderful deal, and the sales manager told us their dealership gave us the best deal toyota tundra off road they would probably. In the same sentence the sales team leader told us we qualified for the cheaper offer. In all honesty they didn't give us the cheapest price they can have. They gave us the highest lease price we were willing with regard to. My credit score is excellent, but it wouldn't have designed a difference for this dealership. After we had shopped around precisely what you want our lease, we might have definitely got a new better deal.
Now, Certain understand why Toyota doesn't offer the SE with rear seat DVD entertainment since most parents discovered that to be an indispensible feature nowadays. Besides that toyota tundra tuning the 3.5 liter V6 emits a lion-like and throaty roar under heavy acceleration that your call don't expect from a clever minivan. Do note I did not have a chance to drive a car the 2011 Honda Odyssey yet when I had the outcome might happen to different. We'll see this year.
Brian Ickler will make his begin of 2011 in the Kyle Busch Motorsports #18 Dollar General Toyota Tundra at Texas Motor Speedway on Friday, June 10. The WinStar World Casino 400K is being run when partnered with the IZOD IndyCar Series Twin 275s on Saturday, June eleventh.
The level came when he was a college junior. He'd just won the co-angler division for this 1994 Bassmaster Top 100 on Lake Norman. Diet plans . only or even bass tournament he'd ever entered.
16-year-old Erik Jones brought home his second top finish because many races in the absolutely no. 51 SUV for Kyle Busch Motorsports, finishing ninth in Sunday's NC Education Lottery 200 at Rockingham Speedway. Jones started at the tail-end belonging to the field in 36th, dropping a lap early along. The "lucky dog" award put him back with the lead lap, and Jones climbed in the top 10 in morrison a pardon stages belonging to the 200-lap race, which was won by Kyle Larson.
Another disadvantage in the Platinum package continually that it adds more chrome trim with regard to an exterior overburdened with it and forces Toyota to stoop a new low no Japanese truck maker has ever gotten to. Yes, the Tundra Platinum comes standard with chrome wheels. They are as tacky just like the optional Red Rock Leather (that really looks orange) and the cheesy half wood/half leather steering interior.
Then either the CrewMax Limited Platinum Package which pulls out all of the stops with vented and heated seats, wood grain style trim and a sunroof. Three cab sizes can be had - regular, double and CrewMax. The Tundra also has three wheelbase and bed lengths. Quite a few options? Not what this means you can build ultimate truck, get style, performance and practicality and always be able to cover it.
In statistics, the term linear model is used in different ways according to the context. The most common occurrence is in connection with regression models and the term is often taken as synonymous with linear regression model. However, the term is also used in time series analysis with a different meaning. In each case, the designation "linear" is used to identify a subclass of models for which substantial reduction in the complexity of the related statistical theory is possible.
Linear regression models
For the regression case, the statistical model is as follows. Given a (random) sample the relation between the observations Yi and the independent variables Xij is formulated as
where may be nonlinear functions. In the above, the quantities εi are random variables representing errors in the relationship. The "linear" part of the designation relates to the appearance of the regression coefficients, βj in a linear way in the above relationship. Alternatively, one may say that the predicted values corresponding to the above model, namely
are linear functions of the βj.
Given that estimation is undertaken on the basis of a least squares analysis, estimates of the unknown parameters βj are determined by minimising a sum of squares function
From this, it can readily be seen that the "linear" aspect of the model means the following:
- the function to be minimised is a quadratic function of the βj for which minimisation is a relatively simple problem;
- the derivatives of the function are linear functions of the βj making it easy to find the minimising values;
- the minimising values βj are linear functions of the observations Yi;
- the minimising values βj are linear functions of the random errors εi which makes it relatively easy to determine the statistical properties of the estimated values of βj.
Time series models
An example of a linear time series model is an autoregressive moving average model. Here the model for values {Xt} in a time series can be written in the form
where again the quantities εt are random variables representing innovations which are new random effects that appear at a certain time but also affect values of X at later times. In this instance the use of the term "linear model" refers to the structure of the above relationship in representing Xt as a linear function of past values of the same time series and of current and past values of the innovations.[1] This particular aspect of the structure means that it is relative simple to derive relations for the mean and covariance properties of the time series. Note that here the "linear" part of the term "linear model" is not referring to the coefficients φi and θi, as it would be in the case of a regression model, which looks structurally similar.
Other uses in statistics
There are some other instances where "nonlinear model" is used to contrast with a linearly structured model, although the term "linear model" is not usually applied. One example of this is nonlinear dimensionality reduction.
See also
References
- ↑ Priestley, M.B. (1988) Non-linear and Non-stationary time series analysis, Academic Press. ISBN 0-12-564911-8
ar:نموذج الانحدار الخطي de:Lineares Modell fr:Modèle linéaire