Weighted least squares

From Citizendium
Revision as of 19:20, 17 January 2008 by imported>Igor Grešovnik (→‎See also)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
This article is developing and not approved.
Main Article
Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
This editable Main Article is under development and subject to a disclaimer.

Weighted least squares is a method of linear regression similar to the ordinary least squares method, except that points are weighted, which causes that some points have greater effect on the approximation than the others. The weighted least squares method is particularly important in function approximation and in estimation of model parameters from measured data.

Problem statement

Consider the problem of adjusting a model function to best fit a given data set. The chosen model function has a set of adjustable parameters a. The data set consist of n points

The modelfunction has the form

where y is the dependent variable, x are the independent variables, and a are the adjustable parameters of the model. We wish to find the values of these parameters such that the model best fits the data according to a defined error criterion. The least squares method minimizes the weighted sum of squares of errors,

with respect to the adjustable parameters of the model a.

When yi are some quantities measured in some real physical system, and f is a model of this system, then we often set the weights wi as inverse of the variances of the corresponding measurements (yi),

In this way, measurements with lower statistical variance are given greater statistical weight.

See also