Ordinary least squares estimator (matrix form)
Gives the vector of regression coefficients that minimizes the sum of squared residuals in a linear regression model. It is used whenever a linear model y = X beta + error is fitted to data and X has full column rank.
\hat{\beta} = (X^{\top}X)^{-1}X^{\top}yWhat the symbols mean
| estimated coefficient vector | |
| design matrix of regressors, n by p, including a column of ones for the intercept | |
| vector of observed responses, length n | |
| transpose of the design matrix |
About this formula
- FieldStatistics
- TopicLinear regression
- LevelUniversity
- Also calledOLS estimator matrix form, least squares coefficient estimate, normal equations solution, linear regression coefficients formula, beta hat OLS, OLS formula
Write it in Obsidian
MathLive is a free visual math editor for Obsidian. Run Find a formula, type “ordinary least squares estimator (matrix form)”, and it goes into your note as editable LaTeX. You can also scan formulas from screenshots, PDFs and handwriting.