Ordinary least squares estimator (matrix form)

Gives the vector of regression coefficients that minimizes the sum of squared residuals in a linear regression model. It is used whenever a linear model y = X beta + error is fitted to data and X has full column rank.

\hat{\beta} = (X^{\top}X)^{-1}X^{\top}y

What the symbols mean

estimated coefficient vector
design matrix of regressors, n by p, including a column of ones for the intercept
vector of observed responses, length n
transpose of the design matrix

About this formula

  • FieldStatistics
  • TopicLinear regression
  • LevelUniversity
  • Also calledOLS estimator matrix form, least squares coefficient estimate, normal equations solution, linear regression coefficients formula, beta hat OLS, OLS formula

Write it in Obsidian

MathLive is a free visual math editor for Obsidian. Run Find a formula, type “ordinary least squares estimator (matrix form)”, and it goes into your note as editable LaTeX. You can also scan formulas from screenshots, PDFs and handwriting.

Related formulas