Fisher information

Gives the amount of information that an observed random variable carries about an unknown parameter of its distribution, computed as the expected square of the score function. It is used in statistical estimation, for example to find the Cramer-Rao lower bound on estimator variance.

I(\theta)=\mathbb{E}\left[\left.\left(\frac{\partial}{\partial\theta}\log f(X;\theta)\right)^2\right|\theta\right]

What the symbols mean

Fisher information about the parameter \theta
unknown parameter of the distribution
random variable with the modelled distribution
probability density or mass function of X given parameter \theta
expectation taken over X

About this formula

  • FieldStatistics
  • TopicStatistical estimation
  • LevelUniversity
  • Also calledFisher information formula, expected squared score, amount of information about a parameter, score variance
  • SourceWikidata Q1420659

Write it in Obsidian

MathLive is a free visual math editor for Obsidian. Run Find a formula, type “fisher information”, and it goes into your note as editable LaTeX. You can also scan formulas from screenshots, PDFs and handwriting.

Related formulas