7.2 A Sufficient Statistic for a Parameter

<< 7.1 Measures of Quality Estimators.md | 7.3 Properties of a Sufficient Statistic.md >>

Definition 7.2.1: Sufficient statistic

Definition

Let

• $X_1,\dots ,X_n$ : Random sample, with joint pdf/pmf $f(x;\theta )$, $\theta \in \Omega$
• $Y=u(\mathbf{X})$ : Statistic, with pdf/pmf $f_Y(y;\theta )$

Then $Y$ is a sufficient statistic for $\theta$

If and only if

• $ \frac{\prod_{i=1}^nf(x_{i};\theta)}{f_{Y}[u(\mathbf{x});\theta]} = H(\mathbf{x}) $$
• $H(\mathbf{X})$ does not depend upon $\theta$

Theorem 7.2.1: Neyman theorem

Theorem

Let

• $X_1,\dots ,X_n=\mathbf{X}$ : Random sample, with distribution that has pdf/pmf $f(x;\theta )$, $\theta \in \Omega$
• $Y=u(\mathbf{X})$ : Statistic for $\theta$
• $L(\theta )$ : Likelihood function of $X$

Then $Y$ is a sufficient statistic for $\theta$

If and only if

• $\exists k,l \ni L(\theta) = k[u(\mathbf{x});\theta]\cdot l(\mathbf{x})$$
• $l(\mathbf{x})$ is independent of $\theta$