About

Least Square Method provides parameter estimates by minimizing the sum of squared residuals, with two main variants that differ in how they handle initial observations.

Conditional vs Unconditional

MethodInitial ValuesInformation UsedComplexity
Conditional LSFixed at observed Only Simpler, explicit for AR
Unconditional LSMarginal distribution includes All observationsMore complex, numerical

When to Use Each

Conditional Least Squares

  • Large samples (initial value impact negligible)
  • Simple AR models
  • Quick preliminary estimates
  • Software default for many time series packages

Unconditional Least Squares

  • Short time series
  • Seasonal models
  • When precision for early observations matters
  • Compromise between conditional LS and full MLE

Comparison with Maximum Likelihood

AspectConditional LSUnconditional LSMLE
Uses all dataNo ( excluded)YesYes
Distributional assumptionNone requiredNormal errorsNormal errors
EfficiencyGood for large BetterBest (large )