Definition

The Akaike Information Criterion (AIC) is a model selection criterion that balances model fit against complexity.

where:

  • = maximum likelihood
  • = number of parameters ( with constant, without)

Interpretation

  • Lower AIC is better
  • Penalizes models with more parameters
  • Emphasizes prediction efficiency

Model Selection

Choose the model with minimum AIC among competing models.

Properties

PropertyDescription
Penalty — constant penalty per parameter
Best forPrediction efficiency
AsymptoticNot consistent (may overfit with large )