Definition
The Akaike Information Criterion (AIC) is a model selection criterion that balances model fit against complexity.
where:
- = maximum likelihood
- = number of parameters ( with constant, without)
Interpretation
- Lower AIC is better
- Penalizes models with more parameters
- Emphasizes prediction efficiency
Model Selection
Choose the model with minimum AIC among competing models.
Properties
| Property | Description |
|---|---|
| Penalty | — constant penalty per parameter |
| Best for | Prediction efficiency |
| Asymptotic | Not consistent (may overfit with large ) |