The purpose of statistical model selection is to identify a parsimonious model, which is a model that is as simple as possible while maintaining good predictive ability over the outcome of interest.

We propose a new criterion for model selection in prediction problems. The covariance inflation criterion adjusts the training error by the average covariance of the ...