Improving Calibration of Overparameterized Neural Networks by Decoupling Feature Extraction and Classification Layers

Decoupling the training of feature extraction layers and classification layers in overparameterized deep neural network architectures significantly improves model calibration while retaining accuracy.