Logit standardization improves student performance in knowledge distillation by focusing on essential logit relations rather than magnitude matching.