Frequency attention in the frequency domain enhances knowledge transfer in distillation by encouraging students to mimic teacher features.
