The author proposes a novel Frequency Attention Module (FAM) that operates in the frequency domain to encourage students to mimic teacher features, enhancing knowledge distillation methods.
学生の学習を向上させるために、周波数ドメインを活用した知識蒸留の重要性を強調します。