LumiNet: Enhancing Knowledge Distillation with Perception
LumiNet introduces a novel approach to knowledge distillation by enhancing logit-based distillation through the concept of 'perception', addressing overconfidence issues and improving sample representation.