SDPose: Efficient Transformer-based Human Pose Estimation via Self-Distillation and Cyclic Forwarding

A novel self-distillation framework, SDPose, that leverages a Multi-Cycled Transformer (MCT) module to improve the performance of small transformer-based human pose estimation models without increasing computational cost.