
Program-aided Distillation (PaD) enhances small models' reasoning abilities by distilling reasoning programs from large language models.


coremsg

program-aided-distillation-for-small-model-reasoning-enhancement


Program-aided Distillation for Small Model Reasoning Enhancement



PaD introduces reasoning programs to improve distillation quality for small models in reasoning tasks.



PaD: Program-aided Distillation Enhances Small Model Reasoning
