Efficient Model Adaptation via Prompt Transfer and Knowledge Distillation

A novel prompt transfer approach (PANDA) that leverages knowledge distillation to effectively transfer knowledge from source prompts to target prompts, outperforming vanilla prompt transfer methods.