Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal

The author proposes the Self-Synthesized Rehearsal (SSR) framework to address catastrophic forgetting in large language models by generating synthetic instances for rehearsal, achieving superior performance compared to conventional methods.