Adapting Language Models to Evolving World Knowledge: Challenges and Benchmarks

Language models trained on static data struggle to adapt to the dynamic nature of knowledge in an ever-changing world. Existing continual learning baselines fail to effectively update and remove outdated knowledge when learning new information.