Automated Continual Learning: Self-Referential Neural Networks that Meta-Learn Their Own Lifelong Learning Algorithms

Automated Continual Learning (ACL) trains self-referential neural networks to meta-learn their own in-context continual learning algorithms, encoding classic desiderata like knowledge preservation and forward/backward transfer into the meta-learning objectives.