Investigating the Relationship Between Neural Collapse and Plasticity Loss in Deep Learning

The core message of this paper is that there exists a complex relationship between neural collapse and plasticity loss in deep learning models, which can be leveraged to mitigate plasticity loss.