Memory is crucial for cognitive functions, with pre-trained language models showing remarkable memorizing abilities. Vanilla models suffer from catastrophic forgetting, while pre-training enhances memory retention. Knowledge relevance and diversification significantly impact memory formation.
Sang ngôn ngữ khác
từ nội dung nguồn
arxiv.org
Thông tin chi tiết chính được chắt lọc từ
by Boxi Cao,Qia... lúc arxiv.org 03-14-2024
https://arxiv.org/pdf/2305.09144.pdfYêu cầu sâu hơn