Challenges of Updating Language Models with Unstructured Facts

The author introduces the Unstructured Knowledge Editing (UKE) benchmark to address the impracticality of current evaluation strategies for knowledge editing, focusing on unstructured texts as updates. The UKE poses significant challenges to existing knowledge editing methods, highlighting the need for more practical approaches.