Scaling Model Editing: An Empirical Study on Batch Size and Sequential Editing Strategies for Llama-3

Increasing edit batch size may degrade model performance more significantly than using smaller edit batches sequentially for an equal number of edits. Sequential model editing is an important component for scaling model editing methods.