Multilingual Language Models Benefit from Imbalanced Training Data

Language imbalance during training can boost cross-lingual generalization in multilingual language models, leading to better performance on less frequent languages.