Inconsistent Behavior of Language Models on Simplified Text: A Concerning Trend Across Multiple Languages

Language models exhibit alarming inconsistencies in their predictions when dealing with simplified text inputs, with prediction change rates up to 50% across multiple languages and tasks.