MELTing point: Mobile Evaluation of Language Transformers

Transformers have revolutionized machine learning, but their deployment on mobile devices faces challenges due to runtime requirements. MELT infrastructure evaluates on-device Large Language Models (LLMs) performance, highlighting the need for optimization.