Compact multilingual ALBERT models offer ecological advantages and comparable performance to larger models in NLP tasks.