Smaller, domain-specific models like BioMedLM can compete with larger models in biomedical NLP tasks, offering transparency, privacy, and cost-effectiveness.