LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

LoRA-based fine-tuning of 310 LLMs across 10 base models and 31 tasks demonstrates significant performance improvements over base models and GPT-4, with the best fine-tuned models outperforming GPT-4 by 10 points on average.