Data-Efficient Fine-Tuning of Large Language Models with LoRA and Active Learning
The author proposes a novel approach to integrate uncertainty-based active learning and LoRA for data-efficient fine-tuning of large language models. Experimental results show superior performance on complex reasoning tasks.