Improving Instruction Data Quality through Reformatting: A Simple and Effective Approach for Aligning Large Language Models

Introducing REALIGN, a simple and effective method to automatically improve the quality of existing instruction datasets by reformatting responses to better align with pre-established criteria and collated evidence, without introducing additional data or advanced training techniques.