Advancing Open-Source Language Models with Mixed-Quality Data: OpenChat Framework

OpenChat introduces a novel framework, C-RLFT, to enhance open-source language models with mixed-quality data, achieving superior performance without costly human preference labeling.