FUSECHAT: Knowledge Fusion of Chat Models
The author argues that combining existing large language models (LLMs) into a more robust LLM through knowledge fusion reduces costs and leverages strengths. The approach involves pairwise knowledge fusion and model merging to create a superior chat LLM, FUSECHAT.