Chinese-Centric Large Language Model: Pretraining and Evaluating a 2B-Parameter Model Focused on the Chinese Language

This study introduces CT-LLM, a 2B-parameter large language model that prioritizes the Chinese language in its pretraining and fine-tuning, demonstrating exceptional performance on Chinese language tasks and competitive abilities in English.