Proceedings

WenyanGPT: A Large Language Model for Classical Chinese Tasks

Xinyu Yao, Mengdi Wang, Bo Chen, Xiaobing Zhao

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 8339-8347.

https://doi.org/10.24963/ijcai.2025/927

Keywords

  • Natural Language Processing: NLP: Language models
  • Natural Language Processing: NLP: Applications

Abstract

Classical Chinese, as the core carrier of Chinese culture, plays a crucial role in the inheritance and study of ancient literature. However, existing natural language processing models primarily optimize for Modern Chinese, resulting in inadequate performance on Classical Chinese. This paper presents a comprehensive solution for Classical Chinese language processing. By continuing pre-training and instruction fine-tuning on the LLaMA3-8B-Chinese model, we construct a large language model, WenyanGPT, which is specifically designed for Classical Chinese tasks. Additionally, we develop an evaluation benchmark dataset, WenyanBENCH. Experimental results on WenyanBENCH demonstrate that WenyanGPT significantly outperforms current advanced LLMs in various Classical Chinese tasks. We make the model's training data, instruction fine-tuning data, and evaluation benchmark dataset publicly available to promote further research and development in the field of Classical Chinese processing.

Xinyu Yao, Mengdi Wang, Bo Chen, and Xiaobing Zhao. 2025. WenyanGPT: A Large Language Model for Classical Chinese Tasks. In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-25. IJCAI, 8339–8347. https://doi.org/10.24963/ijcai.2025/927
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards