{"type":"ScholarlyArticle","title":"WenyanGPT: A Large Language Model for Classical Chinese Tasks","authors":[{"name":"Xinyu Yao","slug":"xinyu-yao","given":"Xinyu","family":"Yao","affiliation":""},{"name":"Mengdi Wang","slug":"mengdi-wang","given":"Mengdi","family":"Wang","affiliation":""},{"name":"Bo Chen","slug":"bo-chen","given":"Bo","family":"Chen","affiliation":""},{"name":"Xiaobing Zhao","slug":"xiaobing-zhao","given":"Xiaobing","family":"Zhao","affiliation":""}],"abstract":"Classical Chinese, as the core carrier of Chinese culture, plays a crucial role in the inheritance and study of ancient literature. However, existing natural language processing models primarily optimize for Modern Chinese, resulting in inadequate performance on Classical Chinese. This paper presents a comprehensive solution for Classical Chinese language processing. By continuing pre-training and instruction fine-tuning on the LLaMA3-8B-Chinese model, we construct a large language model, WenyanGPT, which is specifically designed for Classical Chinese tasks. Additionally, we develop an evaluation benchmark dataset, WenyanBENCH. Experimental results on WenyanBENCH demonstrate that WenyanGPT significantly outperforms current advanced LLMs in various Classical Chinese tasks. We make the model's training data, instruction fine-tuning data, and evaluation benchmark dataset publicly available to promote further research and development in the field of Classical Chinese processing.","doi":"10.24963/ijcai.2025/927","url":"https://ijcai.org/proceedings/2025/927","pdf":"https://ijcai.org/proceedings/2025/0927.pdf","markdown":"https://ijcai.org/proceedings/2025/927.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/927","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Natural Language Processing","track":"Main Track","number":927,"pages":{"first":8339,"last":8347},"keywords":["Natural Language Processing: NLP: Language models","Natural Language Processing: NLP: Applications"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}