{"type":"ScholarlyArticle","title":"Harnessing Multiple Large Language Models: A Survey on LLM Ensemble","authors":[{"name":"Zhijun Chen","slug":"zhijun-chen","given":"Zhijun","family":"Chen","affiliation":""},{"name":"Xiaodong Lu","slug":"xiaodong-lu","given":"Xiaodong","family":"Lu","affiliation":""},{"name":"Jingzheng Li","slug":"jingzheng-li","given":"Jingzheng","family":"Li","affiliation":""},{"name":"Pengpeng Chen","slug":"pengpeng-chen","given":"Pengpeng","family":"Chen","affiliation":""},{"name":"Zhuoran Li","slug":"zhuoran-li","given":"Zhuoran","family":"Li","affiliation":""},{"name":"Kai Sun","slug":"kai-sun","given":"Kai","family":"Sun","affiliation":""},{"name":"Yuankai Luo","slug":"yuankai-luo","given":"Yuankai","family":"Luo","affiliation":""},{"name":"Qianren Mao","slug":"qianren-mao","given":"Qianren","family":"Mao","affiliation":""},{"name":"Ming Li","slug":"ming-li","given":"Ming","family":"Li","affiliation":""},{"name":"Likang Xiao","slug":"likang-xiao","given":"Likang","family":"Xiao","affiliation":""},{"name":"Dingqi Yang","slug":"dingqi-yang","given":"Dingqi","family":"Yang","affiliation":""},{"name":"Yikun Ban","slug":"yikun-ban","given":"Yikun","family":"Ban","affiliation":""},{"name":"Hailong Sun","slug":"hailong-sun","given":"Hailong","family":"Sun","affiliation":""}],"abstract":"LLM Ensemble---which involves the comprehensive use of multiple large language models (LLMs), each aimed at handling user queries during downstream inference, to benefit from their individual strengths---has gained substantial attention recently. The widespread availability of LLMs, coupled with their varying strengths and out-of-the-box usability, has profoundly advanced the field of LLM Ensemble. This paper presents the first systematic review of recent developments in LLM Ensemble. First, we introduce our taxonomy of LLM Ensemble and discuss several related research problems. Then, we provide a more in-depth classification of the methods under the broad categories of ``ensemble-before-inference, ensemble-during-inference, ensemble-after-inference'', and review relevant methods. Finally, we introduce related benchmarks and applications, summarize existing studies, and suggest  future research directions. GitHub project link is: https://github.com/junchenzhi/Awesome-LLM-Ensemble.","doi":"10.24963/ijcai.2026/867","url":"https://ijcai.org/proceedings/2026/867","pdf":"https://ijcai.org/proceedings/2026/0867.pdf","markdown":"https://ijcai.org/proceedings/2026/867.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/867","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Survey Track","track":"Survey Track","number":867,"pages":{"first":7807,"last":7816},"keywords":["Agent-based and Multi-agent Systems: Other","SV: Agent-based and Multi-agent Systems","Machine Learning: Ensemble methods","Natural Language Processing: Applications"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}