{"type":"ScholarlyArticle","title":"GE-Chat: A Graph Enhanced RAG Framework for Evidential Response Generation of LLMs","authors":[{"name":"Longchao Da","slug":"longchao-da","given":"Longchao","family":"Da","affiliation":""},{"name":"Parth Mitesh Shah","slug":"parth-mitesh-shah","given":"Parth Mitesh","family":"Shah","affiliation":""},{"name":"Kuan-Ru Liou","slug":"kuan-ru-liou","given":"Kuan-Ru","family":"Liou","affiliation":""},{"name":"Jiaxing Zhang","slug":"jiaxing-zhang","given":"Jiaxing","family":"Zhang","affiliation":""},{"name":"Hua Wei","slug":"hua-wei","given":"Hua","family":"Wei","affiliation":""}],"abstract":"Large Language Models (LLMs) have become integral to human decision-making processes. However, their outputs are not always reliable, often requiring users to assess the accuracy of the information provided manually. This issue is exacerbated by hallucinated responses, which are frequently presented with convincing but incorrect explanations, leading to trust concerns among users. To address this challenge, we propose GE-Chat, a knowledge Graph-enhanced retrieval-augmented generation framework designed to deliver Evidence-based responses. Specifically, when users upload a document, GE-Chat constructs a knowledge graph to support a retrieval-augmented agent, enriching the agent's responses with external knowledge beyond its training data. We further incorporate Chain-of-Thought (CoT) reasoning, n-hop subgraph searching, and entailment-based sentence generation to ensure accurate evidence retrieval. Experimental results demonstrate that our approach improves the ability of existing models to identify precise evidence in free-form contexts, offering a reliable mechanism for verifying LLM-generated conclusions and enhancing trustworthiness.","doi":"10.24963/ijcai.2025/1256","url":"https://ijcai.org/proceedings/2025/1256","pdf":"https://ijcai.org/proceedings/2025/1256.pdf","markdown":"https://ijcai.org/proceedings/2025/1256.md","bibtex":"https://ijcai.org/proceedings/2025/bibtex/1256","volume":{"slug":"2025","title":"Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2025","url":"https://ijcai.org/proceedings/2025/","year":2025,"location":"Montreal, Canada","dates":"16-22 August 2025","editors":"James Kwok","isbn":"978-1-956792-06-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2025"},"section":"Demo Track","track":"Demo Track","number":1256,"pages":{"first":11030,"last":11033},"keywords":["AI Ethics, Trust, Fairness: ETF: Trustworthy AI","Natural Language Processing: NLP: Applications","Natural Language Processing: NLP: Information extraction","Natural Language Processing: NLP: Interpretability and analysis of models for NLP"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}