Proceedings

The Alignment Bottleneck in Decomposition-Based Claim Verification

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 5458-5467.

https://doi.org/10.24963/ijcai.2026/608

Abstract

Structured claim decomposition is often proposed as a solution for verifying complex, multi-faceted claims, yet empirical results have been inconsistent. We argue that these inconsistencies stem from two overlooked bottlenecks: evidence alignment and sub-claim error profiles. To better understand these factors, we introduce a new dataset of real-world complex claims, featuring temporally bounded evidence and human-annotated sub-claim evidence spans. We evaluate decomposition under two evidence alignment setups: Sub-claim Aligned Evidence (SAE) and Repeated Claim-level Evidence (SRE). Our results reveal that decomposition brings significant performance improvement only when evidence is granular and strictly aligned. By contrast, standard setups that rely on repeated claim-level evidence (SRE) fail to improve and often degrade performance as shown across different datasets and domains (PHEMEPlus, MMM-Fact, COVID-Fact). Furthermore, we demonstrate that in the presence of noisy sub-claim labels, the nature of the error ends up determining downstream robustness. We find that conservative "abstention" significantly reduces error propagation compared to aggressive but incorrect predictions. These findings suggest that future claim decomposition frameworks must prioritize precise evidence synthesis and calibrate the label bias of sub-claim verification models.

  1. [Atanasova et al., 2020] Pepa Atanasova, Jakob Grue Simon- sen, Christina Lioma, and Isabelle Augenstein. Generating fact checking explanations. In Proc. of the 58th Annual Meeting of the ACL, pages 7352-7364, Online, July 2020.
  2. ACL.
  3. [Bastings et al., 2019] Jasmijn Bastings, Wilker Aziz, and Ivan Titov. Interpretable neural predictions with differen- tiable binary variables. In Proc. of the 57th Annual Meeting of the ACL, pages 2963-2977, Florence, Italy, July 2019.
  4. ACL.
  5. [Bilal et al., 2024] Iman Munire Bilal, Preslav Nakov, Rob Procter, and Maria Liakata. Generating zero-shot abstrac- tive explanations for rumour verification, 2024.
  6. [Brodersen et al., 2010] Kay Henning Brodersen, Cheng Soon Ong, Klaas Enno Stephan, and Joachim M. Buhmann. The balanced accuracy and its posterior distri- bution. In 2010 20th Int. Conf. on Pattern Recognition, pages 3121-3124, 2010.
  7. [Chen et al., 2022] Jifan Chen, Aniruddh Sriram, Eunsol Choi, and Greg Durrett. Generating literal and implied subquestions to fact-check complex claims. In Proc. of the 2022 Conf. on EMNLP, pages 3495-3516, Abu Dhabi, United Arab Emirates, December 2022. ACL.
  8. [Chen et al., 2024] Jifan Chen, Grace Kim, Aniruddh Sriram, Greg Durrett, and Eunsol Choi. Complex claim verification with evidence retrieved in the wild. In Proc. of the 2024 Conf. of the NAACL: Human Language Technologies, pages 3569-3587, Mexico City, Mexico, June 2024. ACL.
  9. [Devlin et al., 2019] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proc. of the 2019 Conf. of the NAACL: Human Language Technologies, pages 4171-4186, Minneapolis, Minnesota, June 2019. ACL.
  10. [Dougrez-Lewis et al., 2022] John Dougrez-Lewis, Elena Kochkina, Miguel Arana-Catania, Tom Sherborne, Yulan Lei, and Maria Liakata. PHEMEplus: Enriching social media rumour verification with external evidence. In Proc. of the Fifth Fact Extraction and VERification Workshop (FEVER), pages 1-13, Dublin, Ireland, May 2022. ACL.
  11. [Dougrez-Lewis et al., 2025] John Dougrez-Lewis, Mah- mud Elahi Akhter, Federico Ruggeri, Sebastian Löbbers, Yulan He, and Maria Liakata. Assessing the reasoning ca- pabilities of llms in the context of evidence-based claim verification, 2025.
  12. [Ge et al., 2025] Ziyu Ge, Yuhao Wu, Daniel Wai Kit Chin, Roy Ka-Wei Lee, and Rui Cao. Resolving conflicting evidence in automated fact-checking: A study on retrieval- augmented llms. ArXiv, abs/2505.17762, 2025.
  13. [Glockner et al., 2022] Max Glockner, Yufang Hou, and Iryna Gurevych. Missing counter-evidence renders NLP fact-checking unrealistic for misinformation. In Proc. of the 2022 Conf. on EMNLP, pages 5916-5936, Abu Dhabi, United Arab Emirates, December 2022. ACL.
  14. [Gong et al., 2024] Haisong Gong, Huanhuan Ma, Qiang Liu, Shu Wu, and Liang Wang. Navigating the noisy crowd: Finding key information for claim verification. CoRR, abs/2407.12425, 2024.
  15. [Guo et al., 2022] Zhijiang Guo, Michael Schlichtkrull, and Andreas Vlachos. A survey on automated fact-checking. Transactions of the ACL, 10:178-206, 2022.
  16. [Hu et al., 2022] Xuming Hu, Zhijiang Guo, GuanYu Wu, Ai- wei Liu, Lijie Wen, and Philip Yu. CHEF: A pilot Chinese dataset for evidence-based fact-checking. In Proc. of the 2022 Conf. of the NAACL: Human Language Technologies, pages 3362-3376, Seattle, United States, July 2022. ACL.
  17. [Hu et al., 2024] Qisheng Hu, Quanyu Long, and Wenya Wang. Decomposition dilemmas: Does claim decomposi- tion boost or burden fact-checking performance?, 2024.
  18. [Huang et al., 2024] Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, and Denny Zhou. Large language models cannot self-correct reasoning yet, 2024.
  19. [Jolly et al., 2022] Shailza Jolly, Pepa Atanasova, and Is- abelle Augenstein. Generating fluent fact checking ex- planations with unsupervised post-editing. Information, 13(10):500, 2022.
  20. [Kamoi et al., 2023] Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, and Greg Durrett. WiCE: Real-world entailment for claims in Wikipedia. In Proc. of the 2023 Conf. on EMNLP, pages 7561-7583, Singapore, December 2023. ACL.
  21. [Kochkina and Liakata, 2020] Elena Kochkina and Maria Li- akata. Estimating predictive uncertainty for rumour verifi- cation models. In Proc. of the 58th Annual Meeting of the ACL, pages 6964-6981, Online, July 2020. ACL.
  22. [Lei et al., 2016] Tao Lei, Regina Barzilay, and Tommi Jaakkola. Rationalizing neural predictions. In Proc. of the 2016 Conf. on EMNLP, pages 107-117, Austin, Texas, November 2016. ACL.
  23. [Li et al., 2024] Miaoran Li, Baolin Peng, Michel Galley, Jianfeng Gao, and Zhu Zhang. Self-checker: Plug-and-play modules for fact-checking with large language models. In Findings of the ACL: NAACL 2024, pages 163-181, Mexico City, Mexico, June 2024. ACL.
  24. [Liu et al., 2024] Hui Liu, Wenya Wang, Haoru Li, and Hao- liang Li. TELLER: A trustworthy framework for explain- able, generalizable and controllable fake news detection. In Findings of the ACL: ACL 2024, pages 15556-15583, Bangkok, Thailand, August 2024. ACL.
  25. [Liu et al., 2025] Xinyu Liu, Junhao Yu, Jing Zhao, and Zhouhan Li. Bidev: Bidirectional decomposition for com- plex claim verification, 2025.
  26. [Lyu et al., 2025] Xiucheng Lyu, Chengyu Cao, Mingwei Sun, and Ruifeng Xu. Mitigating error propagation in multi- hop fact verification with logic reasoning. International Journal of Machine Learning and Cybernetics, 2025.
  27. [Ma et al., 2025] Jiatong Ma, Linmei Hu, Rang Li, and Wenbo Fu. Local: Logical and causal fact-checking with llm-based multi-agents. In Proc. of the ACM on Web Con- ference 2025, page 1614-1625, New York, NY, USA, 2025. ACM.
  28. [Min et al., 2023] Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, and Hannaneh Hajishirzi. FactScore: Fine-grained atomic evaluation of factual precision in long form text generation. In Proc. of the 2023 Conf. on EMNLP, pages 12076-12100, Singapore, December 2023. ACL.
  29. [Nakov et al., 2021] Preslav Nakov, David Corney, Maram Hasanain, Firoj Alam, Tamer Elsayed, Alberto Barrón- Cedeño, Paolo Papotti, Shaden Shaar, and Giovanni Da San Martino. Automated fact-checking for assisting human fact-checkers. In Proc. of the 30th IJCAI, pages 4551-4558. IJCAI, 2021. IJCAI
  30. [Pan et al., 2023] Liangming Pan, Xiaobao Wu, Xinyuan Lu, Anh Tuan Luu, William Yang Wang, Min-Yen Kan, and Preslav Nakov. Fact-checking complex claims with program-guided reasoning. In Proc. of the 61st Annual Meeting of the ACL, pages 6981-7004, Toronto, Canada, July 2023. ACL.
  31. [Papineni et al., 2002] Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for au- tomatic evaluation of machine translation. In Proc. of the 40th ACL, ACL '02, pages 311-318, USA, 2002. Associa- tion for Computational Linguistics.
  32. [Quelle and Bovet, 2023] Dorian Quelle and Alexandre Bovet. The perils and promises of fact-checking with large language models. In Proc. of the 2023 ACM Conf. on Fairness, Accountability, and Transparency, 2023.
  33. [Saakyan et al., 2021] Arkadiy Saakyan, Tuhin Chakrabarty, and Smaranda Muresan. COVID-fact: Fact extraction and verification of real-world claims on COVID-19 pandemic. In Proc. of the 59th ACL and the 11th IJCNLP, pages 2116- 2129, Online, August 2021. Association for Computational Linguistics.
  34. [Schlichtkrull et al., 2023a] Michael Schlichtkrull, Zhijiang Guo, and Andreas Vlachos. Averitec: A dataset for real- world claim verification with evidence from the web. In Advances in NeurIPS 36, 2023.
  35. [Schlichtkrull et al., 2023b] Michael Schlichtkrull, Zhijiang Guo, and Andreas Vlachos. Averitec: A dataset for real- world claim verification with evidence from the web. ArXiv, abs/2305.13117, 2023.
  36. [Sundriyal et al., 2022] Megha Sundriyal, Parantak Rani, Sriparna Saha, Pushpak Bhattacharyya, and Tanmoy Chakraborty. Empowering the fact-checkers! automatic identification of claim spans on Twitter. In Proc. of the 2022 Conf. on EMNLP, pages 7701-7715, Abu Dhabi, United Arab Emirates, December 2022. ACL.
  37. [Tang et al., 2024] Liyan Tang, Philippe Laban, and Greg Durrett. MiniCheck: Efficient fact-checking of LLMs on grounding documents. In Proc. of the 2024 Conf. on EMNLP, pages 8818-8847, Miami, Florida, USA, Novem- ber 2024. ACL.
  38. [Wang and Shu, 2023] Haoran Wang and Kai Shu. Explain- able claim verification via knowledge-grounded reason- ing with large language models. In Findings of the ACL: EMNLP 2023, pages 6288-6304, Singapore, December 2023. ACL.
  39. [Wang, 2024] Yuxia et al. Wang. Factcheck-bench: Fine- grained evaluation benchmark for automatic fact-checkers. In Findings of the ACL: EMNLP 2024, pages 14199-14230, Miami, Florida, USA, November 2024. ACL.
  40. [Wanner et al., 2024] Miriam Wanner, Seth Ebner, Zheng- ping Jiang, Mark Dredze, and Benjamin Van Durme. A closer look at claim decomposition. In Proc. of the 13th Joint Conf. on Lexical and Computational Seman- tics (*SEM 2024), pages 153-175, Mexico City, Mexico, June 2024. ACL.
  41. [Xu et al., 2025] Wenyan Xu, Dawei Xiang, Tianqi Ding, and Weihai Lu. Mmm-fact: A multimodal, multi-domain fact- checking dataset with multi-level retrieval difficulty, 2025.
  42. [Yang et al., 2024] Sohee Yang, Jonghyeon Kim, Joel Jang, Seonghyeon Ye, Hyunji Lee, and Minjoon Seo. Improving probability-based prompt selection through unified evalu- ation and analysis. Transactions of the ACL, 12:664-680, 2024.
  43. [Yang et al., 2025] An Yang, Anfeng Li, Baosong Yang, Be- ichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jing Zhou, Jingren Zhou, Junyang Lin, Kai Dang, Keqin Bao, Kexin Yang, Le Yu, Lianghao Deng, Mei Li, Mingfeng Xue, Mingze Li, Pei Zhang, Peng Wang, Qin Zhu, Rui Men, Ruize Gao, Shixuan Liu, Shuang Luo, Tianhao Li, Tianyi Tang, Wenbiao Yin, Xingzhang Ren, Xinyu Wang, Xinyu Zhang, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yinger Zhang, Yu Wan, Yuqiong Liu, Zekun Wang, Zeyu Cui, Zhenru Zhang, Zhipeng Zhou, and Zihan Qiu. Qwen3 technical report, 2025. Accessed: 2026-01-15.
  44. [Zhang and Gao, 2023] Xuan Zhang and Wei Gao. Towards LLM-based fact verification on news claims with a hier- archical step-by-step prompting method. In Proc. of the 13th IJCNLP and the 3rd AACL, pages 996-1011, Bali, Indonesia, November 2023. ACL.
  45. [Zhang et al., 2019] Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. Bertscore: Eval- uating text generation with bert. ArXiv, abs/1904.09675, 2019.
  46. [Zhang et al., 2024] Zhihao Zhang, Yixing Fan, Ruqing Zhang, and Jiafeng Guo. A claim decomposition bench- mark for long-form answer verification, 2024.
  47. [Zhao et al., 2024] Xiaoyan Zhao, Lingzhi Wang, Zhanghao Wang, Hong Cheng, Rui Zhang, and Kam-Fai Wong. PACAR: Automated fact-checking with planning and cus- tomized action reasoning using large language models. In Proc. of the 2024 LREC-COLING, pages 12564-12573, Torino, Italia, May 2024. ELRA and ICCL.
  48. [Zubiaga et al., 2016] Arkaitz Zubiaga, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Peter Tolmie. Analysing how people orient to and spread rumours in social media by looking at conversational threads. PLOS ONE, 11(3):1-29, 2016.
  49. [Zubiaga et al., 2018] Arkaitz Zubiaga, Ahmet Aker, Kalina Bontcheva, Maria Liakata, and Rob Procter. Detection and resolution of rumours in social media: A survey. ACM Computing Surveys, 51(2):1-36, 2018.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards