The Alignment Bottleneck in Decomposition-Based Claim Verification
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 5458-5467.
https://doi.org/10.24963/ijcai.2026/608
Keywords
- Natural Language Processing: Resources and evaluation
- Natural Language Processing: Interpretability and analysis of models for NLP
- Multidisciplinary Topics and Applications: News and media
- Natural Language Processing: Text classification
Abstract
Structured claim decomposition is often proposed as a solution for verifying complex, multi-faceted claims, yet empirical results have been inconsistent. We argue that these inconsistencies stem from two overlooked bottlenecks: evidence alignment and sub-claim error profiles. To better understand these factors, we introduce a new dataset of real-world complex claims, featuring temporally bounded evidence and human-annotated sub-claim evidence spans. We evaluate decomposition under two evidence alignment setups: Sub-claim Aligned Evidence (SAE) and Repeated Claim-level Evidence (SRE). Our results reveal that decomposition brings significant performance improvement only when evidence is granular and strictly aligned. By contrast, standard setups that rely on repeated claim-level evidence (SRE) fail to improve and often degrade performance as shown across different datasets and domains (PHEMEPlus, MMM-Fact, COVID-Fact). Furthermore, we demonstrate that in the presence of noisy sub-claim labels, the nature of the error ends up determining downstream robustness. We find that conservative "abstention" significantly reduces error propagation compared to aggressive but incorrect predictions. These findings suggest that future claim decomposition frameworks must prioritize precise evidence synthesis and calibrate the label bias of sub-claim verification models.
@inproceedings{ijcai2026p608,
title = {The Alignment Bottleneck in Decomposition-Based Claim Verification},
author = {Akhter, Mahmud Elahi and Ruggeri, Federico and Bilal, Iman Munire and Procter, Robert and Liakata, Maria},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {5458--5467},
year = {2026},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2026/608},
url = {https://doi.org/10.24963/ijcai.2026/608},
}
TY - CPAPER TI - The Alignment Bottleneck in Decomposition-Based Claim Verification AU - Akhter, Mahmud Elahi AU - Ruggeri, Federico AU - Bilal, Iman Munire AU - Procter, Robert AU - Liakata, Maria T2 - Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2026 SP - 5458 EP - 5467 DO - 10.24963/ijcai.2026/608 UR - https://doi.org/10.24963/ijcai.2026/608 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: