{"type":"ScholarlyArticle","title":"Trust, but Verify: Uncertainty-Driven Evidential Multimodal Representation Learning","authors":[{"name":"Yupeng Han","slug":"yupeng-han","given":"Yupeng","family":"Han","affiliation":""},{"name":"Kai Zhang","slug":"kai-zhang","given":"Kai","family":"Zhang","affiliation":""},{"name":"Xianquan Wang","slug":"xianquan-wang","given":"Xianquan","family":"Wang","affiliation":""},{"name":"Zhihong Pan","slug":"zhihong-pan","given":"Zhihong","family":"Pan","affiliation":""},{"name":"Ze Liu","slug":"ze-liu","given":"Ze","family":"Liu","affiliation":""},{"name":"Jiyuan He","slug":"jiyuan-he","given":"Jiyuan","family":"He","affiliation":""}],"abstract":"Effective multimodal learning in real-world scenarios depends on a nuanced treatment of uncertainty, which arises at three levels: (1) Intrinsic Uncertainty from modality-specific noise or ambiguity; (2) Relational Uncertainty due to cross-modal conflicts or redundancy; and (3) Aggregated Uncertainty when fusing potentially inconsistent signals. Most existing methods overlook this hierarchy, applying a single uncertainty model. We propose Adaptive Evidential Multimodal Representation Learning (AEMRL), a framework aligned with this multi-level view. To address intrinsic uncertainty, Disentangled Evidential Uncertainty Encoding (D-EUE) provides interpretable, class-aware reliability scores per modality. For relational uncertainty, Uncertainty-Conditioned Dynamic Factorization (UDF) uses a hypernetwork to dynamically extract complementary cues and suppress conflict. To resolve aggregated uncertainty, Adaptive Fusion & Conflict-Aware Calibration (AFCAC) adaptively weights evidence streams and calibrates final predictions based on detected conflicts. Extensive experiments on five diverse benchmark datasets show that AEMRL consistently enhances task accuracy, reduces calibration error, and improves robustness to noise, semantic conflict, and missing modalities.","doi":"10.24963/ijcai.2026/128","url":"https://ijcai.org/proceedings/2026/128","pdf":"https://ijcai.org/proceedings/2026/0128.pdf","markdown":"https://ijcai.org/proceedings/2026/128.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/128","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Computer Vision","track":"Main Track","number":128,"pages":{"first":1143,"last":1151},"keywords":["Computer Vision: Multimodal learning","Machine Learning: Multi-modal learning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}