{"type":"ScholarlyArticle","title":"KG-MultiMS: a Knowledge Graph-Enhanced Multimodal Framework for Multiple Sclerosis","authors":[{"name":"Riccardo Francia","slug":"riccardo-francia","given":"Riccardo","family":"Francia","affiliation":""}],"abstract":"Despite advances in the computational analysis of multiple sclerosis, the ability to accurately predict disease progression remains limited due to unimodal approaches in the context of deep learning. KG-MultiMS proposes as a multimodal deep-learning framework that integrates data from three heterogeneous sources: (1) MRI volumes using the Swin-UNETR architecture to learn both semantic embeddings and segmentation masks of brain lesions; (2) tabular clinical variables using the FT-Tokenizer architecture to learn clinical embeddings; (3) medical knowledge graph based on the Harvard-Oxford atlas using a Heterogeneous Graph Transformer to learn contextual embeddings from patient-specific subgraphs. A cross-attention mechanism will allow for leveraging multimodal contributions by dynamically weighting them based on the anatomical-functional concordance represented in the contextual embeddings.","doi":"10.24963/ijcai.2026/943","url":"https://ijcai.org/proceedings/2026/943","pdf":"https://ijcai.org/proceedings/2026/0943.pdf","markdown":"https://ijcai.org/proceedings/2026/943.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/943","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Doctoral Consortium","track":"Doctoral Consortium","number":943,"pages":{"first":8329,"last":8330},"keywords":["Machine Learning: Knowledge-aided learning","Computer Vision: Biomedical image analysis","Machine Learning: Multi-modal learning","Data Mining: Knowledge graphs and knowledge base completion"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}