{"type":"ScholarlyArticle","title":"HyLoVQA: Dynamic Hypernetwork-Generated Low-Rank Adaptation for Continual Visual Question Answering","authors":[{"name":"Yiran Wang","slug":"yiran-wang","given":"Yiran","family":"Wang","affiliation":""},{"name":"Chenyi Xiong","slug":"chenyi-xiong","given":"Chenyi","family":"Xiong","affiliation":""},{"name":"Ziyue Qin","slug":"ziyue-qin","given":"Ziyue","family":"Qin","affiliation":""},{"name":"Miao Zhang","slug":"miao-zhang","given":"Miao","family":"Zhang","affiliation":""},{"name":"Kui Xiao","slug":"kui-xiao","given":"Kui","family":"Xiao","affiliation":""},{"name":"Zhifei Li","slug":"zhifei-li","given":"Zhifei","family":"Li","affiliation":""}],"abstract":"Continual Visual Question Answering (VQA) requires learning from non-stationary streams of visual inputs and questions while preserving past knowledge. Most prior methods adapt by updating a largely shared parameter set. This often leads to cross-level task interference, hindering accurate adaptation to the current task and object. To address this limitation, we propose HyLoVQA. It maintains a drift-resilient memory bank of anchors. The bank stores the content of visual objects and textual tasks, and they are updated using current input features. Conditioned on retrieved anchors, a hypernetwork generates lightweight Low-Rank Adaptation (LoRA) adapters. This ensures parameter efficiency, allowing the model to adapt to each task and object dynamically. Additionally, we formulate an alignment loss that aligns semantic discrepancies in the feature space with functional changes in the parameter space, thereby constraining LoRA adapters to remain focused on the current task and object. Extensive experiments on VQA v2 and NExT-QA under both standard and compositional settings demonstrate the superiority of HyLoVQA over prior state-of-the-art methods. The code is available at https://github.com/HubuKG/HyLoVQA.","doi":"10.24963/ijcai.2026/200","url":"https://ijcai.org/proceedings/2026/200","pdf":"https://ijcai.org/proceedings/2026/0200.pdf","markdown":"https://ijcai.org/proceedings/2026/200.md","bibtex":"https://ijcai.org/proceedings/2026/bibtex/200","volume":{"slug":"2026","title":"Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2026","url":"https://ijcai.org/proceedings/2026/","year":2026,"location":"Bremen, Germany","dates":"15-21 August 2026","editors":"Diego Calvanese","isbn":"978-1-956792-09-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2026"},"section":"Computer Vision","track":"Main Track","number":200,"pages":{"first":1794,"last":1802},"keywords":["Computer Vision: Image and video retrieval","Computer Vision: Vision, language and reasoning"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}