CoDA: Co-adaptive Dual-path Alignment for Vision-Language Models
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 2100-2108.
https://doi.org/10.24963/ijcai.2026/234
Keywords
- Machine Learning: Few-shot learning
- Computer Vision: Transfer, low-shot, semi- and un- supervised learning
- Computer Vision: Multimodal learning
Abstract
Parameter-efficient adaptation methods, such as adapters and prompt learning, have become popular for transferring pre-trained vision-language models (VLMs) to downstream tasks. However, under limited supervision during adaptation, overly aggressive cross-modal alignment can distort the intrinsic structure of modality-specific representations, leading to degraded generalization. In this paper, we propose Co-adaptive Dual-path Alignment (CoDA), a new adaptation framework that explicitly disentangles and coordinates cross-modal semantic alignment and intra-modal structural consistency. In CoDA, we also propose a parent class labeling strategy that injects hierarchical semantic priors into textual prompts, further stabilizing alignment under limited supervision. Extensive experiments on eleven benchmark datasets show that CoDA outperforms state-of-the-art parameter-efficient methods, particularly under few-shot learning and distribution-shift scenarios. Our code is available at https://github.com/yizhang-ac/CoDA.
@inproceedings{ijcai2026p234,
title = {CoDA: Co-adaptive Dual-path Alignment for Vision-Language Models},
author = {Zhang, Yi and Zhu, Rui and Li, Channi and Li, Xiaoxu and Ma, Zhanyu and Xue, Jing-Hao},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {2100--2108},
year = {2026},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2026/234},
url = {https://doi.org/10.24963/ijcai.2026/234},
}
TY - CPAPER TI - CoDA: Co-adaptive Dual-path Alignment for Vision-Language Models AU - Zhang, Yi AU - Zhu, Rui AU - Li, Channi AU - Li, Xiaoxu AU - Ma, Zhanyu AU - Xue, Jing-Hao T2 - Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2026 SP - 2100 EP - 2108 DO - 10.24963/ijcai.2026/234 UR - https://doi.org/10.24963/ijcai.2026/234 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: