Band Together: Untargeted Adversarial Training with Multimodal Coordination Against Evasion-Based Promotion Attacks
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3124-3132.
https://doi.org/10.24963/ijcai.2026/347
Keywords
- Machine Learning: Multi-modal learning
- Data Mining: Recommender systems
- Machine Learning: Adversarial machine learning
Abstract
Multimodal recommender systems exploit visual and textual signals to alleviate data sparsity, but this also makes them more vulnerable to evasion-based promotion attacks. Existing defenses are largely limited to single-modal settings and mainly focus on poisoning-based threats, leaving evasion-based threats underexplored. In this work, we first identify a cross-modal gradient mismatch under the multi-user promotion setting, where visual and textual perturbations are optimized in inconsistent directions due to the dominance of distinct user groups. This phenomenon dilutes the attack effectiveness and leads robust training to underestimate worst-case risks. To address this issue, we propose Untargeted Adversarial Training with Multimodal Coordination (UAT-MC). UAT-MC tackles the challenge of unknown targeted items in evasion-based attacks (as opposed to poisoning-based attacks) by treating all items as potential targets, and introduces a gradient alignment mechanism to explicitly correct this mismatch. This design ensures synchronized perturbations across modalities, thereby maximizing adversarial strength for robust training. Extensive experiments demonstrate that UAT-MC significantly improves robustness against promotion attacks while maintaining acceptable recommendation performance under the defense–accuracy trade-off. Code is available at https://github.com/
gmXian/UAT-MC.
@inproceedings{ijcai2026p347,
title = {Band Together: Untargeted Adversarial Training with Multimodal Coordination Against Evasion-Based Promotion Attacks},
author = {Xian, Guanmeng and Yang, Ning and Yu, Philip S.},
booktitle = {Proceedings of the Thirty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-26}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Diego Calvanese},
pages = {3124--3132},
year = {2026},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2026/347},
url = {https://doi.org/10.24963/ijcai.2026/347},
}
TY - CPAPER TI - Band Together: Untargeted Adversarial Training with Multimodal Coordination Against Evasion-Based Promotion Attacks AU - Xian, Guanmeng AU - Yang, Ning AU - Yu, Philip S. T2 - Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-26 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2026 SP - 3124 EP - 3132 DO - 10.24963/ijcai.2026/347 UR - https://doi.org/10.24963/ijcai.2026/347 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: