Proceedings

Mitigating Backdoors via Decoy Shortcuts and Knowledge Decoupling

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 2172-2180.

https://doi.org/10.24963/ijcai.2026/242

© 2026 International Joint Conferences on Artificial Intelligence

Abstract

Backdoor attacks pose a serious threat to deep neural networks, especially when training relies on third-party data, allowing adversaries to inject malicious behaviors through data poisoning. In this work, we reveal that backdoor behaviors tend to be absorbed by a simpler parallel branch when jointly trained with the main network. Motivated by this insight, we propose Trapping and Removing (TR), a simple yet effective training-time defense that introduces a lightweight shortcut branch as a “honeypot” to trap backdoor knowledge. After training, backdoors can be removed by discarding the shortcut, without requiring any additional data. To further enhance backdoor isolation while maintaining benign performance, we design a knowledge decoupling strategy with entropy-based weight assignment, encouraging poisoned samples to flow through the honeypot while guiding the main network to focus on benign learning. In addition, we introduce an automatic shortcut generation strategy to improve generalization across model architectures. Extensive experiments on four benchmark datasets and five model architectures demonstrate that our approach effectively mitigates a wide range of backdoor attacks while preserving performance on benign data. Code: github.com/Zixuan-Zhu/TR.

  1. [Alex, 2009] Krizhevsky Alex. Learning multiple layers of features from tiny images. 2009.
  2. [Barni et al., 2019] Mauro Barni, Kassem Kallas, and Benedetta Tondi. A New Backdoor Attack in CNNS by Training Set Corruption Without Label Poisoning. In 2019 IEEE International Conference on Image Process- ing, pages 101-105. IEEE, 2019.
  3. [Chen et al., 2017] Xinyun Chen, Chang Liu, Bo Li, Kim- berly Lu, and Dawn Song. Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning. arXiv preprint arXiv:1712.05526, 2017.
  4. [Chen et al., 2024] Yiming Chen, Haiwei Wu, and Jiantao Zhou. Progressive poisoned data isolation for training- time backdoor defense. In Michael J. Wooldridge, Jen- nifer G. Dy, and Sriraam Natarajan, editors, Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI 2024), Vancouver, Canada, pages 11425-11433. AAAI Press, 2024.
  5. [Cheng et al., 2024] Siyuan Cheng, Guanhong Tao, Yingqi Liu, Guangyu Shen, Shengwei An, Shiwei Feng, Xiangzhe Xu, Kaiyuan Zhang, Shiqing Ma, and Xiangyu Zhang. Lo- tus: Evasive and resilient backdoor attacks through sub- partitioning. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 24798-24809, 2024.
  6. [Deng et al., 2009] Jia Deng, Wei Dong, Richard Socher, Li- Jia Li, Kai Li, and Li Fei-Fei. ImageNet: A Large- Scale Hierarchical Image Database. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 248-255. Ieee, 2009.
  7. [Dosovitskiy et al., 2020] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Min- derer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  8. [Gao et al., 2023] Kuofeng Gao, Yang Bai, Jindong Gu, Yong Yang, and Shu-Tao Xia. Backdoor defense via adap- tively splitting poisoned dataset. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4005-4014, 2023.
  9. [Gao et al., 2024] Yudong Gao, Honglong Chen, Peng Sun, Junjian Li, Anqing Zhang, Zhibo Wang, and Weifeng Liu. A dual stealthy backdoor: From both spatial and frequency perspectives. In Thirty-Eighth AAAI Conference on Arti- ficial Intelligence, AAAI 2024, Vancouver, Canada, pages 1851-1859. AAAI Press, 2024.
  10. [Gu et al., 2017] Tianyu Gu, Brendan Dolan-Gavitt, and Sid- dharth Garg. Badnets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain. arXiv preprint arXiv:1708.06733, 2017.
  11. [He et al., 2016a] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 770- 778, 2016.
  12. [He et al., 2016b] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Identity mappings in deep residual networks. In Computer Vision-ECCV 2016: 14th Euro- pean Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part IV 14, pages 630-645. Springer, 2016.
  13. [Huang et al., 2022] Kunzhe Huang, Yiming Li, Baoyuan Wu, Zhan Qin, and Kui Ren. Backdoor Defense via De- coupling the Training Process. In The Tenth International Conference on Learning Representations, 2022.
  14. [Jin et al., 2023] Yan Jin, Fang Gao, Jun Yu, Jiabao Wang, and Feng Shuang. Multi-object tracking: Decoupling fea- tures to solve the contradictory dilemma of feature require- ments. IEEE Transactions on Circuits and Systems for Video Technology, 33(9):5117-5132, 2023.
  15. [Li et al., 2021a] Yige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu, Bo Li, and Xingjun Ma. Anti-Backdoor Learning: Training Clean Models on Poisoned Data. Advances in Neural Information Processing Systems, 34:14900-14912, 2021.
  16. [Li et al., 2021b] Yige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu, Bo Li, and Xingjun Ma. Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networks. In International Conference on Learning Rep- resentations, 2021.
  17. [Li et al., 2021c] Yuezun Li, Yiming Li, Baoyuan Wu, Longkang Li, Ran He, and Siwei Lyu. Invisible Backdoor Attack With Sample-Specific Triggers. In Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 16463-16472, 2021.
  18. [Liu et al., 2018] Kang Liu, Brendan Dolan-Gavitt, and Sid- dharth Garg. Fine-Pruning: Defending Against Backdoor- ing Attacks on Deep Neural Networks. In International Symposium on Research in Attacks, Intrusions, and De- fenses, pages 273-294. Springer, 2018.
  19. [Liu et al., 2023] Qin Liu, Fei Wang, Chaowei Xiao, and Muhao Chen. From shortcuts to triggers: Back- door defense with denoised poe. arXiv preprint arXiv:2305.14910, 2023.
  20. [Lv et al., 2023] Peizhuo Lv, Chang Yue, Ruigang Liang, Yunfei Yang, Shengzhi Zhang, Hualong Ma, and Kai Chen. A data-free backdoor injection approach in neural networks. In 32nd USENIX Security Symposium (USENIX Security 23), pages 2671-2688, 2023.
  21. [Mkadry et al., 2017] Aleksander Mkadry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. Towards deep learning models resistant to adversarial attacks. stat, 1050(9), 2017.
  22. [Mu et al., 2023] Bingxu Mu, Zhenxing Niu, Le Wang, Xue Wang, Qiguang Miao, Rong Jin, and Gang Hua. Progres- sive backdoor erasing via connecting backdoor and adver- sarial attacks. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 20495-20503, 2023.
  23. [Nguyen and Tran, 2020] Tuan Anh Nguyen and Anh Tran. Input-Aware Dynamic Backdoor Attack. Advances in Neu- ral Information Processing Systems, 33:3454-3464, 2020.
  24. [Nguyen and Tran, 2021] Anh Nguyen and Anh Tran. WaNet-Imperceptible Warping-based Backdoor Attack. arXiv preprint arXiv:2102.10369, 2021.
  25. [Shah et al., 2020] Harshay Shah, Kaustav Tamuly, Aditi Raghunathan, Prateek Jain, and Praneeth Netrapalli. The pitfalls of simplicity bias in neural networks. Advances in Neural Information Processing Systems, 33:9573-9585, 2020.
  26. [Simonyan and Zisserman, 2014] Karen Simonyan and An- drew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
  27. [Stallkamp et al., 2011] Johannes Stallkamp, Marc Schlips- ing, Jan Salmen, and Christian Igel. The german traffic sign recognition benchmark: a multi-class classification competition. In The 2011 international joint conference on neural networks, pages 1453-1460. IEEE, 2011.
  28. [Subramanya et al., 2024] Akshayvarun Subramanya, Soroush Abbasi Koohpayegani, Aniruddha Saha, Ajinkya Tejankar, and Hamed Pirsiavash. A closer look at robustness of vision transformers to backdoor attacks. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3874-3883, 2024.
  29. [Tang et al., 2023] Ruixiang Ryan Tang, Jiayi Yuan, Yiming Li, Zirui Liu, Rui Chen, and Xia Hu. Setting the trap: Capturing and defeating backdoors in pretrained language models through honeypots. Advances in Neural Informa- tion Processing Systems, 36:73191-73210, 2023.
  30. [Turner et al., 2019] Alexander Turner, Dimitris Tsipras, and Aleksander Madry. Label-Consistent Backdoor Attacks. arXiv preprint arXiv:1912.02771, 2019.
  31. [Wang et al., 2019] Bolun Wang, Yuanshun Yao, Shawn Shan, Huiying Li, Bimal Viswanath, Haitao Zheng, and Ben Y Zhao. Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural Networks. In 2019 IEEE Sym- posium on Security and Privacy, pages 707-723. IEEE, 2019.
  32. [Wang et al., 2020] Yue Wang, Alireza Fathi, Abhijit Kundu, David A Ross, Caroline Pantofaru, Tom Funkhouser, and Justin Solomon. Pillar-Based Object Detection for Au- tonomous Driving. In European Conference on Computer Vision, pages 18-34. Springer, 2020.
  33. [Wang et al., 2021] Yanling Wang, Jing Zhang, Shasha Guo, Hongzhi Yin, Cuiping Li, and Hong Chen. Decoupling representation learning and classification for gnn-based anomaly detection. In Proceedings of the 44th interna- tional ACM SIGIR conference on research and develop- ment in information retrieval, pages 1239-1248, 2021.
  34. [Wang et al., 2022] Haotao Wang, Junyuan Hong, Aston Zhang, Jiayu Zhou, and Zhangyang Wang. Trap and re- place: Defending backdoor attacks by trapping them into an easy-to-replace subnetwork. Advances in neural infor- mation processing systems, 35:36026-36039, 2022.
  35. [Wei et al., 2024] Shaokui Wei, Hongyuan Zha, and Baoyuan Wu. Mitigating backdoor attack by injecting proactive defensive backdoor. Advances in Neural Information Processing Systems, 37:80674-80705, 2024.
  36. [Woo et al., 2018] Sanghyun Woo, Jongchan Park, Joon- Young Lee, and In So Kweon. Cbam: Convolutional block attention module. In Proceedings of the European confer- ence on computer vision (ECCV), pages 3-19, 2018.
  37. [Wu et al., 2025] Zhixiao Wu, Yao Lu, Jie Wen, Hao Sun, Qi Zhou, and Guangming Lu. A set of generalized com- ponents to achieve effective poison-only clean-label back- door attacks with collaborative sample selection and trig- gers. In Advances in Neural Information Processing Sys- tems, 2025.
  38. [Yang and Yang, 2022] Zongxin Yang and Yi Yang. Decou- pling features in hierarchical propagation for video object segmentation. Advances in Neural Information Processing Systems, 35:36324-36336, 2022.
  39. [Yang et al., 2023] Sheng Yang, Yiming Li, Yong Jiang, and Shu-Tao Xia. Backdoor defense via suppressing model shortcuts. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1-5. IEEE, 2023.
  40. [Yu et al., 2025] Hongrui Yu, Lu Qi, Wanyu Lin, Jian Chen, Hailong Sun, and Chengbin Sun. Backdoor defense via enhanced splitting and trap isolation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1708-1717, 2025.
  41. [Zagoruyko, 2016] Sergey Zagoruyko. Wide residual net- works. arXiv preprint arXiv:1605.07146, 2016.
  42. [Zeng et al., 2023] Yi Zeng, Minzhou Pan, Hoang Anh Just, Lingjuan Lyu, Meikang Qiu, and Ruoxi Jia. Narcissus: A practical clean-label backdoor attack with limited infor- mation. In Proceedings of the 2023 ACM SIGSAC Confer- ence on Computer and Communications Security, pages 771-785, 2023.
  43. [Zhang et al., 2020] Yuyang Zhang, Shibiao Xu, Baoyuan Wu, Jian Shi, Weiliang Meng, and Xiaopeng Zhang. Unsu- pervised Multi-View Constrained Convolutional Network for Accurate Depth Estimation. IEEE Transactions on Im- age Processing, 29:7019-7031, 2020.
  44. [Zhang et al., 2023] Zaixi Zhang, Qi Liu, Zhicai Wang, Zepu Lu, and Qingyong Hu. Backdoor defense via decon- founded representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12228-12238, 2023.
  45. [Zhu et al., 2023] Zixuan Zhu, Rui Wang, Cong Zou, and Li- hua Jing. The victim and the beneficiary: Exploiting a poisoned model to train a clean model on poisoned data. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 155-164, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards