CARBEN: Composite Adversarial Robustness Benchmark

Lei Hsiung, Yun-Yun Tsai, Pin-Yu Chen, Tsung-Yi Ho

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence

Demo Track. Pages 5908-5911.

https://doi.org/10.24963/ijcai.2022/851

PDF BibTeX Video

Abstract

Prior literature on adversarial attack methods has mainly focused on attacking with and defending against a single threat model, e.g., perturbations bounded in Lp ball. However, multiple threat models can be combined into composite perturbations. One such approach, composite adversarial attack (CAA), not only expands the perturbable space of the image, but also may be overlooked by current modes of robustness evaluation. This paper demonstrates how CAA's attack order affects the resulting image, and provides real-time inferences of different models, which will facilitate users' configuration of the parameters of the attack level and their rapid evaluation of model prediction. A leaderboard to benchmark adversarial robustness against CAA is also introduced.

Keywords

  • Humans and AI: Computer-Aided Education
  • AI Ethics, Trust, Fairness: Explainability and Interpretability
  • Humans and AI: Human-Computer Interaction
  • Machine Learning: Robustness
  • Multidisciplinary Topics and Applications: Web and Social Networks
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards