Model-Agnostic Adversarial Detection by Random Perturbations

Bo Huang, Yi Wang, Wei Wang

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence

Main track. Pages 4689-4696.

https://doi.org/10.24963/ijcai.2019/651

PDF BibTeX

Abstract

Adversarial examples induce model classification errors on purpose, which has raised concerns on the security aspect of machine learning techniques. Many existing countermeasures are compromised by adaptive adversaries and transferred examples. We propose a model-agnostic approach to resolve the problem by analysing the model responses to an input under random perturbations, and study the robustness of detecting norm-bounded adversarial distortions in a theoretical framework. Extensive evaluations are performed on the MNIST, CIFAR-10 and ImageNet datasets. The results demonstrate that our detection method is effective and resilient against various attacks including black-box attacks and the powerful CW attack with four adversarial adaptations.

Keywords

  • Multidisciplinary Topics and Applications: Security and Privacy
  • Machine Learning: Adversarial Machine Learning
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards