SAMI-FGSM: Towards Transferable Attacks with Stochastic Gradient Accumulation
Source abstract
Abstract
Deep neural networks remain susceptible to adversarial examples, where the goal of an adversarial attack is to introduce small perturbations to the original examples in order to confuse the model without being easily detected. Although many adversarial attack methods produce adversarial examples that have achieved great results in the white-box setting, they exhibit low transferability in the black-box setting. In order to improve the transferability along the baseline of the gradient-based attack technique, we present a novel Stochastic Gradient Accumulation Momentum Iterative Attack (SAMI-FGSM) in this study. In particular, during each iteration, the gradient information is calculated using a normal sampling approach that randomly samples around the sample points, with the highest probability of capturing adversarial features. Meanwhile, the accumulated information of the sampled gradient from the previous iteration is further considered to modify the current updated gradient, and the original gradient attack direction is changed to ensure that the updated gradient direction is more stable. Comprehensive experiments conducted on the ImageNet dataset show that our method outperforms existing state-of-the-art gradient-based attack techniques, achieving an average improvement of 10.2% in transferability.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Adversarial Robustness in Machine Learning · Advanced Memory and Neural Computing · Stochastic Gradient Optimization Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. Imagenet classification with deep convolutional neural networks
2. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. 2014.
3. Micron-BERT: BERT-based facial micro-expression recognition
4. Physical-world optical adversarial attacks on 3D face recognition
5. VAD: vectorized scene representation for efficient autonomous driving
6. DriveAdapter: breaking the coupling barrier of perception and planning in end-to-end autonomous driving
7. Ada3D: exploiting the spatial redundancy with adaptive inference for efficient 3D object detection
8. Composite adversarial attacks
9. Towards large yet imperceptible adversarial image perturbations with perceptual color distance
10. GLH: from global to local gradient attacks with high-frequency momentum guidance for object detection10.3390/e25030461 ↗
11. Enhancing the transferability of adversarial attacks through variance tuning
12. Wang G, Wei X, Yan H. Improving adversarial transferability with spatial momentum. arXiv:2203.13479. 2022.
13. Goodfellow IJ, Shlens J, Szegedy C. Explaining and harnessing adversarial examples. arXiv:1412.6572. 2014.
14. Boosting adversarial attacks with momentum
15. Lin J, Song C, He K, Wang L, Hopcroft JE. Nesterov accelerated gradient and scale invariance for adversarial attacks. arXiv:1908.06281. 2019.
16. Boosting the transferability of adversarial attacks with global momentum initialization10.1016/j.eswa.2024.124757 ↗
17. Yet another intermediate-level attack
18. Frequency domain model augmentation for adversarial attack
19. Yang X, Lin J, Zhang H, Yang X, Zhao P. Improving the transferability of adversarial examples via direction tuning. arXiv:2303.15109. 2023.10.1016/j.ins.2023.119491 ↗
20. Feature importance-aware transferable adversarial attacks
21. Enhancing adversarial example transferability with an intermediate level attack
22. Boosting adversarial transferability via gradient relevance attack
23. Evading defenses to transferable adversarial examples by translation-invariant attacks
24. Improving transferability of adversarial examples with input diversity
25. Zhang H, Yao Z, Sakurai K. Versatile defense against adversarial attacks on image recognition. arXiv:2403.08170. 2024.10.3390/app14188119 ↗
26. Tramèr F, Kurakin A, Papernot N, Goodfellow I, Boneh D, McDaniel P. Ensemble adversarial training: attacks and defenses. arXiv:1705.07204. 2017.
27. Shafahi A, Najibi M, Ghiasi MA, Xu Z, Dickerson J, Studer C, et al. Adversarial training for free! In: Advances in neural information processing systems; 2019. doi:10.48550/arXiv.1904.12843.
28. Attribute-guided adversarial training for robustness to natural perturbations
29. A self-supervised approach for adversarial robustness
30. Xu W. Feature squeezing: detecting adversarial examples in deep neural networks. arXiv:1704.01155. 2017.10.14722/ndss.2018.23198 ↗
31. Feature distillation: DNN-oriented JPEG compression against adversarial examples
32. Kurakin · Artificial intelligence safety and security · 2018 · 9910.1201/9781351251389-8 ↗
33. Enhancing the self-universality for transferable targeted attacks
34. Grad-cam: visual explanations from deep networks via gradient-based localization
35. Rethinking the inception architecture for computer vision
36. Inception-V4, Inception-ResNet and the impact of residual connections on learning
37. Deep residual learning for image recognition
38. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv: 2010.11929. 2020.
39. Rethinking spatial dimensions of vision transformers
40. Visformer: the vision-friendly transformer
41. Swin transformer: hierarchical vision transformer using shifted windows
42. Xie C, Wang J, Zhang Z, Ren Z, Yuille A. Mitigating adversarial effects through randomization. arXiv:1711.01991. 2017.
43. Defense against adversarial attacks using high-level representation guided denoiser
44. Certified adversarial robustness via randomized smoothing
45. Improving the transferability of adversarial examples through neighborhood attribution10.1016/j.knosys.2024.111909 ↗
46. Improving adversarial transferability via neuron attribution-based attacks
47. Enhancing the transferability of adversarial attacks via multi-feature attention10.1109/TIFS.2025.3526067 ↗
48. Liu Y, Chen X, Liu C, Song D. Delving into transferable adversarial examples and black-box attacks. arXiv:1611.02770. 2016.
49. Survey on adversarial attack and defense for medical image analysis: methods and challenges10.1145/3702638 ↗
50. Physical adversarial attacks on an aerial imagery object detector