journal article·2025Open access

A Black-Box Speech Adversarial Attack Method Based on Enhanced Neural Predictors in Industrial IoT

Yun Zhang, Zhenhua Yu, Xufei Hu, Xuya Cong, Ou Ye

Computers, Materials & Continua· Volume 84· Issue 3

Abstract

Devices in Industrial Internet of Things are vulnerable to voice adversarial attacks. Studying adversarial speech samples is crucial for enhancing the security of automatic speech recognition systems in Industrial Internet of Things devices. Current black-box attack methods often face challenges such as complex search processes and excessive perturbation generation. To address these issues, this paper proposes a black-box voice adversarial attack method based on enhanced neural predictors. This method searches for minimal perturbations in the perturbation space, employing an optimization process guided by a self-attention neural predictor to identify the optimal perturbation direction. This direction is then applied to the original sample to generate adversarial samples. To improve search efficiency, a pruning strategy is designed to discard samples below a threshold in the early search stages, reducing the number of searches. Additionally, a dynamic factor based on feedback from querying the automatic speech recognition system is introduced to adaptively adjust the search step size, further accelerating the search process. To validate the performance of the proposed method, experiments are conducted on the LibriSpeech dataset. Compared with the mainstream methods, the proposed method improves the signal-to-noise ratio by 0.8 dB, increases sample similarity by 0.43%, and reduces the average number of queries by 7%. Experimental results demonstrate that the proposed method offers better attack effectiveness and stealthiness.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (29)

Show source-provided references
1. The spiking neural network based on fMRI for speech recognition10.1016/j.patcog.2024.110672 ↗
2. APFT: adaptive phoneme filter template to generate anti-compression speech adversarial example in real-time10.1109/TIFS.2025.3573182 ↗
3. Adversarial attack and defense strategies for deep speaker recognition systems10.1016/j.csl.2021.101199 ↗
4. Improving the security of audio captchas with adversarial examples10.1109/TDSC.2023.3236367 ↗
5. A method for generating speech adversarial examples using conditional generative adversarial networks
6. Generating transferable adversarial examples for speech classification10.1016/j.patcog.2022.109286 ↗
7. Imperio: robust over-the-air adversarial examples for automatic speech recognition systems
8. Adversarial example detection techniques in speech recognition systems: a review
9. Imperceptible black-box waveform-level adversarial attack towards automatic speaker recognition10.1007/s40747-022-00782-x ↗
10. Multi-targeted audio adversarial example for use against speech recognition systems10.1016/j.cose.2023.103168 ↗
11. Targeted adversarial examples for black box audio systems
12. Audio adversarial attack: HIS attack
13. Generating black-box audio adversarial CAPTCHAs based on differential evolution algorithm
14. Your voice is not yours? Black-box adversarial attacks against speaker recognition systems
15. Crafting adversarial examples for speech paralinguistics applications
16. Robust audio adversarial example for a physical attack
17. Houdini: fooling deep structured visual and speech recognition models with adversarial examples
18. Audio adversarial examples: targeted attacks on speech-to-text
19. Query-efficient adversarial attack with low perturbation against end-to-end speech recognition systems10.1109/TIFS.2022.3222963 ↗
20. A systematic approach for practical adversarial voice recognition
21. Fooling end-to-end speaker verification with adversarial examples
22. Khare S, Aralikatte R, Mani S. Adversarial black-box attacks on automatic speech recognition systems using multi-objective evolutionary optimization. arXiv:1811.01312. 2018.10.21437/Interspeech.2019-2420 ↗
23. The Kaldi speech recognition toolkit
24. Imperceptible, robust, and targeted adversarial examples for automatic speech recognition
25. Biolková M, Nguyen B. Neural predictor for black-box adversarial attacks on speech recognition. arXiv:2203.09849. 2022.
26. Sirenattack: generating adversarial audio for end-to-end acoustic systems
27. Wu S, Wang J, Ping W, Nie W, Xiao C. Defending against adversarial audio via diffusion model. arXiv:2303.01507. 2023.
28. Olivier R, Abdullah H, Raj B. Watch what you pretrain for: targeted, transferable adversarial examples on self-supervised speech recognition models. arXiv:2209.13523. 2022.
29. Bayesopt adversarial attack