journal article·2024-01-02

Defence algorithm against adversarial example based on local perturbation DAT-LP

Jun Tang, Yuchen Huang, Zhi Mou, Shiyu Wang, Yuanyuan Zhang, Bing Guo

Publisher page

Abstract

With further research into neural networks, their scope of application is becoming increasingly extensive. Among these, more neural network models are used in text classification tasks and have achieved excellent results. However, the crucial issue of derived adversarial examples has dramatically affected the stability and robustness of the neural network model. This issue confines the further expansion of the neural network application, especially in some security-sensitive tasks. Concerning the text classification task, our proposed DAT-LP (Defence with Adversarial Training Based on Local Perturbation) algorithm is designed to address the adversarial example issue, which uses local perturbation to enhance model performance based on adversarial training. Furthermore, SW-CStart (Cold-start Algorithm Based on Sliding Window) algorithm is designed to realise adversarial training in the model’s initialisation stage. The DAT-LP algorithm is evaluated by comparing with three baselines, including baseline models (BiLSTM, TextCNN), Dropout(regularisation method), and ADT (Adversarial Training method), respectively. As it turns out, DAT-LP’s performance is superior and demonstrates the best generalisation ability.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Adversarial Robustness in Machine Learning · Advanced Malware Detection Techniques · Bacillus and Francisella bacterial research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science, Sichuan University, Chengdu, China

Business Centre, Sichuan GreatWall Computer System Co.,Ltd, Luzhou, China

Funding

National Natural Science Foundation of China · Sichuan Science and Technology Program

References (32)

Show source-provided references
1. 10.1080/10589759.2014.100283910.1080/10589759.2014.1002839 ↗
2. 10.21203/rs.3.rs-2610874/v110.21203/rs.3.rs-2610874/v1 ↗
3. 10.1080/10589759.2023.216928510.1080/10589759.2023.2169285 ↗
4. 10.1080/10589759.2023.219564610.1080/10589759.2023.2195646 ↗
5. 10.1007/978-981-19-5868-7_3610.1007/978-981-19-5868-7_36 ↗
6. 10.48550/arXiv.1312.619910.48550/arXiv.1312.6199 ↗
7. 10.48550/arXiv.1412.657210.48550/arXiv.1412.6572 ↗
8. 10.1109/MILCOM.2016.779530010.1109/MILCOM.2016.7795300 ↗
9. Wang W, Tang B, Wang R, et al. A survey on adversarial attacks and defenses in text. arXiv Preprint. 2019 arXiv:1902.07285 1–13 .
10. 10.24963/ijcai.2018/58510.24963/ijcai.2018/585 ↗
11. 10.1109/SPW.2018.0001610.1109/SPW.2018.00016 ↗
12. 10.48550/arXiv.1605.0772510.48550/arXiv.1605.07725 ↗
13. 10.1145/1161366.116139710.1145/1161366.1161397 ↗
14. Goodfellow I, Bengio Y, Courville A Dropout. Deep learning. 2016 7.12 (MIT press) 249–251 .
15. 10.48550/arXiv.1712.0675110.48550/arXiv.1712.06751 ↗
16. 10.1609/aaai.v31i1.1097010.1609/aaai.v31i1.10970 ↗
17. 10.48550/arXiv.1905.1126810.48550/arXiv.1905.11268 ↗
18. 10.48550/arXiv.1705.0720410.48550/arXiv.1705.07204 ↗
19. 10.1109/EuroSP.2016.3610.1109/EuroSP.2016.36 ↗
20. Bastani O, Ioannou Y, Lampropoulos L, et al. Measuring neural net robustness with constraints. Advances in neural information processing systems. 2016 29 1–9 .
21. 10.1609/aaai.v32i1.1220610.1609/aaai.v32i1.12206 ↗
22. 10.48550/arXiv.1507.0067710.48550/arXiv.1507.00677 ↗
23. 10.48550/arXiv.1908.0712510.48550/arXiv.1908.07125 ↗
24. 10.1145/3132747.313278510.1145/3132747.3132785 ↗
25. 10.1109/TIFS.2020.302189910.1109/TIFS.2020.3021899 ↗
26. 10.1109/ICSE.2019.0010810.1109/ICSE.2019.00108 ↗
27. Weng L, Zhang H, Chen H, et al. Towards fast computation of certified robustness for relu networks Proceedings of Machine Learning Research Stockholmsmässan, Stockholm, Sweden. 2018 80 5276-–5285 .
28. 10.1007/978-1-4842-5364-9_210.1007/978-1-4842-5364-9_2 ↗
29. Gulli A, Pal S Deep learning with Keras. 2017.
30. Abadi M, Barham P, Chen J, et al. {Tensorflow}: a system for {large-scale} machine learning. 12th (USENIX) Symposium on Operating Systems Design and Implementation (OSDI) Savannah, GA, USA, 16:265–283, 2016.
31. 10.48550/arXiv.1805.0650410.48550/arXiv.1805.06504 ↗
32. 10.48550/arXiv.1408.588210.48550/arXiv.1408.5882 ↗