journal article·2022Open access

Towards Securing Machine Learning Models Against Membership Inference Attacks

Sana Ben Hamida, Hichem Mrabet, Sana Belguith, Adeeb Alhomoud, Abderrazak Jemai

Computers, Materials & Continua· Volume 70· Issue 3

Abstract

From fraud detection to speech recognition, including price prediction, Machine Learning (ML) applications are manifold and can significantly improve different areas. Nevertheless, machine learning models are vulnerable and are exposed to different security and privacy attacks. Hence, these issues should be addressed while using ML models to preserve the security and privacy of the data used. There is a need to secure ML models, especially in the training phase to preserve the privacy of the training datasets and to minimise the information leakage. In this paper, we present an overview of ML threats and vulnerabilities, and we highlight current progress in the research works proposing defence techniques against ML security and privacy attacks. The relevant background for the different attacks occurring in both the training and testing/inferring phases is introduced before presenting a detailed overview of Membership Inference Attacks (MIA) and the related countermeasures. In this paper, we introduce a countermeasure against membership inference attacks (MIA) on Conventional Neural Networks (CNN) based on dropout and L2 regularization. Through experimental analysis, we demonstrate that this defence technique can mitigate the risks of MIA attacks while ensuring an acceptable accuracy of the model. Indeed, using CNN model training on two datasets CIFAR-10 and CIFAR-100, we empirically verify the ability of our defence strategy to decrease the impact of MIA on our model and we compare results of five different classifiers. Moreover, we present a solution to achieve a trade-off between the performance of the model and the mitigation of MIA attack.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Adversarial Robustness in Machine Learning · Privacy-Preserving Technologies in Data · Advanced Malware Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. A survey of IoT security based on a layered architecture of sensing and data analysis10.3390/s20133625 ↗
2. A survey on the usage of blockchain technology for cyber-threats in the context of industry 4.010.3390/su12219179 ↗
3. A survey on security threats and defensive techniques of machine learning: A data driven view10.1109/ACCESS.2018.2805680 ↗
4. Automated poisoning attacks and defenses in malware detection systems: An adversarial machine learning approach10.1016/j.cose.2017.11.007 ↗
5. A. Polyakov, “How to attack machine learning (evasion, poisoning, inference, trojans, backdoors),” Aug. 06, 2019. [Online]. Available: https://towardsdatascience.com/how-to-attack-machine-learning-evasion-poisoning-inference-trojans-backdoors-a7cb5832595c. Accessed: April 22, 2021.
6. IMPACT: Impersonation attack detection via edge computing using deep autoencoder and feature abstraction10.1109/ACCESS.2020.2985089 ↗
7. S. Chen, R. Jia and G.-J. Qi, “Improved techniques for model inversion attacks,” arXiv preprint, arXiv: 2010.04092 [cs], Oct. 2020, Accessed: Mar. 25, 2021.
8. Membership inference attacks against machine learning models,
9. Overfitting, robustness, and malicious algorithms: A study of potential causes of privacy risk in machine Learning10.3233/JCS-191362 ↗
10. Security evaluation of pattern classifiers under attack10.1109/TKDE.2013.57 ↗
11. Sok: Towards the science of security and privacy in machine learning
12. A taxonomy and survey of attacks against machine learning10.1016/j.cosrev.2019.100199 ↗
13. ML-Leaks: Model and data independent membership inference attacks and defenses on machine learning models
14. Machine learning with membership privacy using adversarial regularization10.1145/3243734.3243855 ↗
15. LOGAN: Membership inference attacks against generative models
16. Machine learning security: Threats, countermeasures, and evaluations10.1109/ACCESS.2020.2987435 ↗
17. Review of artificial intelligence adversarial attack and defense technologies10.3390/app9050909 ↗
18. Dropout: A simple way to prevent neural networks from overfitting
19. Privacy risk in machine learning: Analyzing the connection to overfitting
20. M. Lomnitz, N. Lopatina, P. Gamble, Z. Hampel-Arias, L. Tindall et al., “Reducing audio membership inference attack accuracy to chance: 4 defenses’, arXiv preprint, arXiv: 1911.01888 [cs, Eess], Oct. 2019.
21. Adversarial machine learning
22. Misleading learners: Co-opting your spam filter,
23. R. Laishram and V. V. Phoha, “Curie: A method for protecting SVM classifier from poisoning attack,” arXiv preprint, arXiv arXiv: 1606.01584 [cs], Jun. 2016, Accessed: April, 2021.
24. Yes, machine learning can be more secure! a case study on android malware detection
25. Nash equilibria of static prediction games
26. Randomized prediction games for adversarial machine Learning
27. Generating natural adversarial examples,”
28. Status report on the first round of the NIST post-quantum cryptography standardization process
29. Differential privacy
30. J. Chen, W. H. Wang and X. Shi, “Differential privacy protection against membership inference attack on machine learning for genomic data,” bioRxiv, World Scientific, 2020.10.1101/2020.08.03.235416 ↗
31. ANTIDOTE: Understanding and defending against poisoning of anomaly detectors
32. Evasion attacks against machine learning at test time,
33. Nightmare at test time: Robust learning by feature deletion
34. A scalable modular convex solver for regularized risk minimization
35. Generalized nash equilibrium problems10.1007/s10479-009-0653-x ↗
36. “CIFAR-10 and CIFAR-100 datasets,” [Online]. Available: https://www.cs.toronto.edu/~kriz/cifar.html, Accessed: Dec. 30, 2020.
37. Improvement of learning for CNN with ReLU activation by sparse regularization
38. “Introducing TensorFlow Privacy: Learning with Differential Privacy for Training Data,” [Online]. Available: https://github.com/tensorflow/privacy, Accessed: Dec. 30, 2020.
39. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever and R. R. Salakhutdinov, “Improving neural networks by preventing co-adaptation of feature detectors,” arXiv preprint arXiv: 1207.0580 [cs], Jul. 2012.
40. von Stackelberg · Market Structure and Equilibrium · 2010