journal article·2025-03-17Open access

A Symmetric Projection Space and Adversarial Training Framework for Privacy-Preserving Machine Learning with Improved Computational Efficiency

Qianqian Li, Shutian Zhou, Xiangrong Zeng, Jiaqi Shi, Qianye Lin, Chenjia Huang, Yuchen Yue, Yuyao Jiang, Chunli Lv

Applied Sciences· Volume 15· Issue 6

Abstract

This paper proposes a data security training framework based on symmetric projection space and adversarial training, aimed at addressing the issues of privacy leakage and computational efficiency encountered by current privacy protection technologies when processing sensitive data. By designing a new projection loss function and combining autoencoders with adversarial training, the proposed method effectively balances privacy protection and model utility. Experimental results show that, for financial time-series data tasks, the model using the projection loss achieves a precision of 0.95, recall of 0.91, and accuracy of 0.93, significantly outperforming the traditional cross-entropy loss. In image data tasks, the projection loss yields a precision of 0.93, recall of 0.90, accuracy of 0.91, and mAP@50 and mAP@75 of 0.91 and 0.90, respectively, demonstrating its strong advantage in complex tasks. Furthermore, experiments on different hardware platforms (Raspberry Pi, Jetson, and NVIDIA 3080 GPU) show that the proposed method performs well on low-computation devices and exhibits significant advantages on high-performance GPUs, particularly in terms of computational efficiency, demonstrating good scalability and efficiency. The experimental results validate the superiority of the proposed method in terms of data privacy protection and computational efficiency.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · Adversarial Robustness in Machine Learning · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

China Agricultural University, Beijing 100083, China

Beijing Foreign Studies University, Beijing 100089, China

University of International Business and Economics, Beijing 100029, China

China University of Political Science and Law, Beijing 102249, China

Peking University, Beijing 100871, China

Funding

National Natural Science Foundation of China

References (50)

Show source-provided references
1. Data security and privacy protection for cloud storage: A survey10.1109/ACCESS.2020.3009876 ↗
2. Li, Q., and Zhang, Y. (2024, January 5–7). Confidential Federated Learning for Heterogeneous Platforms against Client-Side Privacy Leakages. Proceedings of the ACM Turing Award Celebration Conference 2024, Changsha, China.10.1145/3674399.3674484 ↗
3. Secure, privacy-preserving and federated machine learning in medical imaging10.1038/s42256-020-0186-1 ↗
4. Data privacy laws and their impact on financial technology companies: A review
5. Ethics of artificial intelligence in education: Student privacy and data protection10.15354/sief.23.re202 ↗
6. How to dp-fy ml: A practical guide to machine learning with differential privacy10.1613/jair.1.14649 ↗
7. Jin, W., Yao, Y., Han, S., Gu, J., Joe-Wong, C., Ravi, S., Avestimehr, S., and He, C. (2023). FedML-HE: An efficient homomorphic-encryption-based privacy-preserving federated learning system. arXiv.
8. When federated learning meets privacy-preserving computation10.1145/3679013 ↗
9. Ppefl: Privacy-preserving edge federated learning with local differential privacy10.1109/JIOT.2023.3264259 ↗
10. Li, Q., Zhang, Y., Ren, J., Li, Q., and Zhang, Y. (2024). You Can Use But Cannot Recognize: Preserving Visual Privacy in Deep Neural Networks. arXiv.10.14722/ndss.2024.241361 ↗
11. Li, Q., Ren, J., Zhang, Y., Song, C., Liao, Y., and Zhang, Y. (2023, January 9–13). Privacy-Preserving DNN Training with Prefetched Meta-Keys on Heterogeneous Neural Network Accelerators. Proceedings of the 2023 60th ACM/IEEE Design Automation Conference (DAC), San Francisco, CA, USA.10.1109/DAC56929.2023.10247964 ↗
12. Yan, Y., Wang, X., Ligeti, P., and Jin, Y. DP-FSAEA: Differential Privacy for Federated Surrogate-Assisted Evolutionary Algorithms. IEEE Trans. Evol. Comput., 2024.10.1109/TEVC.2024.3391003 ↗
13. Wang, G., Li, C., Dai, B., and Zhang, S. (2024). Privacy-Protection Method for Blockchain Transactions Based on Lightweight Homomorphic Encryption. Information, 15.10.3390/info15080438 ↗
14. FedSHE: Privacy preserving and efficient federated learning with adaptive segmented CKKS homomorphic encryption10.1186/s42400-024-00232-w ↗
15. Efficiency optimization techniques in privacy-preserving federated learning with homomorphic encryption: A brief survey10.1109/JIOT.2024.3382875 ↗
16. Score-based generative modeling in latent space
17. Zhang, Y., Wa, S., Zhang, L., and Lv, C. (2022). Automatic plant disease detection based on tranvolution detection network with GAN modules using leaf images. Front. Plant Sci., 13.10.3389/fpls.2022.875693 ↗
18. Wang, Y., Yang, D., Bremond, F., and Dantcheva, A. (2022). Latent image animator: Learning to animate images via latent space navigation. arXiv.
19. Kwon, M., Jeong, J., and Uh, Y. (2022). Diffusion models already have a semantic latent space. arXiv.
20. Chen, X., Jiang, B., Liu, W., Huang, Z., Fu, B., Chen, T., and Yu, G. (2023, January 17–24). Executing your commands via motion diffusion in latent space. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01726 ↗
21. Learning latent space energy-based prior model
22. Local latent space bayesian optimization over structured inputs
23. Zhang, Y., Wa, S., Liu, Y., Zhou, X., Sun, P., and Ma, Q. (2021). High-accuracy detection of maize leaf diseases CNN based on multi-pathway activation function module. Remote Sens., 13.10.3390/rs13214218 ↗
24. Wu, C.H., and De la Torre, F. (2023, January 2–3). A latent space of stochastic diffusion models for zero-shot image editing and guidance. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00678 ↗
25. Tzelepis, C., Tzimiropoulos, G., and Patras, I. (2021, January 11–17). Warpedganspace: Finding non-linear rbf paths in gan latent space. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00633 ↗
26. Ramaswamy, V.V., Kim, S.S., and Russakovsky, O. (2021, January 20–25). Fair attribute classification through latent space de-biasing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00918 ↗
27. Pang, B., and Wu, Y.N. Latent space energy-based model of symbol-vector coupling for text generation and classification. Proceedings of the International Conference on Machine Learning, PMLR, Online.
28. Chen, L., Li, J., Peng, J., Xie, T., Cao, Z., Xu, K., He, X., Zheng, Z., and Wu, B. (2020). A survey of adversarial learning on graphs. arXiv.
29. Federated transfer learning for intelligent fault diagnostics using deep adversarial networks with data privacy10.1109/TMECH.2021.3065522 ↗
30. Federated multi-source domain adversarial adaptation framework for machinery fault diagnosis with data privacy10.1016/j.ress.2023.109246 ↗
31. Croce, D., Castellucci, G., and Basili, R. (2020, January 5–10). GAN-BERT: Generative adversarial learning for robust text classification with a bunch of labeled examples. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.191 ↗
32. Privacy-preserving deep action recognition: An adversarial learning framework and a new dataset10.1109/TPAMI.2020.3026709 ↗
33. Adversarial learning of privacy-preserving and task-oriented representations10.1609/aaai.v34i07.6930 ↗
34. Privacy and security issues in deep learning: A survey10.1109/ACCESS.2020.3045078 ↗
35. Autoencoder-based representation learning and its application in intelligent fault diagnosis: A review10.1016/j.measurement.2021.110460 ↗
36. A review on autoencoder based representation learning for fault detection and diagnosis in industrial processes10.1016/j.chemolab.2022.104711 ↗
37. NVAE: A deep hierarchical variational autoencoder
38. TinySegformer: A lightweight visual segmentation model for real-time agricultural pest detection10.1016/j.compag.2024.108740 ↗
39. A time-series neural network for pig feeding behavior recognition and dangerous detection from videos10.1016/j.compag.2024.108710 ↗
40. Context autoencoder for self-supervised representation learning10.1007/s11263-023-01852-4 ↗
41. Ge, T., Hu, J., Wang, L., Wang, X., Chen, S.Q., and Wei, F. (2023). In-context autoencoder for context compression in a large language model. arXiv.
42. Liang, Y., and Liang, W. (2023). ResWCAE: Biometric Pattern Image Denoising Using Residual Wavelet-Conditioned Autoencoder. arXiv.
43. Autoencoder based self-supervised test-time adaptation for medical image analysis10.1016/j.media.2021.102136 ↗
44. A novel battery abnormality detection method using interpretable Autoencoder10.1016/j.apenergy.2022.120312 ↗
45. Mao, Y., Xue, F.F., Wang, R., Zhang, J., Zheng, W.S., and Liu, H. (2020, January 4–8). Abnormality detection in chest x-ray images using uncertainty prediction autoencoders. Proceedings of the Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru.10.1007/978-3-030-59725-2_51 ↗
46. Deep denoising autoencoder for seismic random noise attenuation10.1190/geo2019-0468.1 ↗
47. Dwork, C. (2006, January 10–14). Differential privacy. Proceedings of the International Colloquium on Automata, Languages, and Programming, Venice, Italy.10.1007/11787006_1 ↗
48. A review of applications in federated learning10.1016/j.cie.2020.106854 ↗
49. Crypten: Secure multi-party computation meets machine learning
50. A systematic review of homomorphic encryption and its contributions in healthcare industry10.1007/s40747-022-00756-z ↗