A Reliable Aggregation Method Based on Threshold Additive Secret Sharing in Federated Learning with Quality of Service (QoS) Support
Source abstract
Abstract
Federated learning is a decentralized privacy-preserving mechanism that allows multiple clients to collaborate without exchanging their datasets. Instead, they jointly train a model by uploading their own gradients. However, recent research has shown that attackers can use clients’ gradients to reconstruct the original training data, compromising the security of federated learning. Thus, there has been an increasing number of studies aiming to protect gradients using different techniques. One common technique is secret sharing. However, it has been shown in previous research that when using secret sharing to protect gradient privacy, the original gradient cannot be reconstructed when one share is lost or a server is damaged, causing federated learning to be interrupted. In this paper, we propose an approach that involves using additive secret sharing for federated learning gradient aggregation, making it difficult for attackers to easily access clients’ original gradients. Additionally, our proposed method ensures that any server damage or loss of gradient shares are unlikely to impact the federated learning operation, within a certain probability. We also added a membership level system, allowing members of varying levels to ultimately obtain models with different accuracy levels.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Privacy-Preserving Technologies in Data · Cryptography and Data Security · Stochastic Gradient Optimization Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, National Taiwan Normal University, Taipei 116, Taiwan
Funding
National Science and Technology Council, Taiwan
References (30)
Show source-provided references
1. McMahan, H.B., Moore, E., Ramage, D., and y Arcas, B.A. (2016). Federated Learning of Deep Networks using Model Averaging. arXiv.
2. McMahan, H.B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B.A. (2023). Communication-Efficient Learning of Deep Networks from Decentralized Data. arXiv.
3. Zhu, L., Liu, Z., and Han, S. (2019, January 8–14). Deep leakage from gradients. Proceedings of the Annual Conference on Neural Information Processing Systems 2019, Vancouver, BC, Canada.
4. Zhao, B., Mopuri, K.R., and Bilen, H. (2020). idlg: Improved deep leakage from gradients. arXiv.
5. Wei, W., Liu, L., Loper, M., Chow, K.H., Gursoy, M.E., Truex, S., and Wu, Y. (2020). A framework for evaluating gradient leakage attacks in federated learning. arXiv.
6. Inverting gradients-how easy is it to break privacy in federated learning?
7. More, Y., Ramachandran, P., Panda, P., Mondal, A., Virk, H., and Gupta, D. (2022). SCOTCH: An efficient secure computation framework for secure aggregation. arXiv.
8. Fazli Khojir, H., Alhadidi, D., Rouhani, S., and Mohammed, N. (2023, January 5–7). FedShare: Secure aggregation based on additive secret sharing in federated learning. Proceedings of the 27th International Database Engineered Applications Symposium, Heraklion, Crete, Greece.10.1145/3589462.3589504 ↗
9. FedMes: Speeding up federated learning with multiple edge servers10.1109/JSAC.2021.3118422 ↗
10. On the convergence of multi-server federated learning with overlapping area10.1109/TMC.2022.3200016 ↗
11. Dwork, C. (2006). Differential privacy. International Colloquium on Automata, Languages, and Programming, Springer.10.1007/11787006_1 ↗
12. Yao, A.C. (1982, January 3–5). Protocols for secure computations. Proceedings of the 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), Chicago, IL, USA.10.1109/SFCS.1982.38 ↗
13. Park, J., and Lim, H. (2022). Privacy-preserving federated learning using homomorphic encryption. Appl. Sci., 12.10.3390/app12020734 ↗
14. Fang, H., and Qian, Q. (2021). Privacy preserving machine learning with homomorphic encryption and federated learning. Future Internet, 13.10.3390/fi13040094 ↗
15. Zhang, C., Li, S., Xia, J., Wang, W., Yan, F., and Liu, Y. (2020, January 15–17). {BatchCrypt}: Efficient homomorphic encryption for {Cross-Silo} federated learning. Proceedings of the 2020 USENIX Annual Technical Conference (USENIX ATC 20), Online.
16. Privacy-preserving federated learning based on multi-key homomorphic encryption10.1002/int.22818 ↗
17. Privacy-preserving federated learning in medical diagnosis with homomorphic re-encryption10.1016/j.csi.2021.103583 ↗
18. Chuanxin, Z., Yi, S., and Degang, W. (2020, January 17–19). Federated learning with Gaussian differential privacy. Proceedings of the 2020 2nd International Conference on Robotics, Intelligent Control and Artificial Intelligence, Shanghai, China.10.1145/3438872.3439097 ↗
19. Federated learning with differential privacy: Algorithms and performance analysis10.1109/TIFS.2020.2988575 ↗
20. Triastcyn, A., and Faltings, B. (2019, January 9–12). Federated learning with bayesian differential privacy. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9005465 ↗
21. Sun, L., Qian, J., and Chen, X. (2020). LDP-FL: Practical private aggregation in federated learning with local differential privacy. arXiv.10.24963/ijcai.2021/217 ↗
22. Privacy-preserving distributed deep learning based on secret sharing10.1016/j.ins.2020.03.074 ↗
23. Privacy-preserving federated learning framework based on chained secure multiparty computing10.1109/JIOT.2020.3022911 ↗
24. Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., and Ludwig, H. (2019, January 15). Hybridalpha: An efficient approach for privacy-preserving federated learning. Proceedings of the P12th ACM Workshop on Artificial Intelligence and Security, London, UK.10.1145/3338501.3357371 ↗
25. Columbia University, Department of Computer Science (2023, August 11). COMS W4261: Introduction to Cryptography. Available online: https://www.cs.columbia.edu/~tal/4261/F19/secretsharingf19.pdf.
26. How to share a secret10.1145/359168.359176 ↗
27. Bisong, E., and Bisong, E. (2019). Google colaboratory. Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners, Apress.10.1007/978-1-4842-4470-8 ↗
28. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). Pytorch: An imperative style, high-performance deep learning library. Proceedings of the Annual Conference on Neural Information Processing Systems 2019, Vancouver, BC, Canada.
29. The mnist database of handwritten digit images for machine learning research [best of the web]10.1109/MSP.2012.2211477 ↗
30. Xiao, H., Rasul, K., and Vollgraf, R. (2017). Fashion-mnist: A novel image dataset for benchmarking machine learning algorithms. arXiv.