Blockchain and Access Control Encryption-Empowered IoT Knowledge Sharing for Cloud-Edge Orchestrated Personalized Privacy-Preserving Federated Learning
Source abstract
Abstract
Federated learning (FL) is emerging as a powerful paradigm for distributed data mining in the context of Internet of Things (IoT) big data. It addresses privacy concerns associated with data outsourcing by enabling local data training and knowledge (i.e., model) sharing. However, simplistic local knowledge sharing can inadvertently expose user privacy to advanced attacks, such as model inversion or gradient leakage. Furthermore, achieving fine-grained and personalized privacy protection for IoT users remains a challenge. In this paper, we propose a novel solution called hierarchical blockchain-empowered cloud-edge orchestrated federated learning (HBCE-FL) to address these challenges. HBCE-FL is designed to provide secure, intelligent, and distributed data analysis for IoT users. To tackle FL’s privacy issues, we develop a multi-level access control encryption and blockchain-based approach for sharing IoT knowledge within the HBCE-FL framework. Our approach classifies IoT users into different levels based on their individual privacy requirements, enabling fine-grained privacy protection. The blockchain is employed for identity authentication, key management, and message sanitization. For scenarios involving IoT users with non-IID data, we integrate federated multi-task learning into HBCE-FL to ensure fairness, robustness, and privacy. Finally, we conduct experiments using classic MNIST and CIFAR10 datasets to validate our approach. The experimental results illustrate that HBCE-FL effectively achieves personalized privacy-preserving FL without losing IoT data availability. Regardless of whether IoT data are homogeneous or heterogeneous, our approach enhances model accuracy and convergence rates by enabling secure IoT knowledge access and sharing for IoT users.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Privacy-Preserving Technologies in Data · Cryptography and Data Security · Stochastic Gradient Optimization Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
Shanghai Key Laboratory of Integrated Administration Technologies for Information Security, Shanghai 200240, China
Funding
National Natural Science Foundation of China · Shanghai Engineering Research Center of Cyber and Information Security Evaluation (The Third Research Institute of Ministry of Public Security)
References (45)
Show source-provided references
1. EdgeABC: An architecture for task offloading and resource allocation in the Internet of Things10.1016/j.future.2020.02.026 ↗
2. Friend-as-Learner: Socially-Driven Trustworthy and Efficient Wireless Federated Edge Learning10.1109/TMC.2021.3074816 ↗
3. Federated Machine Learning: Concept and Applications10.1145/3339474 ↗
4. Federated Learning: Challenges, Methods, and Future Directions
5. Preserving Edge Knowledge Sharing Among IoT Services: A Blockchain-Based Approach10.1109/TETCI.2019.2952587 ↗
6. Gao, Z., Yang, Y., Zhao, C., and Mo, Z. (2022, January 14–16). CFedPer: Clustered Federated Learning with Two-Stages Optimization for Personalization. Proceedings of the 2022 18th International Conference on Mobility, Sensing and Networking (MSN), Guangzhou, China.10.1109/MSN57253.2022.00039 ↗
7. Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., and Garnett, R. (2019, January 8–14). Deep Leakage from Gradients. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
8. Zhao, B., Mopuri, K.R., and Bilen, H. (2020). iDLG: Improved Deep Leakage from Gradients. arXiv.
9. Gradient Leakage Attack Resilient Deep Learning10.1109/TIFS.2021.3139777 ↗
10. Shokri, R., Stronati, M., Song, C., and Shmatikov, V. (2017, January 22–26). Membership Inference Attacks Against Machine Learning Models. Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP), San Jose, CA, USA.10.1109/SP.2017.41 ↗
11. Melis, L., Song, C., De Cristofaro, E., and Shmatikov, V. (2019, January 19–23). Exploiting Unintended Feature Leakage in Collaborative Learning. Proceedings of the 2019 IEEE Symposium on Security and Privacy (SP), San Francisco, CA, USA.10.1109/SP.2019.00029 ↗
12. Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H.B., Patel, S., Ramage, D., Segal, A., and Seth, K. (November, January 30). Practical Secure Aggregation for Privacy-Preserving Machine Learning. Proceedings of the CCS ’17, 2017 ACM SIGSAC Conference on Computer and Communications Security, Dallas, TX, USA.10.1145/3133956.3133982 ↗
13. Hardy, S., Henecka, W., Ivey-Law, H., Nock, R., Patrini, G., Smith, G., and Thorne, B. (2017). Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv.
14. McMahan, H.B., Ramage, D., Talwar, K., and Zhang, L. (2017). Learning Differentially Private Recurrent Language Models. arXiv.
15. Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., and Garnett, R. (2019, January 8–14). Differential Privacy Has Disparate Impact on Model Accuracy. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
16. Yu, T., Bagdasaryan, E., and Shmatikov, V. (2020). Salvaging Federated Learning by Local Adaptation. arXiv.
17. Chen, L.Y., and Reiser, H.P. (2017). Distributed Applications and Interoperable Systems, Proceedings of the 17th International Federated Conference on Distributed Computing Techniques, DisCoTec 2022, Lucca, Italy, 13–17 June 2022, Springer.
18. Majeed, U., and Hong, C.S. (2019, January 18–20). FLchain: Federated Learning via MEC-enabled Blockchain Network. Proceedings of the 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS), Matsue, Japan.10.23919/APNOMS.2019.8892848 ↗
19. Hirt, M., and Smith, A. (2016). Theory of Cryptography, Springer.10.1007/978-3-662-53644-5 ↗
20. Tan, G., Zhang, R., Ma, H., and Tao, Y. (2017, January 2). Access Control Encryption Based on LWE. Proceedings of the APKC ’17, 4th ACM International Workshop on ASIA Public-Key Cryptography, Abu Dhabi, United Arab Emirates.10.1145/3055504.3055509 ↗
21. Privacy-Preserving Federated Deep Learning With Irregular Users
22. Mohassel, P., and Zhang, Y. (2017, January 22–26). SecureML: A System for Scalable Privacy-Preserving Machine Learning. Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP), San Jose, CA, USA.10.1109/SP.2017.12 ↗
23. Mohassel, P., and Rindal, P. (2018, January 15–19). ABY3: A Mixed Protocol Framework for Machine Learning. Proceedings of the CCS ’18, 2018 ACM SIGSAC Conference on Computer and Communications Security, Toronto, ON, Canada.
24. Privacy-Preserving Collaborative Deep Learning With Unreliable Participants10.1109/TIFS.2019.2939713 ↗
25. Geyer, R.C., Klein, T., and Nabi, M. (2018). Differentially Private Federated Learning: A Client Level Perspective. arXiv.
26. Heterogeneous Differential-Private Federated Learning: Trading Privacy for Utility Truthfully10.1109/TDSC.2023.3241057 ↗
27. Privacy-Preserving Deep Learning via Additively Homomorphic Encryption10.1109/TIFS.2017.2787987 ↗
28. Park, J., Yu, N.Y., and Lim, H. (2022, January 19–21). Privacy-Preserving Federated Learning Using Homomorphic Encryption With Different Encryption Keys. Proceedings of the 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.10.1109/ICTC55196.2022.9952531 ↗
29. Secure Logistic Regression Based on Homomorphic Encryption: Design and Evaluation10.2196/medinform.8805 ↗
30. Assessing the Impact of Blockchain Technology on Internal Controls within the COSO Framework10.56578/jcgirm100110 ↗
31. Blockchain Assisted Decentralized Federated Learning (BLADE-FL): Performance Analysis and Resource Allocation10.1109/TPDS.2021.3138848 ↗
32. Wu, X., Wang, Z., Zhao, J., Zhang, Y., and Wu, Y. (2020, January 27–29). FedBC: Blockchain-based Decentralized Federated Learning. Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China.10.1109/ICAICA50127.2020.9182705 ↗
33. Low-Latency Federated Learning and Blockchain for Edge Association in Digital Twin Empowered 6G Networks10.1109/TII.2020.3017668 ↗
34. Rehman, M.H., Salah, K., Damiani, E., and Svetinovic, D. (2020, January 6–9). Towards Blockchain-Based Reputation-Aware Federated Learning. Proceedings of the IEEE INFOCOM 2020—IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Toronto, ON, Canada.
35. Enhancing healthcare data security in IoT environments using blockchain and DCGRU with Twofish encryption
36. Blockchain-Enabled Lightweight Fine-Grained Searchable Knowledge Sharing for Intelligent IoT10.1109/JIOT.2023.3306606 ↗
37. Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT10.1109/TII.2019.2942190 ↗
38. A Blockchain-Based Decentralized Federated Learning Framework with Committee Consensus10.1109/MNET.011.2000263 ↗
39. Xu, L., Zhang, H., Du, X., and Wang, C. (2009, January 25–26). Research on Mandatory Access Control Model for Application System. Proceedings of the 2009 International Conference on Networks Security, Wireless Communications and Trusted Computing, Wuhan, China.10.1109/NSWCTC.2009.322 ↗
40. Jiang, Y., Lin, C., Yin, H., and Tan, Z. (2004, January 10–13). Security analysis of mandatory access control model. Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583), The Hague, The Netherlands.
41. McMahan, B., Moore, E., Ramage, D., Hampson, S., and Arcas, B.A.y. (2017, January 20–22). Communication-Efficient Learning of Deep Networks from Decentralized Data. Proceedings of the PMLR, 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA.
42. Li, T., Hu, S., Beirami, A., and Smith, V. (2021, January 18–24). Ditto: Fair and Robust Federated Learning Through Personalization. Proceedings of the PMLR, 38th International Conference on Machine Learning, Virtual.
43. A public key cryptosystem and a signature scheme based on discrete logarithms10.1109/TIT.1985.1057074 ↗
44. Li, Q., Diao, Y., Chen, Q., and He, B. (2022, January 9–12). Federated Learning on Non-IID Data Silos: An Experimental Study. Proceedings of the 2022 IEEE 38th International Conference on Data Engineering (ICDE), Kuala Lumpur, Malaysia.10.1109/ICDE53745.2022.00077 ↗
45. Yurochkin, M., Agarwal, M., Ghosh, S., Greenewald, K., Hoang, N., and Khazaeni, Y. (2019, January 9–15). Bayesian Nonparametric Federated Learning of Neural Networks. Proceedings of the PMLR, 36th International Conference on Machine Learning, Long Beach, CA, USA.