journal article·2024Open access

Blockchain-Enabled Federated Learning for Privacy-Preserving Non-IID Data Sharing in Industrial Internet

Qiuyan Wang, Haibing Dong, Yongfei Huang, Zenglei Liu, Yundong Gou

Computers, Materials & Continua· Volume 80· Issue 2

Abstract

Sharing data while protecting privacy in the industrial Internet is a significant challenge. Traditional machine learning methods require a combination of all data for training; however, this approach can be limited by data availability and privacy concerns. Federated learning (FL) has gained considerable attention because it allows for decentralized training on multiple local datasets. However, the training data collected by data providers are often non-independent and identically distributed (non-IID), resulting in poor FL performance. This paper proposes a privacy-preserving approach for sharing non-IID data in the industrial Internet using an FL approach based on blockchain technology. To overcome the problem of non-IID data leading to poor training accuracy, we propose dynamically updating the local model based on the divergence of the global and local models. This approach can significantly improve the accuracy of FL training when there is relatively large dispersion. In addition, we design a dynamic gradient clipping algorithm to alleviate the influence of noise on the model accuracy to reduce potential privacy leakage caused by sharing model parameters. Finally, we evaluate the performance of the proposed scheme using commonly used open-source image datasets. The simulation results demonstrate that our method can significantly enhance the accuracy while protecting privacy and maintaining efficiency, thereby providing a new solution to data-sharing and privacy-protection challenges in the industrial Internet.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · Blockchain Technology Applications and Security · Mobile Crowdsensing and Crowdsourcing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (47)

Show source-provided references
1. A MEC-based architecture to secure IoT applications using federated deep learning10.1109/IOTM.001.2100238 ↗
2. Task-driven privacy-preserving data-sharing framework for the industrial internet
3. Blockchain in industrial IoT applications: Security and privacy advances, challenges, and opportunities10.1109/TII.2020.2966068 ↗
4. A survey on industrial internet of things: A cyber-physical systems perspective10.1109/ACCESS.2018.2884906 ↗
5. Dobbs · The Internet of Things: Mapping the Value Beyond the Hype · 2015
6. An intelligent and privacy-enhanced data sharing strategy for blockchain-empowered internet of things10.1016/j.dcan.2021.12.007 ↗
7. Communication efficient learning of deep networks from decentralized data
8. Differentially private federated multi-task learning framework for enhancing human-to-virtual connectivity in human digital twin10.1109/JSAC.2023.3310106 ↗
9. Performance analysis of blockchain-enabled data sharing scheme in cloud-edge computing-based IoT networks10.1109/JIOT.2022.3181556 ↗
10. Biscotti: A blockchain system for private and secure federated learning10.1109/TPDS.2020.3044223 ↗
11. LTSM: Lightweight and trusted sharing mechanism of IoT data in smart city10.1109/JIOT.2021.3110097 ↗
12. Deep federated learning for IoT-based decentralized healthcare systems
13. Probabilistic solar irradiation forecasting based on variational bayesian inference with secure federated learning10.1109/TII.2020.3035807 ↗
14. Decentralized privacy using blockchain-enabled federated learning in fog computing10.1109/JIOT.2020.2977383 ↗
15. A hierarchical blockchain-enabled federated learning algorithm for knowledge sharing in internet of vehicles10.1109/TITS.2020.3002712 ↗
16. Communication-efficient distributed AI strategies for the IoT edge10.1016/j.future.2022.01.013 ↗
17. Communication-efficient federated learning with adaptive quantization10.1145/3510587 ↗
18. A privacy preserving federated learning scheme using homomorphic encryption and secret sharing10.1007/s11235-022-00982-3 ↗
19. Quality inference in federated learning with secure aggregation10.1109/TBDATA.2023.3280406 ↗
20. Papaya: Practical, private, and scalable federated learning
21. Towards federated learning at scale: System design
22. A distribution information sharing federated learning approach for medical image data10.1007/s40747-023-01035-1 ↗
23. Learning critically: Selective self-distillation in federated learning on noniid data
24. X. Li, M. Jiang, X. Zhang, M. Kamp, and Q. Dou, “FedBN: Federated learning on non-IID features via local batch normalization,” 2021. doi: 10.48550/arXiv.2102.07623.
25. Privacy-preserving blockchain-based global data sharing for federated learning with non-IID data
26. CBFL: A communication efficient federated learning framework from data redundancy perspective
27. Calibrating noise to sensitivity in private data analysis10.29012/jpc.v7i3.405 ↗
28. Membership inference attacks on machine learning: A survey10.1145/3523273 ↗
29. Membership inference attacks against machine learning models
30. H. B. McMahan, D. Ramage, K. Talwar, and L. Zhang, “Learning differentially private recurrent language models,” 2017. doi: 10.48550/arXiv.1710.06963.
31. M. Naseri, J. Hayes, and E. De Cristofaro, “Local and central differential privacy for robustness and privacy in federated learning,” 2020. doi: 10.48550/arXiv.2009.035.
32. Augmented multi-party computation against gradient leakage in federated learning
33. How to DP-fy ML: A practical guide to machine learning with differential privacy10.1613/jair.1.14649 ↗
34. LDP-Fed: Federated learning with local differential privacy
35. Label inference attacks against vertical federated learning
36. Privacy-preserving deep learning model for decentralized vanets using fully homomorphic encryption and blockchain10.1109/TITS.2021.3105682 ↗
37. Privacy-preserving distributed deep learning based on secret sharing10.1016/j.ins.2020.03.074 ↗
38. Secure, privacy-preserving and federated machine learning in medical imaging10.1038/s42256-020-0186-1 ↗
39. Privacy preserving deep learning
40. Deep learning with differential privacy
41. R. C. Geyer, T. Klein, and M. Nabi, “Differentially private federated learning: A client level perspective,” 2017. doi: 10.48550/arXiv.1712.07557.
42. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
43. Long short-term memory
44. H. Wang, M. Yurochkin, Y. Sun, D. Papailiopoulos, and Y. Khazaeni, “Federated learning with matched averaging,” 2020. doi: 10.48550/arXiv.2002.06440.
45. Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin and V. Chandra, “Federated learning with noniid data,” 2018. doi:10.48550/arXiv.1806.00582.
46. S. Caldas et al., “LEAF: A benchmark for federated settings,” 2018. doi: 10.48550/arXiv.1812.01097.
47. EasyFL: A low-code federated learning platform for dummies10.1109/JIOT.2022.3143842 ↗