journal article·2024-04-12Open access

Enhancing Robustness within the Collaborative Federated Learning Framework: A Novel Grouping Algorithm for Edge Clients

Zhi-Yuan Su, I-Hsien Liu, Chu-Fen Li, Chuan-Kang Liu, Chi-Hui Chiang

Applied Sciences· Volume 14· Issue 8

Abstract

In this study, we introduce a novel collaborative federated learning (FL) framework, aiming at enhancing robustness in distributed learning environments, particularly pertinent to IoT and industrial automation scenarios. At the core of our contribution is the development of an innovative grouping algorithm for edge clients. This algorithm employs a distinctive ID distribution function, enabling efficient and secure grouping of both normal and potentially malicious clients. Our proposed grouping scheme accurately determines the numerical difference between normal and malicious groups under various network scenarios. Our method addresses the challenge of model poisoning attacks, ensuring the accuracy of outcomes in a collaborative federated learning framework. Our numerical experiments demonstrate that our grouping scheme effectively limits the number of malicious groups. Additionally, our collaborative FL framework has shown resilience against various levels of poisoning attack abilities and maintained high prediction accuracy across a range of scenarios, showcasing its robustness against poisoning attacks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · Network Security and Intrusion Detection · Internet Traffic Analysis and Secure E-voting

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Multimedia and Game Development, Chia-Nan University of Pharmacy and Science, No. 60, Sec. 1, Erren Rd., Rende Dist., Tainan City 717301, Taiwan

Department of Electrical Engineering, Institute of Computer and Communication Engineering, National Cheng Kung University, No. 1, University Rd., East Dist., Tainan City 701401, Taiwan

Department of Finance, National Formosa University, No. 64, Wunhua Rd., Huwei Township, Yunlin County 632301, Taiwan

Department of Artificial Intelligence and Computer Engineering, National Chin-Yi University of Technology, No. 57, Sec. 2, Zhongshan Rd., Taiping Dist., Taichung 411030, Taiwan

Department of Information Management, Chia-Nan University of Pharmacy and Science, No. 60, Sec. 1, Erren Rd., Rende Dist., Tainan City 717301, Taiwan

Funding

National Science and Technology Council (NSTC) in Taiwan

References (25)

Show source-provided references
1. Kone, J., McMahan, H.B., Yu, X.F., Richtárik, P., Suresh, A.T., and Bacon, D. (2016, January 9). Federated Learning: Strategies for Improving Communication Efficiency. Proceedings of the NeurIPS Workshop Private Multi-Party Machine Learning 2016, Barcelona, Spain.
2. Qolomany, B., Ahmad, K., Al-Fuqaha, A., and Qadir, J. (2020, January 7–11). Particle Swarm Optimized Federated Learning for Industrial IoT and Smart City Services. Proceedings of the GLOBECOM 2020–2020 IEEE Global Communications Conference, Taipei, Taiwan.10.1109/GLOBECOM42002.2020.9322464 ↗
3. Xing, J., Jiang, Z.X., and Yin, H. (2020, January 3–6). Jupiter: A Modern Federated Learning Platform for Regional Medical Care. Proceedings of the 2020 IEEE International Conference on Joint Cloud Computing, Oxford, UK.10.1109/JCC49151.2020.00012 ↗
4. Hu, Y., Cao, N., Guo, W., Chen, M., Rong, Y., and Lu, H. (2024). FedDeep: A Federated Deep Learning Network for Edge Assisted Multi-Urban PM2.5 Forecasting. Appl. Sci., 14.10.3390/app14051979 ↗
5. Saputra, Y.M., Hoang, D.T., Nguyen, D.N., Dutkiewicz, E., Mueck, M.D., and Srikanteswara, S. (2019, January 9–13). Energy Demand Prediction with Federated Learning for Electric Vehicle Networks. Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA.10.1109/GLOBECOM38437.2019.9013587 ↗
6. Mobility-Aware Proactive Edge Caching for Connected Vehicles Using Federated Learning10.1109/TITS.2020.3017474 ↗
7. Review on security of federated learning and its application in healthcare10.1016/j.future.2023.02.021 ↗
8. Internet of Things Intrusion Detection: Centralized, on-Device, or Federated Learning?10.1109/MNET.011.2000286 ↗
9. FLCert: Provably Secure Federated Learning Against Poisoning Attacks10.1109/TIFS.2022.3212174 ↗
10. Liu, C.K., and Chiang, C.H. (July, January 30). A Collaboration Federated Learning Framework with a Grouping Scheme against Poisoning Attacks. Proceedings of the International Symposium on Computer, Consumer and Control, Taichung, Taiwan.
11. Recent Advances on Federated Learning for Cybersecurity and Cybersecurity for Federated Learning for Internet of Things10.1109/JIOT.2022.3150363 ↗
12. Fed-IIoT: A Robust Federated Malware Detection Architecture in Industrial IoT10.1109/TII.2020.3043458 ↗
13. Sun, Y., Ochiai, H., and Esaki, H. (2020, January 19–24). Intrusion Detection with Segmented Federated Learning for Large-Scale Multiple LANs. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9207094 ↗
14. Lin, K.-Y., and Huang, W.-R. (2020, January 16–19). Using Federated Learning on Malware Classification. Proceedings of the 22nd International Conference on Advanced Communication Technology, Phoenix Park, Republic of Korea.10.23919/ICACT48636.2020.9061261 ↗
15. VFL: A Verifiable Federated Learning with Privacy-Preserving for Big Data in Industrial IoT10.1109/TII.2020.3036166 ↗
16. GEMLIDS-MIOT: A Green Effective Machine Learning Intrusion Detection System based on Federated Learning for Medical IoT network security hardening10.1016/j.comcom.2024.02.023 ↗
17. Khoa, T.V., Saputra, Y.M., Hoang, D.T., Trung, N.L., Nguyen, D., Ha, N.V., and Dutkiewicz, E. (2020, January 25–28). Collaborative Learning Model for Cyberattack Detection Systems in IoT Industry 4.0. Proceedings of the IEEE Wireless Communications and Networking, Seoul, Republic of Korea.10.1109/WCNC45663.2020.9120761 ↗
18. Detecting cyberattacks using anomaly detection in industrial control systems: A Federated Learning approach10.1016/j.compind.2021.103509 ↗
19. Mahindru, A., and Arora, H. (2022, January 24–26). DNNdroid: Android Malware Detection Framework Based on Federated Learning and Edge Computing. Proceedings of the Advancements in Smart Computing and Information Security 2022, Rajkot, India.10.1007/978-3-031-23095-0_7 ↗
20. Mahindru, A., Sharma, S.K., and Mittal, M. (2023, January 5–6). YarowskyDroid: Semi-supervised based Android malware detection using federation learning. Proceedings of the 2023 International Conference on Advancement in Computation & Computer Technologies (InCACCT), Gharuan, India.10.1109/InCACCT57535.2023.10141735 ↗
21. Less is More: A privacy-respecting Android malware classifier using Federated Learning
22. Jiang, C., Yin, K., Xia, C., and Huang, W. (2022). FedHGCDroid: An Adaptive Multi-Dimensional Federated Learning for Privacy-Preserving Android Malware Classification. Entropy, 24.10.3390/e24070919 ↗
23. The Byzantine Generals Problem10.1145/357172.357176 ↗
24. Blanchard, P., Mhamdi, E.M.E., Guerraoui, R., and Stainer, J. (2017, January 4–9). Machine learning with adversaries: Byzantine tolerant gradient descent. Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA.
25. Zhang, Z., Cao, X., Jia, J., and Gong, N.Z. (2022, January 14–18). FLDetector: Defending Federated Learning Against Model Poisoning Attacks via Detecting Malicious Clients. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, New York, NY, USA.10.1145/3534678.3539231 ↗