Efficient and Personalized Federated Learning for Human Activity Recognition on Resource-Constrained Devices
Source abstract
Abstract
Human Activity Recognition (HAR) using wearable sensors enables impactful applications in healthcare, fitness, and smart environments, but it also faces challenges related to data privacy, non-independent and identically distributed (non-IID) data, and limited computational resources on edge devices. This study proposes an efficient and personalized federated learning (PFL) framework for HAR that integrates federated training with model compression and per-client fine-tuning to address these challenges and support deployment on resource-constrained devices (RCDs). A convolutional neural network (CNN) is trained across multiple clients using FedAvg, followed by magnitude-based pruning and float16 quantization to reduce model size. While personalization and compression have previously been studied independently, their combined application for HAR remains underexplored in federated settings. Experimental results show that the global FedAvg model experiences performance degradation under non-IID conditions, which is further amplified after pruning, whereas per-client personalization substantially improves performance by adapting the model to individual user patterns. To ensure realistic evaluation, experiments are conducted using both random and temporal data splits, with the latter mitigating temporal leakage in time-series data. Personalization consistently improves performance under both settings, while quantization reduces the model footprint by approximately 50%, enabling deployment on wearable and IoT devices. Statistical analysis using paired significance tests confirms the robustness of the observed performance gains. Overall, this work demonstrates that combining lightweight model compression with personalization providing an effective and practical solution for federated HAR, balancing accuracy, efficiency, and deployment feasibility in real-world scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Context-Aware Activity Recognition Systems · Physical Activity and Health · Personal Information Management and User Behavior
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computing, Ulster University, Belfast BT15 1ED, UK
School of Engineering, Ulster University, Belfast BT15 1ED, UK
Funding
Dell Technologies
References (45)
Show source-provided references
1. McMahan, H.B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B.A. (2016). Communication-Efficient Learning of Deep Networks from Decentralized Data. arXiv.
2. Human activity recognition with smartphone sensors using deep learning neural networks10.1016/j.eswa.2016.04.032 ↗
3. Li, T., Sahu, A.K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V. (2018). Federated Optimization in Heterogeneous Networks. arXiv.
4. Nguyen, D.P., Yu, S., Muñoz, J.P., and Jannesari, A. (2023, January 12–17). Enhancing Heterogeneous Federated Learning with Knowledge Extraction and Multi-Model Fusion. Proceedings of the SC ’23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, Denver, CO, USA.10.1145/3624062.3626325 ↗
5. Hybrid transformer deep neural architectures for enhanced misinformation detection on social media10.1016/j.eswa.2025.130470 ↗
6. Secure and decentralized federated learning framework with non-IID data based on blockchain10.1016/j.heliyon.2024.e27176 ↗
7. Personalized Federated Learning on Non-IID Data via Group-based Meta-learning
8. Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., and Kalenichenko, D. (2018, January 18–22). Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00286 ↗
9. FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare10.1109/MIS.2020.2988604 ↗
10. Perez-Gamboa, S., Sun, Q., and Zhang, Y. (2021, January 22–25). Improved Sensor Based Human Activity Recognition via Hybrid Convolutional and Recurrent Neural Networks. Proceedings of the 2021 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL), Kailua-Kona, HI, USA.10.1109/INERTIAL51137.2021.9430460 ↗
11. Improving Machine Reliability with Recurrent Neural Networks
12. Federated Learning for Human Activity Recognition: Overview, Advances, and Challenges10.1109/OJCOMS.2024.3484228 ↗
13. Resource-Constrained Federated Learning with Heterogeneous Labels and Models for Human Activity Recognition10.1007/978-981-16-0575-8_5 ↗
14. Reschedule Gradients: Temporal Non-IID Resilient Federated Learning10.1109/JIOT.2022.3203233 ↗
15. Lin, H.-T., and Wen, C.-Y. (2024). Edge Federated Optimization for Heterogeneous Data. Future Internet, 16.10.3390/fi16040142 ↗
16. Bock, M., Hölzemann, A., Moeller, M., and Van Laerhoven, K. (2021, January 21–26). Improving Deep Learning for HAR with Shallow LSTMs. Proceedings of the 2021 International Symposium on Wearable Computers, Virtual.10.1145/3460421.3480419 ↗
17. Sittijuk, P., and Tamee, K. (2024). Fed-RHLP: Enhancing Federated Learning with Random High-Local Performance Client Selection for Improved Convergence and Accuracy. Symmetry, 16.10.3390/sym16091181 ↗
18. Shi, Y., Liu, Z., Shi, Z., and Yu, H. (2023, January 10–14). Fairness-Aware Client Selection for Federated Learning. Proceedings of the 2023 IEEE International Conference on Multimedia and Expo (ICME), Brisbane, Australia.10.1109/ICME55011.2023.00063 ↗
19. Zhang, J., and Li, Z. (2023). A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data. Electronics, 12.10.3390/electronics12071660 ↗
20. Lalapura, V.S., Bhimavarapu, V.R., Amudha, J., and Satheesh, H.S. (2024). A Systematic Evaluation of Recurrent Neural Network Models for Edge Intelligence and Human Activity Recognition Applications. Algorithms, 17.10.3390/a17030104 ↗
21. Sui, X., Lv, Q., Zhi, L., Zhu, B., Yang, Y., Zhang, Y., and Tan, Z. (2023). A Hardware-Friendly High-Precision CNN Pruning Method and Its FPGA Implementation. Sensors, 23.10.3390/s23020824 ↗
22. A Study on the Application of TensorFlow Compression Techniques to Human Activity Recognition10.1109/ACCESS.2023.3276438 ↗
23. Tung, F., and Mori, G. (2018, January 18–22). CLIP-Q: Deep Network Compression Learning by In-parallel Pruning-Quantization. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00821 ↗
24. Li, Y., Zhu, F., Gong, R., Shen, M., Dong, X., Yu, F., Lu, S., and Gu, S. (2021, January 10–17). MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00437 ↗
25. Song, S., Du, S., Song, Y., and Zhu, Y. (2024). DualPFL: A Dual Sparse Pruning Method with Efficient Federated Learning for Edge-Based Object Detection. Appl. Sci., 14.10.3390/app142210547 ↗
26. Hierarchical Clustering-based Personalized Federated Learning for Robust and Fair Human Activity Recognition
27. Confusion Matrix-Based Building of Hierarchical Classification
28. Using score distributions to compare statistical significance tests for information retrieval evaluation10.1002/asi.24203 ↗
29. Federated Learning via Plurality Vote10.1109/TNNLS.2022.3225715 ↗
30. Cho, Y.J., Liu, L., Xu, Z., Fahrezi, A., and Joshi, G. (2024, January 12–16). Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.10.18653/v1/2024.emnlp-main.717 ↗
31. FedLF: Layer-Wise Fair Federated Learning
32. Online Client Selection for Asynchronous Federated Learning With Fairness Consideration10.1109/TWC.2022.3211998 ↗
33. Hao, W., El-Khamy, M., Lee, J., Zhang, J., Liang, K.J., Chen, C., and Carin, L. (2021, January 19–25). Towards Fair Federated Learning with Zero-Shot Data Augmentation. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Nashville, TN, USA.10.1109/CVPRW53098.2021.00369 ↗
34. A Novel Framework for the Analysis and Design of Heterogeneous Federated Learning10.1109/TSP.2021.3106104 ↗
35. EdgeFed: Optimized Federated Learning Based on Edge Computing10.1109/ACCESS.2020.3038287 ↗
36. A Review on Human Activity Recognition Using Vision-Based Method
37. Zhou, Y., Duan, G., Qiu, T., Zhang, L., Tian, L., Zheng, X., and Zhu, Y. (2024). Personalized Federated Learning Incorporating Adaptive Model Pruning at the Edge. Electronics, 13.10.3390/electronics13091738 ↗
38. Hsu, H.-Y., Keoy, K.H., Chen, J.-R., Chao, H.-C., and Lai, C.-F. (2023). Personalized Federated Learning Algorithm with Adaptive Clustering for Non-IID IoT Data Incorporating Multi-Task Learning and Neural Network Model Characteristics. Sensors, 23.10.3390/s23229016 ↗
39. Arivazhagan, M.G., Aggarwal, V., Singh, A.K., and Choudhary, S. (2019). Federated Learning with Personalization Layers. arXiv.
40. Li, X., Jiang, M., Zhang, X., Kamp, M., and Dou, Q. (2021). FedBN: Federated Learning on Non-IID Features via Local Batch Normalization. arXiv.
41. Li, C., Niu, D., Jiang, B., Zuo, X., and Yang, J. (2021, January 19–23). Meta-HAR: Federated Representation Learning for Human Activity Recognition. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.10.1145/3442381.3450006 ↗
42. Building Lightweight Deep learning Models with TensorFlow Lite for Human Activity Recognition on Mobile Devices10.1007/s12243-023-00962-x ↗
43. Khan, A.R., Manzoor, H.U., Ayaz, F., Imran, M.A., and Zoha, A. (2023). A Privacy and Energy-Aware Federated Framework for Human Activity Recognition. Sensors, 23.10.20944/preprints202310.0998.v1 ↗
44. Contribution prediction in federated learning via client behavior evaluation10.1016/j.future.2024.107639 ↗
45. Cleland, I., Donnelly, M.P., Nugent, C.D., Hallberg, J., Espinilla, M., and Garcia-Constantino, M. (2018, January 19–23). Collection of a Diverse, Realistic and Annotated Dataset for Wearable Activity Recognition. Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Athens, Greece.10.1109/PERCOMW.2018.8480322 ↗