journal article·2025-01-06Open access

FD-YOLO: A YOLO Network Optimized for Fall Detection

Hoseong Hwang, Donghyun Kim, Hochul Kim

Applied Sciences· Volume 15· Issue 1

Abstract

Falls are defined by the World Health Organization (WHO) as incidents in which an individual unintentionally falls to the ground or a lower level. Falls represent a serious public health issue, ranking as the second leading cause of death from unintentional injuries, following traffic accidents. While fall prevention is crucial, prompt intervention after a fall is equally necessary. Delayed responses can result in severe complications, reduced recovery potential, and a negative impact on quality of life. This study focuses on detecting fall situations using image-based methods. The fall images utilized in this research were created by combining three open-source datasets to enhance generalization and adaptability across diverse scenarios. Because falls must be detected promptly, the YOLO (You Only Look Once) network, known for its effectiveness in real-time detection, was applied. To better capture the complex body structures and interactions with the floor during a fall, two key techniques were integrated. First, a global attention module (GAM) based on the Convolutional Block Attention Module (CBAM) was employed to improve detection performance. Second, a Transformer-based Swin Transformer module was added to effectively learn global spatial information and enable a more detailed analysis of body movements. This study prioritized minimizing missed fall detections (false negatives, FN) as the key performance metric, since undetected falls pose greater risks than false detections. The proposed Fall Detection YOLO (FD-YOLO) network, developed by integrating the Swin Transformer and GAM into YOLOv9, achieved a high mAP@0.5 score of 0.982 and recorded only 134 missed fall incidents, demonstrating optimal performance. When implemented in environments equipped with standard camera systems, the proposed FD-YOLO network is expected to enable real-time fall detection and prompt post-fall responses. This technology has the potential to significantly improve public health and safety by preventing fall-related injuries and facilitating rapid interventions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Context-Aware Activity Recognition Systems · Anomaly Detection Techniques and Applications · Gait Recognition and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Medical Artificial Intelligent, Eulji University, Seongnam-si 13135, Gyeonggi-do, Republic of Korea

Department of Radiological Science, Eulji University, Seongnam-si 13135, Gyeonggi-do, Republic of Korea

Funding

National Research Foundation of Korea (NRF)

References (39)

Show source-provided references
1. WHO (2024, September 06). Falls. Available online: http://www.who.int/en/news-room/fact-sheets/detail/falls.
2. Development of wearable human fall detection system using multilayer perceptron neural network10.1080/18756891.2013.761769 ↗
3. Improving fall detection by the use of depth sensor and accelerometer10.1016/j.neucom.2015.05.061 ↗
4. A real-time patient monitoring framework for fall detection10.1155/2019/9507938 ↗
5. Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm10.1016/j.gaitpost.2006.09.012 ↗
6. Chen, G.-C., Huang, C.-N., Chiang, C.-Y., Hsieh, C.-J., and Chan, C.-T. (2010, January 22–24). A reliable fall detection system based on wearable sensor and signal magnitude area for elderly residents. Proceedings of the Aging Friendly Technology for Health and Independence: 8th International Conference on Smart Homes and Health Telematics, ICOST 2010, Proceedings 8, Seoul, Republic of Korea.
7. He, Y., Li, Y., and Bao, S.-D. (2012, January 5–7). Fall detection by built-in tri-accelerometer of smartphone. Proceedings of the 2012 IEEE-EMBS International Conference on Biomedical and Health Informatics, Hong Kong, China.
8. Yuwono, M., Moulton, B.D., Su, S.W., Celler, B.G., and Nguyen, H.T. (2012). Unsupervised machine-learning method for improving the performance of ambulatory fall-detection systems. Biomed. Eng. Online, 11.10.1186/1475-925X-11-9 ↗
9. Review of fall detection techniques: A data availability perspective10.1016/j.medengphy.2016.10.014 ↗
10. Impact of a personal emergency response system on hospital utilization by community-residing elders10.1097/00007611-199509000-00006 ↗
11. Posture recognition based on fuzzy logic for home monitoring of the elderly10.1109/TITB.2012.2208757 ↗
12. A real-time, multiview fall detection system: A LHMM-based approach10.1109/TCSVT.2008.2005606 ↗
13. 3D head tracking for fall detection using a single calibrated camera10.1016/j.imavis.2012.11.003 ↗
14. Fall detection with multiple cameras: An occlusion-resistant method based on 3-d silhouette vertical distribution10.1109/TITB.2010.2087385 ↗
15. Fall detection based on body part tracking using a depth camera10.1109/JBHI.2014.2319372 ↗
16. Alam, E., Sufian, A., Dutta, P., and Leo, M. (2023, January 27–28). Real-Time human fall detection using a lightweight pose estimation technique. Proceedings of the International Conference on Computational Intelligence in Communications and Business Analytics, Kalyani, India.10.1007/978-3-031-48879-5_3 ↗
17. Zheng, X., Cao, J., Wang, C., and Ma, P. (2024). A High-Precision Human Fall Detection Model Based on FasterNet and Deformable Convolution. Electronics, 13.10.3390/electronics13142798 ↗
18. Wang, Y., Chi, Z., Liu, M., Li, G., and Ding, S. (2023). High-performance lightweight fall detection with an improved YOLOv5s algorithm. Machines, 11.10.3390/machines11080818 ↗
19. Kan, X., Zhu, S., Zhang, Y., and Qian, C. (2023). A lightweight human fall detection network. Sensors, 23.10.3390/s23229069 ↗
20. Object detection with deep learning: A review10.1109/TNNLS.2018.2876865 ↗
21. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
22. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–28). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58452-8_13 ↗
23. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
24. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
25. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
26. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Proceedings, Part I 14, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
27. Liu, C., Tao, Y., Liang, J., Li, K., and Chen, Y. (2018, January 14–16). Object detection based on YOLO network. Proceedings of the 2018 IEEE 4th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China.10.1109/ITOEC.2018.8740604 ↗
28. (2024, August 23). Falldown Detection Computer Vision Project. Available online: https://universe.roboflow.com/roboflow-universe-projects/fall-detection-ca3o8.
29. (2024, August 23). Fall Detection Dataset. Available online: https://www.kaggle.com/datasets/uttejkumarkandagatla/fall-detection-dataset.
30. Dataset for human fall recognition in an uncontrolled environment10.1016/j.dib.2022.108610 ↗
31. Wang, C.-Y., Yeh, I.-H., and Liao, H.-Y.M. (2024). Yolov9: Learning what you want to learn using programmable gradient information. arXiv.10.1007/978-3-031-72751-1_1 ↗
32. Fall detection based on dual-channel feature integration10.1109/ACCESS.2020.2999503 ↗
33. Depth-based human fall detection via shape features and improved extreme learning machine10.1109/JBHI.2014.2304357 ↗
34. 3D depth image analysis for indoor fall detection of elderly people10.1016/j.dcan.2015.12.001 ↗
35. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
36. Yan, Z., Hao, L., Yang, J., and Zhou, J. (2024). Real-Time Underwater Fish Detection and Recognition Based on CBAM-YOLO Network with Lightweight Design. J. Mar. Sci. Eng., 12.10.3390/jmse12081302 ↗
37. Liu, Y., Shao, Z., and Hoffmann, N. (2021). Global attention mechanism: Retain information to enhance channel-spatial interactions. arXiv.
38. Song, C.H., Han, H.J., and Avrithis, Y. (2022, January 3–8). All the attention you need: Global-local, spatial-channel attention for image retrieval. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV51458.2022.00051 ↗
39. Cao, X., Zhang, Y., Lang, S., and Gong, Y. (2023). Swin-transformer-based YOLOv5 for small-object detection in remote sensing images. Sensors, 23.10.3390/s23073634 ↗