journal article·2025-12-08Open access

YOLO-HRNet with Attention Mechanism: For Automated Ergonomic Risk Assessment in Garment Manufacturing

Yichen Tan, Ziqian Yang, Zhihui Wu

Applied Sciences· Volume 15· Issue 24

Abstract

For garment manufacturing, an efficient and precise assessment of ergonomics is vital to prevent work-related musculoskeletal disorders. This study creates a computer vision-based algorithm for fast and accurate risk analysis. Specifically, we introduced SE and CBAM attention mechanisms into the YOLO network and integrated the optimized modules into the HRNet architecture to improve the accuracy of human pose recognition. This approach effectively addresses common interferences in garment production environments, such as fabric accumulation, equipment occlusion, and complex hand movements, while significantly enhancing the accuracy of human detection. On the COCO dataset, it increased mAP and recall by 4.43% and 5.99%, respectively, over YOLOv8. Furthermore, by analyzing key postural features from worker videos of cutting, sewing, and pressing, we achieved a quantified ergonomic risk assessment. Experimental results indicate that the RULA scores calculated using this algorithm are highly consistent and stable with expert evaluations and accurately reflect the dynamic changes in ergonomic risk levels across different processes. It is important to note that the validation was based on a pilot study involving a limited number of workers and task types, meaning that the findings primarily demonstrate feasibility rather than full-scale generalizability. Even so, the algorithm outperforms existing lightweight solutions and can be deployed in real-time on edge devices within factories, providing a low-cost ergonomic monitoring tool for the garment manufacturing industry. This helps prevent and reduce musculoskeletal injuries among workers.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Ergonomics and Musculoskeletal Disorders · Human Pose and Action Recognition · Muscle activation and electromyography studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Furnishings and Industrial Design, Nanjing Forestry University, Nanjing 210037, China

Jiangsu Co-Innovation Center of Efficient Processing and Utilization of Forest Resources, Nanjing 210037, China

References (67)

Show source-provided references
1. Investigation of ergonomic working conditions of sewing and cutting machine operators of clothing industry10.35530/IT.072.03.1723 ↗
2. Occupational health and Safety for Sewing Machine Operators in Pakistan: Revealing Hazards in Small and Medium Garment Enterprises
3. Ergonomic posture recognition using 3D view-invariant features from single ordinary camera10.1016/j.autcon.2018.05.033 ↗
4. Analysis of upper-limb muscle fatigue in the process of rotary handling10.1016/j.ergon.2021.103109 ↗
5. A physiological and biomechanical investigation of three passive upper-extremity exoskeletons during simulated overhead work10.1080/00140139.2021.1963490 ↗
6. Exploring the creation of multi-modal soundscapes in the indoor environment: A study of stimulus modality and scene type affecting physiological recovery10.1016/j.jobe.2025.113327 ↗
7. Lightweight deep learning framework for recognizing construction workers’ activities based on simplified node combinations10.1016/j.autcon.2023.105236 ↗
8. Advancing Occupational Medicine through Wearable Technology: A Review of Sensor Systems for Biomechanical Risk Assessment and Work-Related Musculoskeletal Disorder Prevention10.1021/acssensors.5c01578 ↗
9. Automated Kinect-based posture evaluation method for work-related musculoskeletal disorders of construction workers10.1080/13467581.2024.2357202 ↗
10. A real-time posture assessment system based on motion capture data for manual maintenance and assembly processes10.1007/s00170-024-13114-9 ↗
11. Vision-based action recognition of construction workers using dense trajectories10.1016/j.aei.2016.04.009 ↗
12. A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory10.1016/j.autcon.2017.11.002 ↗
13. Wang, Z., Men, S., Bai, Y., Yuan, Y., Wang, J., Wang, K., and Zhang, L. (2024). Improved Small Object Detection Algorithm CRL-YOLOv5. Sensors, 24.10.20944/preprints202408.1218.v1 ↗
14. Agostinelli, T., Generosi, A., Ceccacci, S., Bevilacqua, A., Mengarelli, F., Fioretti, S., Verdini, M., Cacciagrano, D., Moccia, S., and Cenci, A. (2024). Validation of Computer Vision-Based Ergonomic Risk Assessment Tools for Real Manufacturing Environments. Sci. Rep., 14.10.1038/s41598-024-79373-4 ↗
15. A Review of Machine Learning Techniques for Ergonomic Risk Assessment Based on Human Pose Estimation10.1007/s44163-025-00566-5 ↗
16. Object Detection in 20 Years: A Survey10.1109/JPROC.2023.3238524 ↗
17. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
18. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
19. He, K.M., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 16th IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
20. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8–16). SSD: Single Shot MultiBox Detector. Proceedings of the 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
21. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR.2016.91 ↗
22. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
23. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
24. Bochkovskiy, A., Wang, C.-Y., and Mark Liao, H.-Y. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
25. Jocher, G. (2020). Ultralytics YOLOv5, Ultralytics.
26. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications. arXiv.
27. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 17–24). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
28. Jocher, G., Chaurasia, A., and Qiu, J. (2023). Ultralytics YOLOv8, Ultralytics.
29. Wang, C.Y., Yeh, J., and Liao, H.Y.M. (October, January 29). YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information. Proceedings of the 18th European Conference on Computer Vision (ECCV), Milan, Italy.
30. Yolov10: Real-time end-to-end object detection
31. Jocher, G. (2024). Ultralytics YOLO11, Ultralytics.
32. SO-YOLOv8: A novel deep learning-based approach for small object detection with YOLO beyond COCO10.1016/j.eswa.2025.127447 ↗
33. Jing, X.H., Liu, X.S., and Liu, B.L. (2024). Composite Backbone Small Object Detection Based on Context and Multi-Scale Information with Attention Mechanism. Mathematics, 12.10.3390/math12050622 ↗
34. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.
35. Woo, S.H., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
36. Deep Learning-based Human Pose Estimation: A Survey10.1145/3603618 ↗
37. Toshev, A., and Szegedy, C. (2014, January 23–28). DeepPose: Human Pose Estimation via Deep Neural Networks. Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1109/CVPR.2014.214 ↗
38. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields10.1109/TPAMI.2019.2929257 ↗
39. Xiao, B., Wu, H.P., and Wei, Y.C. (2018, January 8–14). Simple Baselines for Human Pose Estimation and Tracking. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01231-1_29 ↗
40. Deep High-Resolution Representation Learning for Visual Recognition10.1109/TPAMI.2020.2983686 ↗
41. Real-time ergonomic risk assessment in construction using a co-learning-powered 3D human pose estimation model10.1111/mice.13139 ↗
42. Jeong, S.O., and Kook, J. (2023). CREBAS: Computer-Based REBA Evaluation System for Wood Manufacturers Using MediaPipe. Appl. Sci., 13.10.3390/app13020938 ↗
43. AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time10.1109/TPAMI.2022.3222784 ↗
44. Cheng, B.W., Xiao, B., Wang, J.D., Shi, H.H., Huang, T.S., and Zhang, L. (2020, January 14–19). HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual.10.1109/CVPR42600.2020.00543 ↗
45. MDA-YOLO Person: A 2D human pose estimation model based on YOLO detection framework
46. Liu, L., Sun, Y.G., Li, Y.Y., and Liu, Y.H. (2025). A hybrid human fall detection method based on modified YOLOv8s and AlphaPose. Sci. Rep., 15.10.1038/s41598-025-86429-6 ↗
47. Prevalence of work-related musculoskeletal disorders and quality of life assessment among garment workers in Tiruppur district, Tamil Nadu10.1080/10803548.2023.2278939 ↗
48. Machine learning approach to determine the decision rules in ergonomic assessment of working posture in sewing machine operators10.1016/j.jsr.2023.08.008 ↗
49. Tahir, N.U., Long, Z., Zhang, Z.P., Asim, M., and Elaffendi, M. (2024). PVswin-YOLOv8s: UAV-Based Pedestrian and Vehicle Detection for Traffic Management in Smart Cities Using Improved YOLOv8. Drones, 8.10.3390/drones8030084 ↗
50. Li, R., Yan, A., Yang, S.Q., He, D., Zeng, X., and Liu, H.Y. (2024). Human Pose Estimation Based on Efficient and Lightweight High-Resolution Network (EL-HRNet). Sensors, 24.10.3390/s24020396 ↗
51. Newell, A., Huang, Z., and Deng, J. (2017, January 4–9). Associative Embedding: End-to-End Learning for Joint Detection and Grouping. Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
52. Papandreou, G., Zhu, T., Chen, L.C., Gidaris, S., Tompson, J., and Murphy, K. (2018, January 8–14). PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_17 ↗
53. Kocabas, M., Karagoz, S., and Akbas, E. (2018, January 8–14). MultiPoseNet: Fast Multi-Person Pose Estimation Using Pose Residual Network. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01252-6_26 ↗
54. Papandreou, G., Zhu, T., Kanazawa, N., Toshev, A., Tompson, J., Bregler, C., and Murphy, K. (2017, January 21–26). Towards Accurate Multi-person Pose Estimation in the Wild. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.395 ↗
55. Sun, X., Xiao, B., Wei, F.Y., Liang, S., and Wei, Y.C. (2018, January 8–14). Integral Human Pose Regression. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01231-1_33 ↗
56. Chen, Y.L., Wang, Z.C., Peng, Y.X., Zhang, Z.Q., Yu, G., and Sun, J. (2018, January 18–23). Cascaded Pyramid Network for Multi-Person Pose Estimation. Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00742 ↗
57. Sun, K., Xiao, B., Liu, D., Wang, J.D., and Soc, I.C. (2019, January 16–20). Deep High-Resolution Representation Learning for Human Pose Estimation. Proceedings of the 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗
58. Li, J.F., Bian, S.Y., Zeng, A.L., Wang, C., Pang, B., Liu, W.T., and Lu, C.W. (2021, January 11–17). Human Pose Regression with Residual Log-likelihood Estimation. Proceedings of the 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual.10.1109/ICCV48922.2021.01084 ↗
59. Li, Y.J., Zhang, S.K., Wang, Z.C., Yang, S., Yang, W.K., Xia, S.T., and Zhou, E.J. (2021, January 11–17). TokenPose: Learning Keypoint Tokens for Human Pose Estimation. Proceedings of the 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual.10.1109/ICCV48922.2021.01112 ↗
60. RULA: A survey method for the investigation of work-related upper limb disorders10.1016/0003-6870(93)90080-S ↗
61. Research of Insect Recognition Based on Improved YOLOv510.32604/jai.2021.026902 ↗
62. Hu, M., Zhang, Y.R., Jiao, T., Xue, H.J., Wu, X., Luo, J.G., Han, S.P., and Lv, H. (2024). An Enhanced Feature-Fusion Network for Small-Scale Pedestrian Detection on Edge Devices. Sensors, 24.10.3390/s24227308 ↗
63. Liu, C., Li, Y.Y., Gu, J.J., Lou, Y.Q., and Shen, T. (2023, January 2–7). Enhancing Pedestrian Target Recognition in Open Community Multi-Scene Spaces Using the Yolo-Stp Network. Proceedings of the 5th International-Society-for-Photogrammetry-and-Remote-Sensing (ISPRS) Geospatial Week (GSW), Cairo, Egypt.
64. Novel person detection and suspicious activity recognition using enhanced YOLOv5 and motion feature map10.1007/s10462-023-10630-0 ↗
65. Guidelines to sewing machine workstation design for improving working posture of sewing operator10.1016/j.ergon.2019.02.002 ↗
66. Yu, N., Guo, J., Hong, L., Wu, P.W., and Li, J. (2018, January 20–22). Study on Fatigue of Workers in the Row Drilling Operation of Furniture Manufacturing Based on Operational Energy Efficiency Analysis. Proceedings of the 18th International Conference on Man-Machine-Environment System Engineering (MMESE), MMESE Comm China, Nanjing, China.10.1007/978-981-13-2481-9_8 ↗
67. Big data for furniture intelligent manufacturing: Conceptual framework, technologies, applications, and challenges10.1007/s00170-024-13719-0 ↗