journal article·2025-10-11Open access

Intelligent Motion Classification via Computer Vision for Smart Manufacturing and Ergonomic Risk Prevention in SMEs

Armando Mares-Castro, Valentin Calzada-Ledesma, María Blanca Becerra-Rodríguez, Raúl Santiago-Montero, Anayansi Estrada-Monje

Applied Sciences· Volume 15· Issue 20

Abstract

The transition toward Industry 4.0 and the emerging concept of Industry 5.0 demand intelligent tools that integrate efficiency, adaptability, and human-centered design. This paper presents a Computer Vision-based framework for automated motion classification in Methods-Time Measurement 2 (MTM-2), with the aim of supporting industrial time studies and ergonomic risk assessment. The system uses a Convolutional Neural Network (CNN) for pose estimation and derives angular kinematic features of key joints to characterize upper limb movements. A two-stage experimental design was conducted: first, three lightweight classifiers—K-Nearest Neighbors (KNN), Support Vector Machines (SVMs), and a Shallow Neural Network (SNN)—were compared, with KNN demonstrating the best trade-off between accuracy and efficiency; second, KNN was tested under noisy conditions to assess robustness. The results show near-perfect accuracy (≈100%) on 8919 motion instances, with an average inference time of 1 microsecond per sample, reducing the analysis time compared to manual transcription. Beyond efficiency, the framework addresses ergonomic risks such as wrist hyperextension, offering a scalable and cost-effective solution for Small and Medium-sized Enterprises. It also facilitates integration with Manufacturing Execution Systems and Digital Twins, and is therefore aligned with Industry 5.0 goals.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Digital Transformation in Industry

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial Engineering, Tecnológico Nacional de México/ITS de Purísima del Rincón, Blvd. del Valle 2301, Guardarrayas, Purísima del Rincón 36413, Mexico

Department of Systems and Computing, Tecnológico Nacional de México/ITS de Purísima del Rincón, Blvd. del Valle 2301, Guardarrayas, Purísima del Rincón 36413, Mexico

Department of Industrial Engineering, Tecnológico Nacional de México/IT de Querétaro, Av. Tecnológico s/n esq. Gral. Mariano Escobedo, Colonia Centro Histórico, Querétaro 76000, Mexico

Department of Computer Systems, Tecnológico Nacional de México/IT de León, Av. Tecnológico s/n, Fracc. Industrial de Obregón, León 37290, Mexico

Industrial Processes and Energy Division, Centro de Innovación Aplicada en Tecnologías Competitivas, Omega 201. Col, Industrial Delta, León 37545, Mexico

Funding

National Institute of Technology of Mexico

References (28)

Show source-provided references
1. A VR-based approach in conducting MTM for manual workplaces10.1007/s00170-021-07260-7 ↗
2. Andreopoulos, E., Gorobets, V., and Kunz, A. (2022). Automatic MTM-Transcription in Virtual Reality Using the Digital Twin of a Workplace. Res. Sq.10.21203/rs.3.rs-2110194/v1 ↗
3. Automatic transcription of the Methods-Time Measurement MTM-1 motions in VR
4. Urban, M., Koblasa, F., and Mendřický, R. (2024). Machine Learning in Small and Medium-Sized Enterprises, Methodology for the Estimation of the Production Time. Appl. Sci., 14.10.3390/app14198608 ↗
5. Transformer Production Improvement by Lean and Mtm-2 Technique10.11113/aej.v12.16712 ↗
6. Visión por Computador aplicada al control de calidad en procesos de manufactura: Seguimiento en tiempo real de refrigeradores10.24050/reia.v15i30.1150 ↗
7. Detección de acción humana para el control de inventario utilizando visión por computadora
8. Gorobets, V., Andreopoulos, E., and Kunz, A. (2024). Automatic Transcription of the Basic MTM-2 Motions in Virtual Reality. Progress in IS, Spinger.10.1007/978-3-031-60313-6_19 ↗
9. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
10. A Comparative Empirical Evaluation of the Accuracy of the Novel Process Language MTM-Human Work Design10.1007/978-3-319-41697-7_14 ↗
11. Advancing Towards Automated Ergonomic Assessment: A Panel of Perspectives10.1007/978-3-030-74614-8_72 ↗
12. ME-WARD: A multimodal ergonomic analysis tool for musculoskeletal risk assessment from inertial and video data in working places10.1016/j.eswa.2025.127212 ↗
13. Posture Risk Assessment and Workload Estimation for Material Handling by Computer Vision10.1155/2023/2085251 ↗
14. Kunz, M., Shu, C., Picard, M., Vera, D.A., Hopkinson, P., and Xi, P. (2022, January 24–26). Vision-based Ergonomic and Fatigue Analyses for Advanced Manufacturing. Proceedings of the 2022 IEEE 5th International Conference on Industrial Cyber-Physical Systems (ICPS), Coventry, UK.10.1109/ICPS51978.2022.9816946 ↗
15. A Systematic Review: Advancing Ergonomic Posture Risk Assessment through the Integration of Computer Vision and Machine Learning Techniques10.1109/ACCESS.2024.3509447 ↗
16. Kasani, A.A., and Sajedi, H. (2022, January 3–5). Predict joint angle of body parts based on sequence pattern recognition. Proceedings of the 2022 16th International Conference on Ubiquitous Information Management and Communication (IMCOM), Seoul, Republic of Korea.10.1109/IMCOM53663.2022.9721801 ↗
17. Cruciata, L., Contino, S., Ciccarelli, M., Pirrone, R., Mostarda, L., Papetti, A., and Piangerelli, M. (2025). Lightweight Vision Transformer for Frame-Level Ergonomic Posture Classification in Industrial Workflows. Sensors, 25.10.3390/s25154750 ↗
18. Ergonomic risk assessment application based on computer vision and machine learning; Bilgisayarlı görü ve makine öğrenmesi ile ergonomik risk değerlendirme uygulaması
19. Validation of computer vision-based ergonomic risk assessment tools for real manufacturing environments10.1038/s41598-024-79373-4 ↗
20. Automated Transcription of MTM Motions in a Virtual Environment10.1007/978-981-97-3556-3_20 ↗
21. Liang, G., Chen, F., Liang, Y., Feng, Y., Wang, C., and Wu, X. (2021). A Manufacturing-Oriented Intelligent Vision System Based on Deep Neural Network for Object Recognition and 6D Pose Estimation. Front. Neurorobot., 14.10.3389/fnbot.2020.616775 ↗
22. Computer Vision Techniques in Manufacturing10.1109/TSMC.2022.3166397 ↗
23. AI and Computer Vision-based Real-time Quality Control: A Review of Industrial Applications10.1016/j.procs.2023.12.195 ↗
24. De Feudis, I., Buongiorno, D., Grossi, S., Losito, G., Brunetti, A., Longo, N., Di Stefano, G., and Bevilacqua, V. (2022). Evaluation of Vision-Based Hand Tool Tracking Methods for Quality Assessment and Training in Human-Centered Industry 4.0. Appl. Sci., 12.10.3390/app12041796 ↗
25. Valle, M., Lehmhus, D., Gianoglio, C., Ragusa, E., Seminara, L., Bosse, S., Ibrahim, A., and Thoben, K.D. (2023). Image Based Classification of Methods-Time Measurement Operations in Assembly Using Recurrent Neuronal Networks. Proceedings of the Advances in System-Integrated Intelligence, Springer International Publishing.10.1007/978-3-031-16281-7 ↗
26. Deep Learning-Based Recognition of Unsafe Acts in Manufacturing Industry10.1109/ACCESS.2023.3318114 ↗
27. Tolio, T. (2024). AI-Based Pose Estimation of Human Operators in Manufacturing Environments. CIRP Novel Topics in Production Engineering: Volume 1, Springer Nature.
28. Gradient-based learning applied to document recognition10.1109/5.726791 ↗