Controlling Industrial Robotic Arms Using Gyroscopic and Gesture Inputs from a Smartwatch
Source abstract
Abstract
This paper presents a novel interface that leverages a smartwatch for controlling industrial robotic arms. By harnessing the gyroscope and advanced gesture recognition capabilities of the smartwatch, our solution facilitates intuitive, real-time manipulation that caters to users ranging from novices to seasoned professionals. A dedicated application is implemented to aggregate sensor data via an open-source library, providing a streamlined alternative to conventional control systems. The experimental setup consists of a smartwatch equipped with a data collection application, a robotic arm, and a communication module programmed in Python. Our aim is to evaluate the practicality and effectiveness of smartwatch-based control in a real-world industrial context. The experimental results indicate that this approach significantly enhances accessibility while concurrently minimizing the complexity typically associated with automation systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hand Gesture Recognition Systems · Robotics and Automated Systems · Robot Manipulation and Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Robots and Production Systems Department, The Faculty of Industrial Engineering and Robotics, National University of Science and Technology POLITEHNICA Bucharest, Splaiul Independenței 313, 060041 Bucharest, Romania
Department of Machine Construction Technology, The Faculty of Industrial Engineering and Robotics, National University of Science and Technology POLITEHNICA Bucharest, Splaiul Independenței 313, 060041 Bucharest, Romania
Education Team, PTC Eastern Europe SRL, Splaiul Independenței 319, 060044 Bucharest, Romania
References (24)
Show source-provided references
1. Human factors in cobot era: A review of modern production systems features10.1007/s10845-022-01953-w ↗
2. Dzedzickis, A., Subačiūtė-Žemaitienė, J., Šutinys, E., Samukaitė-Bubnienė, U., and Bučinskas, V. (2022). Advanced Applications of Industrial Robotics: New Trends and Possibilities. Appl. Sci., 12.10.3390/app12010135 ↗
3. Olteanu, A., Marian, C.G., and Pietraru, R.N. (2025). Smartwatch-Based Monitoring and Alert System for Factory Operators Using Public Cloud Services. Appl. Sci., 15.10.3390/app15052806 ↗
4. Nahavandi, S. (2019). Industry 5.0—A Human-Centric Solution. Sustainability, 11.10.3390/su11164371 ↗
5. Kim, Y.H., Kim, S., and Nam, H.S. (2025). Application of Smart Watch-Based Functional Evaluation for Upper Extremity Impairment: A Preliminary Study on Older Emirati Stroke Population. Sensors, 25.10.3390/s25051554 ↗
6. Škulj, G., Vrabič, R., and Podržaj, P. (2021). A Wearable IMU System for Flexible Teleoperation of a Collaborative Industrial Robot. Sensors, 21.10.3390/s21175871 ↗
7. Weigend, F.C., Kumar, N., Aran, O., and Ben Amor, H. (2025). WearMoCap: Multimodal Pose Tracking for Ubiquitous Robot Control Using a Smartwatch. Front. Robot. AI, 11.10.3389/frobt.2024.1478016 ↗
8. An IMUs and potentiometer-based controller for robotic arm-hand teleoperation10.1016/j.sna.2024.115019 ↗
9. Novel Technique for Control of Industrial Robots with Wearable and Contactless Technologies10.1016/j.measurement.2022.110850 ↗
10. Computer Vision-Based Hand Gesture Recognition for Human–Robot Interaction: A Review10.1007/s40747-023-01173-6 ↗
11. Development of Smartphone-Based Human–Robot Interfaces for Individuals with Disabilities10.1109/LRA.2020.3010453 ↗
12. Papanagiotou, D., Senteri, G., and Manitsaris, S. (2021). Egocentric Gesture Recognition Using 3D CNNs for the Spatiotemporal Adaptation of Collaborative Robots. Front. Neurorobot., 15.10.3389/fnbot.2021.703545 ↗
13. Weigend, F.C., Sonawani, S.D., Drolet, M., and Ben Amor, H. (2023, January 1–5). Anytime, Anywhere: Human Arm Pose from Smartwatch Data for Ubiquitous Robot Control and Teleoperation. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.10.1109/IROS55552.2023.10341624 ↗
14. Xie, J., Xu, Z., Zeng, J., Gao, Y., and Hashimoto, K. (2025). Human–Robot Interaction Using Dynamic Hand Gesture for Teleoperation of Quadruped Robots with a Robotic Arm. Electronics, 14.10.3390/electronics14050860 ↗
15. Kinematics Modeling of the ABB7600 Robot
16. Gesture Recognition for Human–Robot Collaboration: A Review10.1016/j.ergon.2017.02.004 ↗
17. Gesture-based human-robot interaction for human assistance in manufacturing10.1007/s00170-018-2788-x ↗
18. NVP-HRI: Zero Shot Natural Voice and Posture-Based Human–Robot Interaction via Large Language Model
19. Wang, X., Shen, H., Yu, H., Guo, J., and Wei, X. (2022, January 16–18). Hand and Arm Gesture-Based HRI: A Review. Proceedings of the ICACS 2022, Larissa, Greece.
20. IRIS—A Wearable Device for Monitoring Movement Disorders
21. Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications10.1016/j.mechatronics.2018.02.009 ↗
22. ADRC-Based Robust DC Voltage Control of the Grid-Connected VSC in DC Microgrid
23. Transfer Function Analysis and Implementation of Active Disturbance Rejection Control10.1007/s11768-021-00031-5 ↗
24. (2025, January 22). Available online: https://www.doublepoint.com/.