A Symmetrical Leech-Inspired Soft Crawling Robot Based on Gesture Control
Source abstract
Abstract
This paper presents a novel soft crawling robot controlled by gesture recognition, aimed at enhancing the operability and adaptability of soft robots through natural human–computer interactions. The Leap Motion sensor is employed to capture hand gesture data, and Unreal Engine is used for gesture recognition. Using the UE4Duino, gesture semantics are transmitted to an Arduino control system, enabling direct control over the robot’s movements. For accurate and real-time gesture recognition, we propose a threshold-based method for static gestures and a backpropagation (BP) neural network model for dynamic gestures. In terms of design, the robot utilizes cost-effective thermoplastic polyurethane (TPU) film as the primary pneumatic actuator material. Through a positive and negative pressure switching circuit, the robot’s actuators achieve controllable extension and contraction, allowing for basic movements such as linear motion and directional changes. Experimental results demonstrate that the robot can successfully perform diverse motions under gesture control, highlighting the potential of gesture-based interaction in soft robotics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Soft Robotics and Applications · Modular Robots and Swarm Intelligence · Robot Manipulation and Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Key Laboratory of Mechanism Theory and Equipment Design, Ministry of Education, Tianjin University, Tianjin 300072, China
School of Mechanical Engineering, Zhejiang University, Hangzhou 310058, China
Funding
National Natural Science Foundation of China
References (25)
Show source-provided references
1. Soft Robotics: A Bioinspired Evolution in Robotics10.1016/j.tibtech.2013.03.002 ↗
2. Soft Robots and Society10.1089/soro.2015.1501 ↗
3. A Hybrid Combining Hard and Soft Robots10.1089/soro.2013.0002 ↗
4. Design, Fabrication and Control of Soft Robots10.1038/nature14543 ↗
5. Untethered Soft Robot Capable of Stable Locomotion Using Soft Electrostatic Actuators10.1016/j.eml.2018.02.004 ↗
6. A Review of 3D Printing Processes and Materials for Soft Robotics10.1108/RPJ-11-2019-0302 ↗
7. Soft Robotics: Challenges and Perspectives10.1016/j.procs.2011.12.030 ↗
8. Heung, H., Chiu, P.W.Y., and Li, Z. (2016, January 3–7). Design and Prototyping of a Soft Earthworm-like Robot Targeted for GI Tract Inspection. Proceedings of the 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), Qingdao, China.10.1109/ROBIO.2016.7866371 ↗
9. Single-Actuator Soft Robot for In-Pipe Crawling10.1089/soro.2021.0220 ↗
10. Ozkan-Aydin, Y., Liu, B., Ferrero, A.C., Seidel, M., Hammond, F.L., and Goldman, D.I. (2021). Lateral Bending and Buckling Aids Biological and Robotic Earthworm Anchoring and Locomotion. Bioinspir. Biomim., 17.10.1101/2021.02.02.429151 ↗
11. Hydraulically Amplified Self-Healing Electrostatic Actuators with Muscle-like Performance10.1126/science.aao6139 ↗
12. Electrostatically Driven Kresling Origami Soft Pump10.1109/LRA.2024.3419640 ↗
13. An Integrated Design and Fabrication Strategy for Entirely Soft, Autonomous Robots10.1038/nature19100 ↗
14. An Untethered, Jumping Roly-Poly Soft Robot Driven by Combustion10.1089/soro.2014.0021 ↗
15. A 3D-Printed, Functionally Graded Soft Robot Powered by Combustion10.1126/science.aab0129 ↗
16. Gesture-Based Steering Framework for Redundant Soft Robots10.1109/TMECH.2024.3382984 ↗
17. A Survey of Glove-Based Input10.1109/38.250916 ↗
18. Artal-Sevil, J.S., and Montanes, J.L. (2016, January 22–24). Development of a Robotic Arm and Implementation of a Control Strategy for Gesture Recognition through Leap Motion Device. Proceedings of the 2016 Technologies Applied to Electronics Teaching (TAEE 2016), Seville, Spain.10.1109/TAEE.2016.7528373 ↗
19. Natural Gesture Control of a Delta Robot Using Leap Motion
20. The Attitude Control Method and Realization of Micro Rotor-Craft Based on Natural Interaction
21. Development of a Neural Network-Based Control System for the DLR-HIT II Robot Hand Using Leap Motion10.1109/ACCESS.2019.2942648 ↗
22. Hand Gesture Control and Design of a Rotary Pneumatic Soft Actuator Using Leap Motion Sensor10.1007/s41315-020-00140-5 ↗
23. Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures10.1109/TMM.2018.2856094 ↗
24. Li, C., Fahmy, A., and Sienz, J. (2019). An Augmented Reality Based Human-Robot Interaction Interface Using Kalman Filter Sensor Fusion. Sensors, 19.10.3390/s19204586 ↗
25. Hand Gesture Recognition Enhancement Based on Spatial Fuzzy Matching in Leap Motion10.1109/TII.2019.2931140 ↗