journal article·2024-01-01Open access

Research on the opening method of robotic arm based on force feedback reinforcement learning

Ziyang Zhou, Liming Wang, Yang Wang

AIP Advances· Volume 14· Issue 1

Abstract

In practical applications involving robotic arms, particularly in tasks such as manipulating door handles, improper strategies often lead to excessive contact forces. Such forces not only jeopardize the integrity of the robotic arm’s joints but also pose a risk of damaging the door handle. This paper delves into a meticulous study aimed at refining the opening techniques employed by manipulators, enhancing their adaptability across various environments. A novel method is introduced, amalgamating force information feedback with the deep deterministic policy gradient algorithm, fostering a more nuanced approach in trajectory planning. This innovative strategy is meticulously evaluated through simulations and physical experiments, proving instrumental in guiding the robotic arm toward the successful completion of the door-opening task. The findings from the experiments underscore the algorithm’s prowess in cultivating a compliant door-opening strategy, harmonizing with the force applied at the manipulator’s end. A comparative analysis with conventional methods reveals a notable reduction in the end force of the manipulator, facilitating a more efficient and secure execution of door-opening operations.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robot Manipulation and Learning · Teleoperation and Haptic Systems · Elevator Systems and Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical Engineering, Naval University of Engineering , Wuhan 430030, China

References (25)

Show source-provided references
1. Dynamic adaptive hybrid impedance control for dynamic contact force tracking in uncertain environments10.1109/ACCESS.2019.2924696 ↗
2. Smooth adaptive hybrid impedance control for robotic contact force tracking in dynamic environments10.1108/IR-09-2019-0191 ↗
3. Cutting performances with new industrial continuous wave ND:YAG high power lasers10.1016/j.nucengdes.2010.06.041 ↗
4. Planning for autonomous door opening with a mobile manipulator
5. Visual tracking manipulator with redundancy and its application to robotic wheel assembly
6. Markov decision processes
7. Motion learning and adaptive impedance for robot control during physical interaction with humans
8. Pulling open doors and drawers: Coordinating an omni-directional base and a compliant arm with equilibrium point control
9. Learning to open new doors
10. Genetic algorithm and simulated annealing for optimal robot arm PID control
11. Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D., “Continuous control with deep reinforcement learning,” arXiv.1509.02971 (2015).
12. Door opening by joining reinforcement learning and intelligent control
13. Overview of the CPS for smart factories project: Deep learning, knowledge acquisition, anomaly detection and intelligent user interfaces10.1007/978-3-319-42559-7_19 ↗
14. Vision-based detection for learning articulation models of cabinet doors and drawers in household environments
15. Design and implementation of a mobile robot with autonomous door opening ability10.1007/s40815-018-0557-5 ↗
16. Deep reinforcement learning for continuous-time self-triggered control10.1016/j.ifacol.2021.10.353 ↗
17. Auto-sorting system toward smart factory based on deep learning for image segmentation10.1109/JSEN.2018.2866943 ↗
18. Research on door opening operation of mobile robotic arm based on reinforcement learning10.3390/app12105204 ↗
19. Preferable movement of a multijoint robot arm using a genetic algorithm10.1117/12.360286 ↗
20. Multidisciplinary co-design optimization of structural and control parameters for bucket wheel reclaimer10.1007/s11465-019-0578-2 ↗
21. Optimization of an auto drum fashioned brake using the elite opposition-based learning and chaotic k-best gravitational search strategy based grey wolf optimizer algorithm10.1016/j.asoc.2022.108947 ↗
22. Multidisciplinary design optimization of dynamic positioning system for semi-submersible platform10.1016/j.oceaneng.2023.115426 ↗
23. An adaptive resistance and stamina strategy-based dragonfly algorithm for solving engineering optimization problems10.1108/EC-08-2019-0362 ↗
24. Learning-imitation strategy-assisted alpine skiing optimization for the boom of offshore drilling platform10.1016/j.oceaneng.2023.114317 ↗
25. A complete and parametrically continuous kinematic model for robot manipulators