Applying Reinforcement Learning for AMR’s Docking and Obstacle Avoidance Behavior Control
Source abstract
Abstract
In recent years, advancements in artificial intelligence (AI) have become an essential study for machine learning. The use of AI with the Robot Operating System (ROS) enables mobile robots to learn and move autonomously. Mobile robots can now be widely used in industrial and service sectors. Generally, robots have been operated on fixed paths requiring set points to function. This study utilizes Deep Q-Network (DQN) incorporating filtering to train and reward AprilTag images, paths, and obstacle avoidance. Training is conducted in a Gazebo simulation environment, and the collected data is verified on physical mobile robots. The DQN network excels in computing complex functions; AprilTag provides X, Y, Z, Pitch, Yaw, and Roll data. By employing DQN methods, recognition and path accuracy are simultaneously enhanced. The constructed DQN network can endow mobile robots with autonomous learning capabilities.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Reinforcement Learning in Robotics · Autonomous Vehicle Technology and Safety · Robotic Path Planning Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical Engineering, National Yunlin University of Science and Technology, Douliou 64002, Taiwan
Graduate School of Engineering Science and Technology, National Yunlin University of Science and Technology, Douliou 64002, Taiwan
References (26)
Show source-provided references
1. Non-Contact Service Robot Development in Fast-Food Restaurants10.1109/ACCESS.2022.3155661 ↗
2. Immune Deep Reinforcement Learning-Based Path Planning for Mobile Robot in Unknown Environment10.1016/j.asoc.2023.110601 ↗
3. Bailey, T., Nieto, J., Guivant, J., Stevens, M., and Nebot, E. (2006, January 9–15). Consistency of the EKF-SLAM Algorithm. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Beijing, China.10.1109/IROS.2006.281644 ↗
4. Improved Techniques for Grid Mapping with Rao-Blackwellized Particle Filters10.1109/TRO.2006.889486 ↗
5. Da Silva, B.M.F., Xavier, R.S., Do Nascimento, T.P., and Goncalves, L.M.G. (2017, January 6–10). Experimental Evaluation of ROS-Compatible SLAM Algorithms for RGB-D Sensors. Proceedings of the Latin American Robotics Symposium (LARS), Curitiba, Brazil.10.1109/SBR-LARS-R.2017.8215331 ↗
6. Distributed Error Correction of EKF Algorithm in Multisensory Fusion Localization Model10.1109/ACCESS.2020.2995170 ↗
7. Sinisa, M. (2022). Evaluation of SLAM Methods and Adaptive Monte Carlo Localization. [Doctoral Dissertation, Vienna University of Technology]. Available online: https://api.semanticscholar.org/CorpusID:251380609.
8. Application of Recent Developments in Deep Learning to ANN-based Automatic Berthing Systems.International10.46604/ijeti.2020.4354 ↗
9. Multi-Robot Path Planning Based on a Deep Reinforcement Learning DQN Algorithm10.1049/trit.2020.0024 ↗
10. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
11. Badia, A.P., Sprechmann, P., Vitvitskyi, A., Guo, D., Piot, B., Kapturowski, S., Tieleman, O., Arjovsky, M., Pritzel, A., and Bolt, A. (2020). Never Give Up: Learning Directed Exploration Strategies. arXiv.
12. Zong, L., Yu, Y., Wang, J., Liu, P., Feng, W., Dai, X., Chen, L., Gunawan, C., Yun, S.J., and Amal, R. (2023). Oxygen-Vacancy-Rich Molybdenum Carbide MXene Nanonetworks for Ultrasound-Triggered and Capturing-Enhanced Sonocatalytic Bacteria Eradication. Biomaterials, 296.10.1016/j.biomaterials.2023.122074 ↗
13. Artificial Potential Field Incorporated Deep-Q-Network Algorithm for Mobile Robot Path Prediction10.32604/iasc.2023.028126 ↗
14. Zhang, J., Xu, Z., Wu, J., Chen, Q., and Wang, F. (2022, January 23–25). Lightweight Intelligent Autonomous Unmanned Vehicle Based on Deep Neural Network in ROS System. Proceedings of the 2022 IEEE 5th International Conference on Information Systems and Computer Aided Education (ICISCAE), Dalian, China.10.1109/ICISCAE55891.2022.9927506 ↗
15. Miyama, M. (2022, January 28–30). Robust Inference of Multi-Task Convolutional Neural Network for Advanced Driving Assistance by Embedding Coordinates. Proceedings of the 8th World Congress on Electrical Engineering and Computer Systems and Science (EECSS), Prague, Czech Republic. Available online: https://api.semanticscholar.org/CorpusID:251856335.10.11159/mvml22.105 ↗
16. Moroccan’s Arabic Speech Training and Deploying Machine Learning Models with Teachable Machine10.1016/j.procs.2022.07.120 ↗
17. Copot, C., Shi, L., Smet, E., Ionescu, C., and Vanlanduit, S. (2022, January 6–9). Comparison of Deep Learning Models in Position-Based Visual Servoing. Proceedings of the 2022 IEEE 27th International Conference on Emerging Technologies and Factory Automation (ETFA), Stuttgart, Germany.10.1109/ETFA52439.2022.9921442 ↗
18. Intermittent Deployment for Large-Scale Multi-Robot Forage Perception: Data Synthesis, Prediction, and Planning10.1109/TASE.2022.3211873 ↗
19. Real-Time Detection of Ripe Oil Palm Fresh Fruit Bunch Based on YOLOv410.1109/ACCESS.2022.3204762 ↗
20. Lin, H.Z., Chen, H.H., Choophutthakan, K., and Li, C.H. (2022, January 11–15). Autonomous Mobile Robot as a Cyber-Physical System Featuring Networked Deep Learning and Control. Proceedings of the 2022 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Sapporo, Japan.10.1109/AIM52237.2022.9863365 ↗
21. Mandel, N., Sandino, J., Galvez-Serna, J., Vanegas, F., Milford, M., and Gonzalez, F. (2022, January 5–12). Resolution-Adaptive Quadtrees for Semantic Segmentation Mapping in UAV Applications. Proceedings of the 2022 IEEE Aerospace Conference (AERO), Big Sky, MT, USA.10.1109/AERO53065.2022.9843498 ↗
22. The Method for Automatic Adjustment of AGV’s PID Based on Deep Reinforcement Learning10.1088/1742-6596/2320/1/012008 ↗
23. Using Deep Learning Technology to Realize the Automatic Control Program of Robot Arm Based on Hand Gesture Recognition10.46604/ijeti.2021.7342 ↗
24. Yin, Y., Chen, Z., Liu, G., and Guo, J. (2023). Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework. Sensors, 23.10.3390/s23042036 ↗
25. Escobar-Naranjo, J., Caiza, G., Ayala, P., Jordan, E., Garcia, C.A., and Garcia, M.V. (2023). Autonomous Navigation of Robots: Optimization with DQN. Appl. Sci., 13.10.3390/app13127202 ↗
26. Li, J., Chavez-Galaviz, J., Azizzadenesheli, K., and Mahmoudian, N. (2023). Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller. Sensors, 23.10.3390/s23073572 ↗