journal article·2025-08-26Open access

Adaptive A*–Q-Learning–DWA Fusion with Dynamic Heuristic Adjustment for Safe Path Planning in Spraying Robots

Chang Su, Liangliang Zhao, Dongbing Xiang

Applied Sciences· Volume 15· Issue 17

Abstract

In underground coal mines, narrow and irregular tunnels, dust, and gas hazards pose significant challenges to robotic path planning, particularly for shotcrete operations. The traditional A* algorithm has the limitations of limited safety, excessive node expansion, and insufficient dynamic obstacle avoidance capabilities. To address these, a hybrid algorithm integrating adaptive A*, Q-learning, and the Dynamic Window Approach (DWA) is proposed. The A* component is enhanced through improvements to its evaluation function and node selection strategy, incorporating dynamically adjustable neighborhood sampling to improve search efficiency. Q-learning re-plans unsafe trajectories in complex environments using a redesigned reward mechanism and an adaptive exploration strategy. The DWA module facilitates real-time obstacle avoidance in dynamic scenarios by optimizing both the velocity space and the trajectory evaluation process. The simulation results indicate that the proposed algorithm reduces the number of path nodes by approximately 30%, reduces the computational time by approximately 20% on 200 × 200 grids, and increases the path length by only 10%. These results demonstrate that the proposed approach effectively balances global path optimality with local adaptability, significantly improving the safety and real-time performance in complex underground environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotic Path Planning Algorithms · Autonomous Vehicle Technology and Safety · Teleoperation and Haptic Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Electrical Engineering, Anhui University of Science and Technology, Huainan 232001, China

Funding

The National Natural Science Foundation

References (26)

Show source-provided references
1. Li, C., and Zhang, X. (2023, January 15–17). Operation technology of unmanned mining robot for coal mine based on intelligent control technology. Proceedings of the 2023 International Conference on Computer Simulation and Modeling, Information Security (CSMIS), Buenos Aires, Argentina.10.1109/CSMIS60634.2023.00021 ↗
2. Liu, Z. (2022, January 11–15). Navigation system of coal mine rescue robot based on virtual reality technology. Proceedings of the 2022 World Automation Congress (WAC), San Antonio, TX, USA.10.23919/WAC55640.2022.9934676 ↗
3. Zhang, H., Xie, X., Wei, M., Wang, X., Song, D., and Luo, J. (2024, January 4–7). An improved goal-bias RRT algorithm for unmanned aerial vehicle path planning. Proceedings of the 2024 IEEE International Conference on Mechatronics and Automation (ICMA), Tianjin, China.10.1109/ICMA61710.2024.10633102 ↗
4. Fu, S. (2024, January 21–23). Robot Path Planning Optimization Based on RRT and APF Fusion Algorithm. Proceedings of the 2024 8th International Conference on Robotics and Automation Sciences (ICRAS), Tokyo, Japan.10.1109/ICRAS62427.2024.10654464 ↗
5. Zhu, W., and Qiu, G. (2025). Path Planning of Intelligent Mobile Robots with an Improved RRT Algorithm. Appl. Sci., 15.10.3390/app15063370 ↗
6. Wu, D., and Li, Y. (2024, January 20–22). Mobile Robot Path Planning Based on Improved Smooth A* Algorithm and Optimized Dynamic Window Approach. Proceedings of the 2024 2nd International Conference on Signal Processing and Intelligent Computing (SPIC), Guangzhou, China.10.1109/SPIC62469.2024.10691465 ↗
7. Meng, F., Sun, X., Zhu, J., Mei, B., and Zheng, P. (2024;, January 12–14). Research on Ship Path Planning Based on Bidirectional A*-APF Algorithm. Proceedings of the 2024 4th International Conference on Consumer Electronics and Computer Engineering (ICCECE), Guangzhou, China.10.1109/ICCECE61317.2024.10504166 ↗
8. An improved A* algorithm for the industrial robot path planning with high success rate and short length10.1016/j.robot.2018.04.007 ↗
9. Lv, Y., Wang, J., Yang, H., and Zhang, X. (2024, January 8–12). Dynamic Guidance Point Obstacle Avoidance Planning Method and Optimization Based on DWA. Proceedings of the 2024 International Conference on Cyber-Physical Social Intelligence (ICCSI), Doha, Qatar.10.1109/ICCSI62669.2024.10799233 ↗
10. An Improved FFPF-APF Path Planning
11. Zhang, H.M., Li, M.L., and Yang, L. (2018). Safe path planning of mobile robot based on improved A* algorithm in complex terrains. Algorithms, 11.10.3390/a11040044 ↗
12. Zhang, J., Ling, H., Tang, Z., Song, W., and Lu, A. (2025). Path planning of USV in confined waters based on improved A∗ and DWA fusion algorithm. Ocean. Eng., 322.10.1016/j.oceaneng.2025.120475 ↗
13. Fu, X., Huang, Z., Zhang, G., Wang, W., and Wang, J. (2025). Research on path planning of mobile robots based on improved A* algorithm. PeerJ Comput. Sci., 11.10.7717/peerj-cs.2691 ↗
14. Jing, M., and Wang, H. (2023). Robot path planning by integrating improved A* algorithm and DWA algorithm. J. Phys. Conf. Ser., 492.10.1088/1742-6596/2492/1/012017 ↗
15. Huang, X., and Li, G. (2023, January 18–20). An improved Q-learning algorithm for path planning. Proceedings of the 2023 IEEE International Conference on Sensors, Electronics and Computer Engineering (ICSECE), Jinzhou, China.10.1109/ICSECE58870.2023.10263441 ↗
16. Dp-a*: For path planing of ugv and contactless delivery10.1109/TITS.2023.3258186 ↗
17. Liao, C., Wang, S., Wang, Z., and Zhai, Y. (2025, January 21–23). GAA-DFQ: A dual-layer learning model for robot path planning in dynamic environments integrating genetic algorithms, DWA, fuzzy control and Q-learning. Proceedings of the 2025 8th International Conference on Advanced Algorithms and Control Engineering (ICAACE), Shanghai, China.10.1109/ICAACE65325.2025.11019886 ↗
18. On Practical Robust Reinforcement Learning: Adjacent Uncertainty Set and Double-Agent Algorithm10.1109/TNNLS.2024.3385234 ↗
19. De Carvalho, K.B., de OBBatista, H., Fagundes-Junior, L.A., de Oliveira, I.R.L., and Brandão, A.S. (2025). Q-learning global path planning for UAV navigation with pondered priorities. Intell. Syst. Appl., 25.10.1016/j.iswa.2025.200485 ↗
20. Lu, Y., and Da, C. (2025). Global and local path planning of robots combining ACO and dynamic window algorithm. Sci. Rep., 15.10.1038/s41598-025-93571-8 ↗
21. Du, X., Luo, P., and Lv, X. (2024, January 25–27). Path Planning Algorithm Based on Improved RRT and Artificial Potential Field. Proceedings of the 2024 8th International Conference on Electrical, Mechanical and Computer Engineering (ICEMCE), Xi’an, China.10.1109/ICEMCE64157.2024.10861913 ↗
22. Path planning based on fusion of improved A* and ROA-DWA for robot
23. Wang, P., and Gupta, K. (2004). View planning via maximal c-space entropy reduction. Algorithmic Foundations of Robotics V, Springer.10.1007/978-3-540-45058-0_10 ↗
24. Lanillos, P., Besada-Portas, E., Pajares, G., and Ruz, J.J. (2012, January 7–12). Minimum time search for lost targets using cross entropy optimization. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal.10.1109/IROS.2012.6385510 ↗
25. Gong, X., Gao, Y., Wang, F., Zhu, D., Zhao, W., Wang, F., and Liu, Y. (2024). A local path planning algorithm for robots based on improved DWA. Electronics, 13.10.3390/electronics13152965 ↗
26. Uncertainty-Aware Safe Trajectory Planner Based on Model Predictive Control for Autonomous Driving10.1109/TITS.2025.3554836 ↗