Study on Reinforcement Learning-Based Missile Guidance Law
Source abstract
Abstract
Reinforcement learning is generating considerable interest in terms of building guidance law and solving optimization problems that were previously difficult to solve. Since reinforcement learning-based guidance laws often show better robustness than a previously optimized algorithm, several studies have been carried out on the subject. This paper presents a new approach to training missile guidance law by reinforcement learning and introducing some notable characteristics. The novel missile guidance law shows better robustness to the controller-model compared to the proportional navigation guidance. The neural network in this paper has identical inputs with proportional navigation guidance, which makes the comparison fair, distinguishing it from other research. The proposed guidance law will be compared to the proportional navigation guidance, which is widely known as quasi-optimal of missile guidance law. Our work aims to find effective missile training methods through reinforcement learning, and how better the new method is. Additionally, with the derived policy, we contemplated which is better, and in which circumstances it is better. A novel methodology for the training will be proposed first, and the performance comparison results will be continued therefrom.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Guidance and Control Systems · Military Defense Systems Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Aerospace Engineering, Sejong University, Seoul 05006, Korea
Funding
Defense Acquisition Program Administration
References (13)
Show source-provided references
1. Fabian, S.T., Sumner, M.E., Wardill, T.J., Rossoni, S., and Gonzalez-Bellido, P.T. (2018). Interception by two predatory fly species is explained by a proportional navigation feedback controller. J. R. Soc. Interface, 15.10.1098/rsif.2018.0466 ↗
2. Terminal attack trajectories of peregrine falcons are described by the proportional navigation guidance law of missiles10.1073/pnas.1714532114 ↗
3. Gaudet, B., and Furfaro, R. (2012, January 13–16). Missile Homing-Phase Guidance Law Design Using Reinforcement Learning. Proceedings of the AIAA Guidance, Navigation, and Control Conference 2012, Minneapolis, MN, USA.10.2514/6.2012-4470 ↗
4. Reinforcement Learning for Angle-Only Intercept Guidance of Maneuvering Targets10.1016/j.ast.2020.105746 ↗
5. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv.
6. Zarchan, P. (2013). Tactical and Strategic Missile Guidance, American Institute of Aeronautics and Astronautics, Inc.. [6th ed.].10.2514/4.868948 ↗
7. Andrychowicz, M., Wolski, F., Ray, A., Schneider, J., Fong, R., Welinder, P., MacGrew, B., Tobin, J., Abbeel, P., and Zaremba, W. (2018). Hindsight Experience Replay. arXiv.
8. Lillicrap, T.P., Hunt, J.J., Pritzel, A.P., Heess, N.H., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2019). Continuous Control with Deep Reinforcement Learning. arXiv.
9. Gurfil, P. (2001, January 25–27). Robust Zero Miss Distance Guidance for Missiles with Parametric Uncertainties. Proceedings of the 2001 American Control Conference, Arlington, VA, USA.10.1109/ACC.2001.946148 ↗
10. Efficient and accurate online estimation algorithm for zero-effort-miss and time-to-go based on data driven method10.1016/j.cja.2019.05.013 ↗
11. Madany, Y.M., El-Badawy, E.A., and Soliman, A.M. (2016, January 6–8). Optimal Proportional Navigation Guidance Using Pseudo Sensor Enhancement Method (PSEM) for Flexible Interceptor Applications. Proceedings of the 2016 UKSim-AMSS 18th International Conference on Computer Modelling and Simulation (UKSim), Cambridge, UK.10.1109/UKSim.2016.35 ↗
12. Performance Evaluation of Proportional Navigation Guidance for Low-Maneuvering Targets
13. Robust Estimation of a Location Parameter10.1214/aoms/1177703732 ↗