journal article·2019-12-28Open access

Development of Deep Learning Based Human-Centered Threat Assessment for Application to Automated Driving Vehicle

Donghoon Shin, Hyun-geun Kim, Kang-moon Park, Kyongsu Yi

Applied Sciences· Volume 10· Issue 1

Abstract

This paper describes the development of deep learning based human-centered threat assessment for application to automated driving vehicle. To achieve naturalistic driver model that would feel natural while safe to a human driver, manual driving characteristics are investigated through real-world driving test data. A probabilistic threat assessment with predicted collision time and collision probability is conducted to evaluate driving situations. On the basis of collision risk analysis, two kinds of deep learning have been implemented to reflect human driving characteristics for automated driving. A deep neural network (DNN) and recurrent neural network (RNN) are designed by neural architecture search (NAS), and by learning from the sequential data, respectively. The NAS is used to automatically design the individual driver’s neural network for efficient and effortless design process while ensuring training performance. Sequential trends in the host vehicle’s state can be incorporated through hand-made RNN. It has been shown from human-centered risk assessment simulations that two successfully designed deep learning driver models can provide conservative and progressive driving behavior similar to a manual human driver in both acceleration and deceleration situations by preventing collision.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Traffic and Road Safety · Human-Automation Interaction and Safety

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical Systems Engineering, College of Engineering, Sookmyung Women’s University, Seoul 04310, Korea

Department of Computer Science, Korea Aerospace University, Goyang-si 10540, Korea

Department of Computer Science, College of Natural Science, Republic of Korea Naval Academy, Changwon-si 51704, Korea

Department of Mechanical and Aerospace Engineering, College of Engineering, Seoul National University, Seoul 08826, Korea

Funding

Sookmyung Women's University

References (31)

Show source-provided references
1. (2019, November 22). GM’s Cruise Rolls Back Its Target for Self-Driving Cars|WIRED. Available online: https://www.wired.com/story/gms-cruise-rolls-back-target-self-driving-cars/.
2. (2019, November 22). Technology. Available online: https://waymo.com/tech/.
3. (2019, November 22). Autopilot and Full Self-Driving Capability. Available online: https://www.tesla.com/support/autopilot.
4. Archive, P., and Twitter, F.A. (2019, November 22). Waymo’s Backseat Drivers: Confidential Data Reveals Self-Driving Taxi Hurdles. Available online: https://www.theinformation.com/articles/waymos-backseat-drivers-confidential-data-reveals-self-driving-taxi-hurdles.
5. Van Huysduynen, H.H., Terken, J., and Eggen, B. (2018). Why Disable the Autopilot?. Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM.10.1145/3239060.3239063 ↗
6. (2019, November 22). Hyundai Motor Group Develops World’s First Machine Learning based Smart Cruise Control (SCC-ML) Technology. Available online: https://news.hyundaimotorgroup.com/MediaCenter/News/Press-Releases/hyundai-motor-group-develops-world-s-first-machine-learning-based-smart-cruise-control-scc-ml-technology.
7. A learning-based framework for velocity control in autonomous driving
8. Human driving data-based design of a vehicle adaptive cruise control algorithm10.1080/00423110701576130 ↗
9. Elsken, T., Metzen, J.H., and Hutter, F. (2018). Neural architecture search: A survey. arXiv.10.1007/978-3-030-05318-5_3 ↗
10. Miikkulainen, R., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., and Duffy, N. (2019). Evolving deep neural networks. Artificial Intelligence in the Age of Neural Networks and Brain Computing, Elsevier.10.1016/B978-0-12-815480-9.00015-3 ↗
11. Structure learning of Bayesian networks by genetic algorithms: A performance analysis of control parameters10.1109/34.537345 ↗
12. Constructive algorithms for structure learning in feedforward neural networks for regression problems10.1109/72.572102 ↗
13. Zoph, B., and Le, Q.V. (2016). Neural architecture search with reinforcement learning. arXiv.
14. Human-Centered Risk Assessment of an Automated Vehicle Using Vehicular Wireless Communication10.1109/TITS.2018.2823744 ↗
15. Comparison of Markov chain abstraction and Monte Carlo simulation for the safety assessment of autonomous cars10.1109/TITS.2011.2157342 ↗
16. Using stochastic Petri nets for level-crossing collision risk assessment10.1109/TITS.2009.2026310 ↗
17. A multilevel collision mitigation approach—Its situation assessment, decision making, and performance tradeoffs10.1109/TITS.2006.883115 ↗
18. Experimental assessment of the rescue collision-mitigation system10.1109/TVT.2006.883780 ↗
19. Sensor fusion for predicting vehicles’ path for collision avoidance systems10.1109/TITS.2007.903439 ↗
20. Berthelot, A., Tamke, A., Dang, T., and Breuel, G. (2012, January 3–7). A novel approach for the probabilistic computation of time-to-collision. Proceedings of the 2012 IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain.10.1109/IVS.2012.6232221 ↗
21. An IMM/EKF approach for enhanced multitarget state estimation for application to integrated risk management system10.1109/TVT.2014.2329497 ↗
22. Miao, Y., and Metze, F. (2013, January 25–29). Improving low-resource CD-DNN-HMM using dropout and multilingual DNN training. Proceedings of the 14th Annual Conference of the International Speech Communication Association, Lyon, France.10.21437/Interspeech.2013-526 ↗
23. Rojas, R. (1996). The backpropagation algorithm. Neural Networks, Springer.10.1007/978-3-642-61068-4 ↗
24. Modulation format recognition and OSNR estimation using CNN-based deep learning10.1109/LPT.2017.2742553 ↗
25. Liu, H., Simonyan, K., Vinyals, O., Fernando, C., and Kavukcuoglu, K. (2017). Hierarchical representations for efficient architecture search. arXiv.
26. Park, K., Shin, D., and Chi, S. (2019). Variable Chromosome Genetic Algorithm for Structure Learning in Neural Networks to Imitate Human Brain. Appl. Sci., 9.10.3390/app9153176 ↗
27. Wei, X.-S., Wu, J., and Cui, Q. (2019). Deep Learning for Fine-Grained Image Analysis: A Survey. arXiv.
28. Chung, J., Kastner, K., Dinh, L., Goel, K., Courville, A.C., and Bengio, Y. (2015). A recurrent latent variable model for sequential data. Advances in Information Systems Development, Springer US.
29. Pasa, L., Testolin, A., and Sperduti, A. (2014, January 23–25). A HMM-based pre-training approach for sequential data. Proceedings of the 22nd European Symposium on Artificial Neural Networks, Bruges, Belgium.
30. Multivariate time series prediction of lane changing behavior using deep neural network10.1007/s10489-018-1163-9 ↗
31. Matsushita, A., Sunda, T., Nakamura, Y., Takano, W., and Hashimoto, J. (2018). Driving Assistance System and Driving Assistance Method. (US10161754B2), U.S. Patent.