An Integrated Self-Diagnosis System for an Autonomous Vehicle Based on an IoT Gateway and Deep Learning
Source abstract
Abstract
This paper proposes “An Integrated Self-diagnosis System (ISS) for an Autonomous Vehicle based on an Internet of Things (IoT) Gateway and Deep Learning” that collects information from the sensors of an autonomous vehicle, diagnoses itself, and the influence between its parts by using Deep Learning and informs the driver of the result. The ISS consists of three modules. The first In-Vehicle Gateway Module (In-VGM) collects the data from the in-vehicle sensors, consisting of media data like a black box, driving radar, and the control messages of the vehicle, and transfers each of the data collected through each Controller Area Network (CAN), FlexRay, and Media Oriented Systems Transport (MOST) protocols to the on-board diagnostics (OBD) or the actuators. The data collected from the in-vehicle sensors is transferred to the CAN or FlexRay protocol and the media data collected while driving is transferred to the MOST protocol. Various types of messages transferred are transformed into a destination protocol message type. The second Optimized Deep Learning Module (ODLM) creates the Training Dataset on the basis of the data collected from the in-vehicle sensors and reasons the risk of the vehicle parts and consumables and the risk of the other parts influenced by a defective part. It diagnoses the vehicle’s total condition risk. The third Data Processing Module (DPM) is based on Edge Computing and has an Edge Computing based Self-diagnosis Service (ECSS) to improve the self-diagnosis speed and reduce the system overhead, while a V2X based Accident Notification Service (VANS) informs the adjacent vehicles and infrastructures of the self-diagnosis result analyzed by the OBD. This paper improves upon the simultaneous message transmission efficiency through the In-VGM by 15.25% and diminishes the learning error rate of a Neural Network algorithm through the ODLM by about 5.5%. Therefore, in addition, by transferring the self-diagnosis information and by managing the time to replace the car parts of an autonomous driving vehicle safely, this reduces loss of life and overall cost.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autonomous Vehicle Technology and Safety · Vehicular Ad Hoc Networks (VANETs) · IoT and GPS-based Vehicle Safety Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Catholic Kwandong University, Gangneung 25601, Korea
Department of Regional Economics, Kangwon National University, Samcheok 25913, Korea
Funding
National Research Foundation of Korea
References (47)
Show source-provided references
1. Schweber, B. (2018, January 10). The Autonomous Car: A Diverse Array of Sensors Drives Navigation, Driving, and Performance. Available online: https://www.mouser.com/applications/autonomous-car-sensors-drive-performance/.
2. Miller, D. (2018, January 10). Autonomous Vehicles: What Are the Security Risks?. Available online: https://www.covisint.com/blog/autonomous-vehicles-what-are-the-security-risks/.
3. Black, T.G. (2018, January 11). Diagnosis and Repair for Autonomous Vehicles. Available online: http://www.freepatentsonline.com/8874305.html.
4. WCRT Analysis of CAN Messages in Gateway-Integrated In-Vehicle Networks10.1109/TVT.2017.2737035 ↗
5. Design FAQs: FlexRay
6. Li, Z., Jing, H., and Liu, Z. (2013, January 26–28). Design of Application Layer Software and Interface Circuit for the MOST Network in Vehicle. Proceedings of the Proceedings of the 32nd Chinese Control Conference, Xi’an, China.
7. Lee, T., Kuo, C., and Lin, I. (2017, January 7–10). High performance CAN/FlexRay gateway design for In-Vehicle network. Dependable and Secure Computing. Proceedings of the 2017 IEEE Conference on Dependable and Secure Computing, Taipei, Taiwan.10.1109/DESEC.2017.8073848 ↗
8. Dong, Z., Piao, Z., Jang, I., Chung, J., and Lee, C. (2012, January 20–23). Design of FlexRay-MOST gateway using static segments and control messages. Proceedings of the 2012 IEEE International Symposium on Circuits and Systems (ISCAS), Seoul, Korea.10.1109/ISCAS.2012.6272085 ↗
9. Seo, S.H., Kim, J.H., Moon, T.Y., Hwang, S.H., Kwon, K.H., and Jeon, J.W. (2008, January 6–11). A Reliable Gateway for In-vehicle Networks. Proceedings of the 17th World Congress The International Federation of Automatic Control, Seoul, Korea.
10. Gateway Framework for In-Vehicle Networks Based on CAN, FlexRay, and Ethernet10.1109/TVT.2014.2371470 ↗
11. Yang, J., Wang, J., Wan, L., and Liu, X. (2016). Vehicle networking data-upload strategy based on mobile cloud services. EURASIP J. Embed. Syst., 22.10.1186/s13639-016-0057-3 ↗
12. Formal timing analysis of CAN-to-Ethernet gateway strategies in automotive networks10.1007/s11241-015-9243-y ↗
13. Performance Evaluation of Node-mapping-based FlexRay-CAN Gateway for In-Vehicle Networking System10.1080/10798587.2014.981999 ↗
14. FlexRay and Ethernet AVB Synchronization for High QoS Automotive Gateway10.1109/TVT.2016.2636867 ↗
15. An Efficient Gateway Discovery Algorithm with Delay Guarantee for VANET-3G Heterogeneous Networks10.1007/s11277-014-1622-5 ↗
16. A reliable quality of service aware fault tolerant gateway discovery protocol for vehicular networks10.1002/wcm.2413 ↗
17. A reliable gateway for in-vehicle networks based on LIN, CAN, and FlexRay10.1145/2146417.2146424 ↗
18. An, H.S., and Jeon, J.W. (2017, January 18–21). Analysis of CAN FD to CAN message routing method for CAN FD and CAN gateway. Proceedings of the 2017 17th International Conference on Control, Automation and Systems (ICCAS), Jeju, Korea.10.23919/ICCAS.2017.8204292 ↗
19. Design and implementation of a UPnP-can gateway for automotive environments10.1007/s12239-013-0011-5 ↗
20. Wang, L., Wang, L., Liu, W., and Zhang, Y. (2017, January 5–8). Research on fault diagnosis system of electric vehicle power battery based on OBD technology. Proceedings of the 2017 International Conference on Circuits Devices and Systems (ICCDS), Chengdu, China.10.1109/ICCDS.2017.8120458 ↗
21. Khorsravinia, K., Hassan, M.K., Rahman, R.Z.A., and Al-Haddad, S.A.R. (2017, January 21). Integrated OBD-II and mobile application for electric vehicle (EV) monitoring system. Proceedings of the 2017 IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS), Kota Kinabalu, Malaysia.10.1109/I2CACIS.2017.8239058 ↗
22. Chen, S., Liu, W., Tsai, J., and Hung, I. (2016, January 18–20). Vehicle fuel pump service life evaluation using on-board diagnostic (OBD) data. Proceedings of the 2016 International Conference on Orange Technologies (ICOT), Melbourne, VIC, Australia.10.1109/ICOT.2016.8278985 ↗
23. Zhang, H., and Li, W. (2016, January 15–17). A new method of sensor fault diagnosis based on a wavelet packet neural network for Hybrid electric vehicles. Proceedings of the 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Datong, China.10.1109/CISP-BMEI.2016.7852886 ↗
24. Zhang, Z., He, H., and Zhou, N. (2017, January 20–22). A neural network-based method with data preprocess for fault diagnosis of drive system in battery electric vehicles. Proceedings of the 2017 Chinese Automation Congress (CAC), Jinan, China.10.1109/CAC.2017.8243504 ↗
25. Artificial neural network-based fault diagnosis in the AC–DC converter of the power supply of series hybrid electric vehicle10.1049/iet-est.2014.0055 ↗
26. The diagnosis method of stator winding faults in PMSMs based on SOM neural networks10.1016/j.egypro.2017.03.663 ↗
27. Application of Artificial Neural Networks in Vehicles’ Design Self-Diagnostic Systems for Safety Reasons10.1016/j.trpro.2017.01.024 ↗
28. Decoupling control of vehicle chassis system based on neural network inverse system
29. Multi-Task Vehicle Detection With Region-of-Interest Voting10.1109/TIP.2017.2762591 ↗
30. An Ensemble Deep Learning Method for Vehicle Type Classification on Visual Traffic Surveillance Sensors10.1109/ACCESS.2017.2766203 ↗
31. On the Use of Monte-Carlo Simulation and Deep Fourier Neural Network in Lane Departure Warning10.1109/MITS.2017.2743204 ↗
32. A rear-end collision prediction scheme based on deep learning in the Internet of Vehicles10.1016/j.jpdc.2017.08.014 ↗
33. Night-Time Vehicle Sensing in Far Infrared Image with Deep Learning10.1155/2016/3403451 ↗
34. Computation offloading of a vehicle’s continuous intrusion detection workload for energy efficiency and performance
35. Gao, Y., and Lee, H.J. (2016). Local Tiled Deep Networks for Recognition of Vehicle Make and Model. Sensors, 16.10.3390/s16020226 ↗
36. Robust vehicle detection by combining deep features with exemplar classification10.1016/j.neucom.2016.03.094 ↗
37. Monkey King Evolution: A new memetic evolutionary algorithm and its application in vehicle fuel consumption optimization10.1016/j.knosys.2016.01.009 ↗
38. Deep Reinforcement Learning With Visual Attention for Vehicle Classification
39. Vehicle Fault Detection and Diagnosis combining AANN and ANFI10.3182/20090630-4-ES-2003.00178 ↗
40. Distributed formation control of nonholonomic autonomous vehicle via RBF neural network10.1016/j.ymssp.2016.04.015 ↗
41. A Deep Convolution Neural Network Model for Vehicle Recognition and Face Recognition10.1016/j.procs.2017.03.153 ↗
42. Acoustic based fault diagnosis of three-phase induction motoer10.1016/j.apacoust.2018.03.010 ↗
43. Pattern recognition based on-line vibration monitoring system for fault diagnosis of automobile gearbox10.1016/j.measurement.2017.09.041 ↗
44. Design of the model for the on-line control of the AWJ technology based on neural networks
45. Hu, Z., Su, J., Vladimir, J., Orest, K., Mykola, M., Roman, K., and Taras, S. (2016, January 4–6). Data Science Applications to Improve Accuracy of Thermocouples. Proceedings of the 2016 IEEE 8th International Conference On Intelligent Systems, Sofia, Bulgaria.
46. Kamada, S., and Ichimura, T. (2017, January 5–8). Knowledge extracted from recurrent deep belief network for real time deterministic control, Systems, Man, and Cybernetics (SMC). Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada.10.1109/SMC.2017.8122711 ↗
47. Lehner, B., Widmer, G., and Bock, S. (September, January 31). A low-latency, real-time-capable singing voice detection method with LSTM recurrent neural networks. Proceedings of the 23rd European Signal Processing Conference (EUSIPCO), Nice, France.