An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing
Source abstract
Abstract
Drowsy driving is one of the main causes of traffic accidents. To reduce such accidents, early detection of drowsy driving is needed. In previous studies, it was shown that driver drowsiness affected driving performance, behavioral indices, and physiological indices. The purpose of this study is to investigate the feasibility of classification of the alert states of drivers, particularly the slightly drowsy state, based on hybrid sensing of vehicle-based, behavioral, and physiological indicators with consideration for the implementation of these identifications into a detection system. First, we measured the drowsiness level, driving performance, physiological signals (from electroencephalogram and electrocardiogram results), and behavioral indices of a driver using a driving simulator and driver monitoring system. Next, driver alert and drowsy states were identified by machine learning algorithms, and a dataset was constructed from the extracted indices over a period of 10 s. Finally, ensemble algorithms were used for classification. The results showed that the ensemble algorithm can obtain 82.4% classification accuracy using hybrid methods to identify the alert and slightly drowsy states, and 95.4% accuracy classifying the alert and moderately drowsy states. Additionally, the results show that the random forest algorithm can obtain 78.7% accuracy when classifying the alert vs. slightly drowsy states if physiological indicators are excluded and can obtain 89.8% accuracy when classifying the alert vs. moderately drowsy states. These results represent the feasibility of highly accurate early detection of driver drowsiness and the feasibility of implementing a driver drowsiness detection system based on hybrid sensing using non-contact sensors.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sleep and Work-Related Fatigue · Ergonomics and Musculoskeletal Disorders · Human-Automation Interaction and Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Industrial Science, The University of Tokyo, Tokyo 153-8505, Japan
Nissan Motor, Co., Ltd., Kanagawa 243-0192, Japan
Department of Human and Engineered Environment Studies, Graduate School of Frontier Sciences, The University of Tokyo, Chiba 277-8563, Japan
References (36)
Show source-provided references
1. Metropolitan Police Department of Japan (2020, March 01). The occurrence Situation of Traffic Accidents during the Year of 2017. Available online: https://www.npa.go.jp/publications/statistics/koutsuu/H29zennjiko.pdf.
2. Prediction of automobile driver sleepiness
3. Zilberg, E., Xu, Z.M., Burton, D., Karrar, M., and Lal, S. (2007, January 27–30). Methodology and initial analysis results for development of non-invasive and hybrid driver drowsiness detection systems. Proceedings of the IEEE International Conference on Wireless Broadband and Ultra-Wideband Communications, Sydney, NSW, Australia.10.1109/AUSWIRELESS.2007.44 ↗
4. Automatic recognition of alertness from EEG by using neural networks and wavelet coefficients10.1016/j.eswa.2004.12.027 ↗
5. Real-time nonintrusive monitoring and prediction of driver fatigue10.1109/TVT.2004.830974 ↗
6. Popieul, J.C., Simon, P., and Loslever, P. (2003, January 9–11). Using driver’s head movements evolution as a drowsiness indicator. Proceedings of the IEEE Proceeding on Intelligent Vehicle Symposium, Columbus, OH, USA.
7. Pritchett, S., Zilberg, E., Xu, Z.M., Karrar, M., Burton, D., and Lal, S. (2011, January 21–24). Comparing accuracy of two algorithms for detecting driver drowsiness–Single source (EEG) and hybrid (EEG and body movement). Proceedings of the 6th International Conference on Broadband and Biomedical Communications (IB2Com), Melbourne, VIC, Australia.10.1109/IB2Com.2011.6217916 ↗
8. Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep deprived traffic accidents10.1016/j.clinph.2007.04.031 ↗
9. Generalized EEG-based drowsiness prediction system by using a self-organizing neural fuzzy system10.1109/TCSI.2012.2185290 ↗
10. A real–time wireless brain-computer interface system for drowsiness detection10.1109/TBCAS.2010.2046415 ↗
11. Applying neural network analysis on heart rate variability data to assess driver fatigue10.1016/j.eswa.2010.12.028 ↗
12. Awais, M., Badruddin, N., and Drieberg, M. (2017). A Hybrid approach to detect driver drowsiness utilizing physiological signals to improve system performance and wearability. Sensors, 17.10.3390/s17091991 ↗
13. Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers10.1016/j.physbeh.2005.02.021 ↗
14. Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences10.1111/j.1365-2869.2006.00504.x ↗
15. The effect of fatigue driving on car following behavior10.1016/j.trf.2016.06.017 ↗
16. Driver drowsiness warning system using visual information for both diurnal and nocturnal illumination conditions10.1155/2010/438205 ↗
17. Driver drowsiness classification using fuzzy wavelet-packet-based feature-extraction algorithm10.1109/TBME.2010.2077291 ↗
18. Automatic detection of drowsiness in EEG records based on multimodal analysis10.1016/j.medengphy.2013.07.011 ↗
19. Driver drowsiness detection based on multisource information10.1002/hfm.20395 ↗
20. Gwak, J.S., Shino, M., and Hirao, A. (2018, January 4–7). Early detection of driver drowsiness utilizing machine learning based on physiological signals, behavioral measures, and driving performance. Proceedings of the IEEE International Conference on Intelligent Transportation Systems, Maui, Hawaii, HI, USA.10.1109/ITSC.2018.8569493 ↗
21. A simple method of sample size calculation for linear and logistic regression10.1002/(SICI)1097-0258(19980730)17:14<1623::AID-SIM871>3.0.CO;2-S ↗
22. Comparison of linear, nonlinear, and feature selection methods for EEG signal classification10.1109/TNSRE.2003.814441 ↗
23. Soucy, P., and Mineau, G.W. (December, January 29). A simple KNN algorithm for text categorization. Proceedings of the IEEE International Conference on Data Mining, San Jose, CA, USA.
24. A survey on decision tree algorithm for classification
25. Random forests10.1023/A:1010933404324 ↗
26. Visuomotor control of steering: The artefact of the matter10.1007/s00221-010-2530-x ↗
27. Drowsy drivers’ under-performance in lateral control: How much is too much? Using an integrated measure of lateral control to quantify safe lateral driving10.1016/j.aap.2015.08.012 ↗
28. The development of a time related measure to describe driving strategy10.1177/001872088402600302 ↗
29. Localization of the sources of EEG delta, theta, alpha and beta frequency bands using the FFT dipole approximation10.1016/0013-4694(92)90180-P ↗
30. International Organization for Standardization (2005). ISO7730: Ergonomics of the Thermal Environment–Analytical Determination and Interpretation of Thermal Comfort Using Calculation of the PMV and PPD Indices and Local Thermal Comfort Criteria, International Organization for Standardization.
31. Ogutu, J.O., Schulz-Streeck, T., and Piepho, H. (2012). Genomic selection using regularized linear regression models: Ridge regression, lasso, elastic net and their extensions. BMC Proc., 6.10.1186/1753-6561-6-S2-S10 ↗
32. A novel deep learning based method for the computational material design of flexoelectric nanostructures with topology optimization10.1016/j.finel.2019.07.001 ↗
33. A Context-Aware EEG Headset System for Early Detection of Driver Drowsiness10.3390/s150820873 ↗
34. Age and gender differences in risky driving: The roles of positive affect and risk perception10.1016/j.aap.2010.11.015 ↗
35. Effects of major-road vehicle speed and driver age and gender on left-turn gap acceptance10.1016/j.aap.2006.12.006 ↗
36. Structural damage assessment criteria for reinforced concrete buildings by using a Fuzzy Analytic Hierarchy process10.1016/j.undsp.2018.04.002 ↗