journal article·2024Open access

Research on Driver’s Fatigue Detection Based on Information Fusion

Meiyan Zhang, Boqi Zhao, Jipu Li, Qisong Wang, Dan Liu, Jinwei Sun, Jingxiao Liao

Computers, Materials & Continua· Volume 79· Issue 1

Abstract

Driving fatigue is a physiological phenomenon that often occurs during driving. After the driver enters a fatigued state, the attention is lax, the response is slow, and the ability to deal with emergencies is significantly reduced, which can easily cause traffic accidents. Therefore, studying driver fatigue detection methods is significant in ensuring safe driving. However, the fatigue state of actual drivers is easily interfered with by the external environment (glasses and light), which leads to many problems, such as weak reliability of fatigue driving detection. Moreover, fatigue is a slow process, first manifested in physiological signals and then reflected in human face images. To improve the accuracy and stability of fatigue detection, this paper proposed a driver fatigue detection method based on image information and physiological information, designed a fatigue driving detection device, built a simulation driving experiment platform, and collected facial as well as physiological information of drivers during driving. Finally, the effectiveness of the fatigue detection method was evaluated. Eye movement feature parameters and physiological signal features of drivers’ fatigue levels were extracted. The driver fatigue detection model was trained to classify fatigue and non-fatigue states based on the extracted features. Accuracy rates of the image, electroencephalogram (EEG), and blood oxygen signals were 86%, 82%, and 71%, separately. Information fusion theory was presented to facilitate the fatigue detection effect; the fatigue features were fused using multiple kernel learning and typical correlation analysis methods to increase the detection accuracy to 94%. It can be seen that the fatigue driving detection method based on multi-source feature fusion effectively detected driver fatigue state, and the accuracy rate was higher than that of a single information source. In summary, fatigue driving monitoring has broad development prospects and can be used in traffic accident prevention and wearable driver fatigue recognition.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Control Systems · Sleep and Work-Related Fatigue

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. The relationship between fatigue and driving performance: A review and directions for future research
2. Driving behaviour and trip condition effects on the energy consumption of an electric vehicle under real-world driving10.1016/j.apenergy.2021.117096 ↗
3. Analyzing driver behavior under naturalistic driving conditions: A review10.1016/j.aap.2020.105908 ↗
4. Application of Toyota’s production system to reduce traffic accidents in Abha’s region-case study
5. Evaluating the nature of distractive driving factors towards road traffic accident10.28991/cej-2020-03091567 ↗
6. Driver drowsiness detection techniques: A survey
7. Fatigue detection method based on facial features and head posture
8. Computer vision based fatigue detection using facial parameters10.1088/1757-899X/981/2/022005 ↗
9. Drowsiness detection of a driver using conventional computer vision application
10. Research on eye positioning method for driver fatigue monitoring
11. Driver fatigue detection based on residual channel attention network and head pose estimation10.3390/app11199195 ↗
12. A systematic review of physiological signals based driver drowsiness detection systems10.1007/s11571-022-09898-9 ↗
13. Identification of drivers drowsiness based on features extracted from EEG signal using SVM classifier10.17993/3ctecno.2021.specialissue8.579-595 ↗
14. Compact vehicle driver fatigue recognition technology based on EEG signal10.1109/TITS.2021.3119354 ↗
15. Sensitivity and specificity of the driver sleepiness detection methods using physiological signals: A systematic review10.1016/j.aap.2020.105900 ↗
16. Detection and analysis: Driver state with electrocardiogram (ECG)10.1007/s13246-020-00853-8 ↗
17. Driver’s drowsiness detection using SpO2
18. Mental fatigue state of brain tissue oxygen saturation of near-infrared spectral analysis
19. A novel learning model of driver fatigue features representation for steering wheel angle10.1109/TVT.2021.3130152 ↗
20. Automatic driver cognitive fatigue detection based on upper body posture variations10.1016/j.eswa.2022.117568 ↗
21. Deep learning for detecting multi-level driver fatigue using physiological signals: A comprehensive approach10.3390/s23198171 ↗
22. Face recognition using histograms of oriented gradients10.1016/j.patrec.2011.01.004 ↗
23. Learning non-maximum suppression
24. Single-camera automatic landmarking for people recognition with an ensemble of regression trees
25. Adapting and evaluating influence-estimation methods for gradient-boosted decision trees
26. Dlib-ml: A machine learning toolkit
27. Removal of artifacts from EEG signals: A review10.3390/s19050987 ↗
28. Hilbert-Huang transform and its applications
29. Analysis of the intrinsic mode functions10.1007/s00365-005-0603-z ↗
30. The nature of arousal in sleep10.1111/j.1365-2869.2004.00388.x ↗
31. The fast Fourier transform and its applications10.1109/TE.1969.4320436 ↗
32. Toward assessment of blood oxygen saturation by spectroscopic optical coherence tomography10.1364/OL.30.001015 ↗
33. Drowsiness, fatigue and poor sleep’s causes and detection: A comprehensive study10.1109/ACCESS.2019.2951028 ↗
34. Information fusion in biometrics10.1016/S0167-8655(03)00079-5 ↗
35. Multi-layered deep learning features fusion for human action recognition
36. Multiple kernel learning algorithms
37. An overview of radial basis function networks
38. Fingerprint identification of radar emitter based on multi-set canonical correlation analysis
39. Joint blind source separation by multi-set canonical correlation analysis10.1109/TSP.2009.2021636 ↗
40. Assessment of human fatigue during physical performance using physiological signals: A review10.13005/bpj/1308 ↗