journal article·2023-04-18Open access

Adaptive Driver Face Feature Fatigue Detection Algorithm Research

Han Zheng, Yiding Wang, Xiaoming Liu

Applied Sciences· Volume 13· Issue 8

Abstract

Fatigued driving is one of the leading causes of traffic accidents, and detecting fatigued driving effectively is critical to improving driving safety. Given the variety and individual variability of the driving surroundings, the drivers’ states of weariness, and the uncertainty of the key characteristic factors, in this paper, we propose a deep-learning-based study of the MAX-MIN driver fatigue detection algorithm. First, the ShuffleNet V2K16 neural network is used for driver face recognition, which eliminates the influence of poor environmental adaptability in fatigue detection; second, ShuffleNet V2K16 is combined with Dlib to obtain the coordinates of driver face feature points; and finally, the values of EAR and MAR are obtained by comparing the first 100 frames of images to EAR-MAX and MAR-MIN. Our proposed method achieves 98.8% precision, 90.2% recall, and 94.3% F-Score in the actual driving scenario application.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sleep and Work-Related Fatigue · Ergonomics and Musculoskeletal Disorders

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electrical and Control Engineering, North China University of Technology, Beijing 100144, China

School of Artificial Intelligence and Manufacturing, Hechi University, Hechi 546300, China

College of Information Science and Technology, North China University of Technology, Beijing 100144, China

Funding

National Natural Science Foundation of China · the National Key Research and Development Program of China · Guangxi First-class Discipline Construction Project Electronic Information (Hechi University) · Key Laboratory of AI and Information Processing (Hechi University), Education Department of Guangxi Zhuang Autonomous Region

References (17)

Show source-provided references
1. A critical review of the psychophysiology of driver fatigue—ScienceDirect10.1016/S0301-0511(00)00085-5 ↗
2. He, J., Chen, J., Liu, J., and Li, H. (2019, January 6–8). A Lightweight Architecture For Driver Status Monitoring Via Convolutional Neural Networks. Proceedings of the 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), Dali, China.10.1109/ROBIO49542.2019.8961845 ↗
3. Abtahi, S., Omidyeganeh, M., Shirmohammadi, S., and Hariri, B. (2014, January 20–24). YawDD: A yawning detection dataset. Proceedings of the 5th ACM Multimedia Systems Conference, Virtual Event, China.10.1145/2557642.2563678 ↗
4. Guo, X., Li, S., Yu, J., Zhang, J., Ma, J., Ma, L., Liu, W., and Ling, H. (2019). PFLD: A practical facial landmark detector. arXiv.
5. Kreiss, S., Bertoni, L., and Alahi, A. (2019, January 15–20). Pifpaf: Composite fields for human pose estimation. Proceedings of the IEEE/CVF Conferaence on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01225 ↗
6. Driving behavior recognition from still images by using multi-stream fusion CNN10.1007/s00138-018-0994-z ↗
7. Xiang, W., Wu, X., Li, C., Zhang, W., and Li, F. (2022). Driving Fatigue Detection Based on the Combination of Multi-Branch 3D-CNN and Attention Mechanism. Appl. Sci., 12.10.3390/app12094689 ↗
8. Driver mental fatigue detection based on head posture using a new modified reLU-BiLSTM deep neural network10.1109/TITS.2021.3098309 ↗
9. Fatigue driving detection based on deep learning and multi-index fusion10.1109/ACCESS.2021.3123388 ↗
10. Monitoring driving in a monotonous environment: Classification and recognition of driving fatigue based on long short-term memory network10.1155/2022/6897781 ↗
11. Moslemi, N., Azmi, R., and Soriano, M. (2019, January 6–7). Driver distraction recognition using 3d convolutional neural networks. Proceedings of the 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA), Tehran, Iran.10.1109/PRIA.2019.8786012 ↗
12. Zhu, T., Zhang, C., Wu, T., Ouyang, Z., Li, H., Na, X., Ling, J., and Li, W. (2022). Research on a real-time driver fatigue detection algorithm based on facial video sequences. Appl. Sci., 12.10.3390/app12042224 ↗
13. Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8–14). ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
14. Jin, S., Xu, L., Xu, J., Wang, C., Liu, W., Qian, C., Ouyang, W., and Luo, P. (2020, January 23–28). Whole-Body Human Pose Estimation in the Wild. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK.10.1007/978-3-030-58545-7_12 ↗
15. A novel approach for driver fatigue detection based on visual characteristics analysis10.1007/s12652-021-03311-9 ↗
16. Driver Fatigue Detection Using Viola Jones and Principal Component Analysis10.1080/08839514.2020.1723875 ↗
17. Driver Fatigue Detection Based on Facial Key Points and LSTM10.1155/2021/5383573 ↗