An Efficient Approach for Detecting Driver Drowsiness Based on Deep Learning
Source abstract
Abstract
Drowsy driving is one of the common causes of road accidents resulting in injuries, even death, and significant economic losses to drivers, road users, families, and society. There have been many studies carried out in an attempt to detect drowsiness for alert systems. However, a majority of the studies focused on determining eyelid and mouth movements, which have revealed many limitations for drowsiness detection. Besides, physiological measures-based studies may not be feasible in practice because the measuring devices are often not available on vehicles and often uncomfortable for drivers. In this research, we therefore propose two efficient methods with three scenarios for doze alert systems. The former applies facial landmarks to detect blinks and yawns based on appropriate thresholds for each driver. The latter uses deep learning techniques with two adaptive deep neural networks based on MobileNet-V2 and ResNet-50V2. The second method analyzes the videos and detects driver’s activities in every frame to learn all features automatically. We leverage the advantage of the transfer learning technique to train the proposed networks on our training dataset. This solves the problem of limited training datasets, provides fast training time, and keeps the advantage of the deep neural networks. Experiments were conducted to test the effectiveness of our methods compared with other methods. Empirical results demonstrate that the proposed method using deep learning techniques can achieve a high accuracy of 97%. This study provides meaningful solutions in practice to prevent unfortunate automobile accidents caused by drowsiness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sleep and Work-Related Fatigue · Gaze Tracking and Assistive Technology · Ergonomics and Musculoskeletal Disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Information Technology, Vinh Long University of Technology Education, Vinh Long 85110, Vietnam
La Faculté Sciences et Techniques, Université de Bretagne Occidentale, 29200 Brest, France
College of Information and Communication Technology, Can Tho University, Can Tho 902070, Vietnam
References (26)
Show source-provided references
1. Practice parameters for the clinical evaluation and treatment of circadian rhythm sleep disorders10.1093/sleep/30.11.1445 ↗
2. Sleepiness and sleep-related accidents in commercial bus drivers
3. Real-time Driver Drowsiness Detection for Android Application Using Deep Neural Networks Techniques10.1016/j.procs.2018.04.060 ↗
4. Fatigue Detection Using Raspberry Pi 310.14419/ijet.v7i2.24.11993 ↗
5. Drowsiness Detection Based on Eye Closure and Yawning Detection
6. Real-Time Driver Alert System Using Raspberry Pi10.37936/ecti-eec.2019172.215488 ↗
7. Driver Drowsiness Detection Based on Eye Movement and Yawning Using Facial Landmark Analysis
8. Mehta, S., Dadhich, S., Gumber, S., and Bhatt, A.J. (2019, January 26–28). Real-Time Driver Drowsiness Detection System Using Eye Aspect Ratio and Eye Closure Ratio. Proceedings of the International Conference on Sustainable Computing in Science, Technology and Management (SUSCOM), Jaipur, India.10.2139/ssrn.3356401 ↗
9. Driver Drowsiness Detection System using Machine Learning Algorithms
10. Jabbar, R., Shinoy, M., Kharbeche, M., Al-Khalifa, K., Krichen, M., and Barkaoui, K. (2020, January 2–5). Driver Drowsiness Detection Model Using Convolutional Neural Networks Techniques for Android Application. Proceedings of the 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies, Doha, Qatar.10.1109/ICIoT48696.2020.9089484 ↗
11. Driver Fatigue Detection Based on Convolutional Neural Networks Using EM-CNN10.1155/2020/7251280 ↗
12. IoT-Based Smart Alert System for Drowsy Driver Detection10.1155/2021/6627217 ↗
13. Ajinkya Rajkar, N.K., and Raut, A. (2021). Driver Drowsiness Detection Using Deep Learning. Applied Information Processing Systems: Proceedings of ICCET 2021, Springer.10.1007/978-981-16-2008-9_7 ↗
14. A Deep Learning Approach To Detect Driver Drowsiness
15. Kingman, P.S., Jesse, B., Forrest, C., Kate, G., James, K., Roger, K., Anne, T.M., Sharon, L.M., Allan, I.P., and Susan, R. (1999). Drowsy driving and automobile crashes, Ncsdr/nhtsa Expert Panel on Driver Fatigue and Sleepiness.
16. Kazemi, V., and Sullivan, J. (2014, January 23–28). One millisecond face alignment with an ensemble of regression trees. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.241 ↗
17. Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., and Pantic, M. (2013, January 3–8). 300 faces in-the-wild challenge: The first facial landmark localization challenge. Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, Australia.10.1109/ICCVW.2013.59 ↗
18. Cech, J., and Soukupova, T. (2016, January 3–5). Real-time eye blink detection using facial landmarks. Proceedings of the 21st Computer Vision Winter Workshop, Rimske Toplice, Slovenia.
19. Driver Drowsiness Monitoring System Using Visual Behavior and Machine Learning
20. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
21. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
22. Xiang, Q., Wang, X., Li, R., Zhang, G., Lai, J., and Hu, Q. (2019, January 22–24). Fruit image classification based on Mobilenetv2 with transfer learning technique. Proceedings of the 3rd International Conference on Computer Science and Application Engineering, Sanya, China.10.1145/3331453.3361658 ↗
23. Dai, W., Dai, Y., Hirota, K., and Jia, Z. (November, January 31). A Flower Classification Approach with MobileNetV2 and Transfer Learning. Proceedings of the 9th International Symposium on Computational Intelligence and Industrial Applications (ISCIIA2020), Beijing, China.
24. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
25. A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V210.1016/j.imu.2020.100360 ↗
26. Accuracy, precision, recall & f1 score: Interpretation of performance measures