journal article·2023-10-31Open access

U2-Net: A Very-Deep Convolutional Neural Network for Detecting Distracted Drivers

Nawaf O. Alsrehin, Mohit Gupta, Izzat Alsmadi, Saif Addeen Alrababah

Applied Sciences· Volume 13· Issue 21

Abstract

In recent years, the number of deaths and injuries resulting from traffic accidents has been increasing dramatically all over the world due to distracted drivers. Thus, a key element in developing intelligent vehicles and safe roads is monitoring driver behaviors. In this paper, we modify and extend the U-net convolutional neural network so that it provides deep layers to represent image features and yields more precise classification results. It is the basis of a very deep convolution neural network, called U2-net, to detect distracted drivers. The U2-net model has two paths (contracting and expanding) in addition to a fully-connected dense layer. The contracting path is used to extract the context around the objects to provide better object representation while the symmetric expanding path enables precise localization. The motivation behind this model is that it provides precise object features to provide a better object representation and classification. We used two public datasets: MI-AUC and State Farm, to evaluate the U2 model in detecting distracted driving. The accuracy of U2-net on MI-AUC and State Farm is 98.34 % and 99.64%, respectively. These evaluation results show higher accuracy than achieved by many other state-of-the-art methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Video Surveillance and Tracking Methods · Autonomous Vehicle Technology and Safety

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Sciences Department, University of Wisconsin-Madison, Madison, WI 53706, USA

Department of Computing and Cyber Security, Texas A&M University-San Antonio, San Antonio, TX 78224, USA

Faculty of Information Technology, Al Albayt University, Al-Mafraq 25113, Jordan

Funding

Yarmouk University

References (45)

Show source-provided references
1. Field, K.a.T. (2022, November 23). Help Nervus Drivers Transform How They Feel about Driving. Available online: https://www.confidentdrivers.co.uk.
2. ibisworld (2022, November 23). Expert Industry Research You Can Trust. Available online: www.ibisworld.com.10.5260/chara.23.1.20 ↗
3. National Highway Traffic Safety Administration (2022, November 23). Distracted Driving, Available online: https://www.nhtsa.gov/risky-driving/distracted-driving.
4. UIU-Net: U-Net in U-Net for Infrared Small Object Detection10.1109/TIP.2022.3228497 ↗
5. Ronneberger, O., Fischer, P., and Brox, T. (2015). Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: Proceedings of the 18th International Conference, Munich, Germany, 5–9 October 2015, Springer. Proceedings, Part III 18.
6. Distracted driver detection based on a CNN with decreasing filter size10.1109/TITS.2021.3063521 ↗
7. Automatic driver distraction detection using deep convolutional neural networks
8. Cities, B.D. (2022, November 23). Mobile App “Maos no Volante” Hands on the Steering Wheel. Available online: https://www.paradapelavida.com.br/maos-no-volante/.
9. Yang, J., Sidhom, S., Chandrasekaran, G., Vu, T., Liu, H., Cecan, N., Chen, Y., Gruteser, M., and Martin, R.P. (2011, January 19–23). Detecting driver phone use leveraging car speakers. Proceedings of the 17th Annual International Conference on Mobile Computing and Networking, Las Vegas, NV, USA.10.1145/2030613.2030625 ↗
10. Deshmukh, S.V., and Dehzangi, O. (2017, January 29–31). ECG-based driver distraction identification using wavelet packet transform and discriminative kernel-based features. Proceedings of the 2017 IEEE International Conference on Smart Computing (SMARTCOMP), Hong Kong, China.10.1109/SMARTCOMP.2017.7947003 ↗
11. Driver distraction identification with an ensemble of convolutional neural networks10.1155/2019/4125865 ↗
12. “Texting & Driving” detection using deep convolutional neural networks10.3390/app9152962 ↗
13. Majdi, M.S., Ram, S., Gill, J.T., and Rodríguez, J.J. (2018, January 8–10). Drive-net: Convolutional network for driver distraction detection. Proceedings of the 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), Las Vegas, NV, USA.10.1109/SSIAI.2018.8470309 ↗
14. Sultan, I. (2022, November 23). Academic Purposes 2016. Available online: https://www.kaggle.com/c/state-farm-distracted-driver-detection/discussion/20043.
15. An efficient deep learning framework for distracted driver detection10.1109/ACCESS.2021.3138137 ↗
16. Driver distraction detection methods: A literature review and framework10.1109/ACCESS.2021.3073599 ↗
17. Distracted driving detection based on the fusion of deep learning and causal reasoning10.1016/j.inffus.2022.08.009 ↗
18. Alkinani, M.H., Khan, W.Z., Arshad, Q., and Raza, M. (2022). HSDDD: A hybrid scheme for the detection of distracted driving through fusion of deep learning and handcrafted features. Sensors, 22.10.3390/s22051864 ↗
19. Wang, D., Pei, M., and Zhu, L. (2014, January 15–16). Detecting driver use of mobile phone based on in-car camera. Proceedings of the 2014 Tenth International Conference on Computational Intelligence and Security, Kunming, China.10.1109/CIS.2014.12 ↗
20. Artan, Y., Bulan, O., Loce, R.P., and Paul, P. (2014, January 23–28). Driver cell phone usage detection from HOV/HOT NIR images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.10.1109/CVPRW.2014.42 ↗
21. Yasar, H. (2017, January 1–3). Detection of Driver’s mobile phone usage. Proceedings of the 2017 IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), Manila, Philippines.10.1109/HNICEM.2017.8269509 ↗
22. Berri, R.A., Silva, A.G., Parpinelli, R.S., Girardi, E., and Arthur, R. (2014, January 5–8). A pattern recognition system for detecting use of mobile phones while driving. Proceedings of the 2014 International Conference on Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal.
23. Berri, R., and Osório, F. (2018, January 8–13). A 3D vision system for detecting use of mobile phones while driving. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489093 ↗
24. Real-time driver distraction recognition: A hybrid genetic deep network based approach10.1016/j.aej.2022.12.009 ↗
25. Automatic segmentation of human placenta images with U-Net10.1109/ACCESS.2019.2958133 ↗
26. Deep learning-based method for SEM image segmentation in mineral characterization, an example from Duvernay Shale samples in Western Canada Sedimentary Basin10.1016/j.cageo.2020.104450 ↗
27. Ojeda-Pat, A., Martin-Gonzalez, A., and Soberanis-Mukul, R. (2020). Intelligent Computing Systems: Proceedings of the Third International Symposium, ISICS 2020, Sharjah, United Arab Emirates, 18–19 March 2020, Springer. Proceedings 3.
28. Khanh, T.L.B., Dao, D.P., Ho, N.H., Yang, H.J., Baek, E.T., Lee, G., Kim, S.H., and Yoo, S.B. (2020). Enhancing U-Net with spatial-channel attention gate for abnormal tissue segmentation in medical imaging. Appl. Sci., 10.10.3390/app10175729 ↗
29. Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25–28). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 fourth international conference on 3D vision (3DV), Stanford, CA, USA.10.1109/3DV.2016.79 ↗
30. Detecting distraction of drivers using convolutional neural network10.1016/j.patrec.2017.12.023 ↗
31. CAT-CapsNet: A Convolutional and Attention Based Capsule Network to Detect the Driver’s Distraction10.1109/TITS.2023.3266113 ↗
32. Abbas, T., Ali, S.F., Mohammed, M.A., Khan, A.Z., Awan, M.J., Majumdar, A., and Thinnukool, O. (2022). Deep Learning Approach Based on Residual Neural Network and SVM Classifier for Driver’s Distraction Detection. Appl. Sci., 12.10.3390/app12136626 ↗
33. Khan, T., Choi, G., and Lee, S. (2023). EFFNet-CA: An Efficient Driver Distraction Detection Based on Multiscale Features Extractions and Channel Attention Mechanism. Sensors, 23.10.3390/s23083835 ↗
34. U-Net-Based Medical Image Segmentation10.1155/2022/4189781 ↗
35. Wambura, S., Li, H., and Nigussie, A. (2020, January 14–16). Fast memory-efficient extreme events prediction in complex time series. Proceedings of the 2020 3rd International Conference on Robot Systems and Applications, Chengdu, China.10.1145/3402597.3402609 ↗
36. Improving computer-aided detection using convolutional neural networks and random view aggregation10.1109/TMI.2015.2482920 ↗
37. Chollet, F. (2021). Deep Learning with Python, Simon and Schuster.
38. Wambura, S., and Li, H. (2020, January 4–6). Deep and confident image analysis for disease detection. Proceedings of the 2020 2nd International Conference on Video, Signal and Image Processing, Jakarta, Indonesia.10.1145/3442705.3442720 ↗
39. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
40. Funt, B., and Zhu, L. (2018, January 12–16). Does colour really matter? Evaluation via object classification. Proceedings of the Color and Imaging Conference. Society for Imaging Science and Technology, Vancouver, BC, Canada.10.2352/ISSN.2169-2629.2018.26.268 ↗
41. Towards computationally efficient and realtime distracted driver detection with mobilevgg network10.1109/TIV.2020.2995555 ↗
42. Wikipedia (2022, November 23). Confusion Matrix. Available online: https://en.wikipedia.org/wiki/Confusion_matrix.
43. Ai, Y., Xia, J., She, K., and Long, Q. (2019, January 30–31). Double attention convolutional neural network for driver action recognition. Proceedings of the 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), Sanya, China.10.1109/EITCE47263.2019.9094987 ↗
44. Behera, A., and Keidel, A.H. (December, January 29). Latent body-pose guided densenet for recognizing driver’s fine-grained secondary activities. Proceedings of the 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Madrid, Spain.10.1109/AVSS.2018.8639158 ↗
45. Zhang, B. (2016). Apply and Compare Different Classical Image Classification Method: Detect Distracted Driver, Department Computer Science, Stanford University. Project Report.