journal article·2025-01-04Open access

Rearview Camera-Based Blind-Spot Detection and Lane Change Assistance System for Autonomous Vehicles

Yunhee Lee, Manbok Park

Applied Sciences· Volume 15· Issue 1

Abstract

This paper focuses on a method of rearview camera-based blind-spot detection and a lane change assistance system for autonomous vehicles, utilizing a convolutional neural network and lane detection. In this study, we propose a method for providing real-time warnings to autonomous vehicles and drivers regarding collision risks during lane-changing maneuvers. We propose a method for lane detection to delineate the area for blind-spot detection and for measuring time to collision—both utilized to ascertain the vehicle’s location and compensate for vertical vibrations caused by vehicle movement. The lane detection method uses edge detection on an input image to extract lane markings by employing edge pairs consisting of positive and negative edges. Lanes were extracted through third-polynomial fitting of the extracted lane markings, with each lane marking being tracked using the results from the previous frame detections. Using the vanishing point where the two lanes converge, the camera calibration information is updated to compensate for the vertical vibrations caused by vehicle movement. Additionally, the proposed method utilized YOLOv9 for object detection, leveraging lane information to define the region of interest (ROI) and detect small-sized objects. The object detection achieved a precision of 90.2% and a recall of 82.8%. The detected object information was subsequently used to calculate the collision risk. A collision risk assessment was performed for various objects using a three-level collision warning system that adapts to the relative speed of obstacles. The proposed method demonstrated a performance of 11.64 fps with an execution time of 85.87 ms. It provides real-time warnings to both drivers and autonomous vehicles regarding potential collisions with detected objects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Advanced Neural Network Applications · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

IVIS Corp., Suwon-si 16229, Republic of Korea

Department of Electronic Engineering, College of Convergence Technology, Korea National University of Transportation, Chungju-si 27469, Republic of Korea

Funding

Ministry of Trade, Industry and Energy (MOTIE, Korea)

References (34)

Show source-provided references
1. Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety10.1109/TITS.2006.889442 ↗
2. Jung, H.G., Kim, D.S., Yoon, P.J., and Kim, J. (2006, January 13–15). Parking slot markings recognition for automatic parking assist system. Proceedings of the 2006 IEEE Intelligent Vehicles Symposium, Tokyo, Japan.
3. Effects of blind spot monitoring systems on police-reported lane-change crashes10.1080/15389588.2018.1476973 ↗
4. Part-based vehicle detection in side-rectilinear images for blind-spot detection10.1016/j.eswa.2018.02.005 ↗
5. Liu, G., Wang, L., and Zou, S. (2017, January 25–26). A radar-based blind spot detection and warning system for driver assistance. Proceedings of the 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC.2017.8054409 ↗
6. Kim, W., Yang, H., and Kim, J. (2023). Blind Spot Detection Radar System Design for Safe Driving of Smart Vehicles. Appl. Sci., 13.10.3390/app13106147 ↗
7. Kwon, D., Malaiya, R., Yoon, G., Ryu, J.T., and Pi, S.Y. (2019). A study on development of the camera-based blind spot detection system using the deep learning methodology. Appl. Sci., 9.10.3390/app9142941 ↗
8. Nighttime data augmentation using GAN for improving blind-spot detection10.1109/ACCESS.2020.2979239 ↗
9. A cross-entropy method for optimising robotic automated storage and retrieval systems10.1080/00207543.2018.1456692 ↗
10. Mahapatra, R., Kumar, K.V., Khurana, G., and Mahajan, R. (2008, January 20–22). Ultra sonic sensor based blind spot accident prevention system. Proceedings of the 2008 International Conference on Advanced Computer Theory and Engineering, Phuket, Thailand.10.1109/ICACTE.2008.165 ↗
11. Blind-spot vehicle detection using motion and static features10.7763/IJMLC.2014.V6.465 ↗
12. Integrating appearance and edge features for sedan vehicle detection in the blind-spot area10.1109/TITS.2011.2182649 ↗
13. Blind spot obstacle detection from monocular camera images with depth cues extracted by CNN10.1007/s42154-018-0036-6 ↗
14. Zhao, Y., Bai, L., Lyu, Y., and Huang, X. (2019). Camera-based blind spot detection with a general purpose lightweight neural network. Electronics, 8.10.3390/electronics8020233 ↗
15. Real-time vehicle detection using a single rear camera for a blind spot warning system10.4271/2012-01-0293 ↗
16. A blind-zone detection method using a rear-mounted fisheye camera with combination of vehicle detection methods10.1109/TITS.2015.2467357 ↗
17. Vision-based blind spot monitoring using rear-view camera and its real-time implementation in an embedded system10.5626/JCSE.2018.12.3.127 ↗
18. A review of recent advances in lane detection and departure warning system10.1016/j.patcog.2017.08.014 ↗
19. Lee, Y., Park, M.k., and Park, M. (2022). Improving Lane Detection Performance for Autonomous Vehicle Integrating Camera with Dual Light Sensors. Electronics, 11.10.3390/electronics11091474 ↗
20. Dong, Y., Xiong, J., Li, L., and Yang, J. (2012, January 28–29). Lane detection based on object segmentation and piecewise fitting. Proceedings of the ICCP Proceedings, Seattle, WA, USA.
21. Vehicle position monitoring using Hough transform10.1016/j.ieri.2013.11.045 ↗
22. Sensor fusion-based lane detection for LKS+ ACC system10.1007/s12239-009-0026-0 ↗
23. Borkar, A., Hayes, M., and Smith, M.T. (2009, January 7–10). Robust lane detection and tracking with ransac and kalman filter. Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.10.1109/ICIP.2009.5413980 ↗
24. Redmill, K.A., Upadhya, S., Krishnamurthy, A., and Ozguner, U. (2001, January 25–29). A lane tracking system for intelligent vehicle applications. Proceedings of the ITSC 2001, 2001 IEEE Intelligent Transportation Systems, Proceedings (Cat. No. 01TH8585), Oakland, CA, USA.
25. Vision-based fusion of robust lane tracking and forward vehicle detection in a real driving environment10.1007/s12239-012-0064-x ↗
26. Robust multirate control scheme with predictive virtual lanes for lane-keeping system of autonomous highway driving10.1109/TVT.2014.2356204 ↗
27. A flexible new technique for camera calibration10.1109/34.888718 ↗
28. Radial distortion refinement by inverse mapping-based extrapolation10.1109/ICPR.2006.952 ↗
29. Deep learning10.1038/nature14539 ↗
30. Wang, C.Y., Yeh, I.H., and Liao, H.Y.M. (2024). Yolov9: Learning what you want to learn using programmable gradient information. arXiv.10.1007/978-3-031-72751-1_1 ↗
31. How transferable are features in deep neural networks?
32. Real-time vehicle detection and tracking using improved histogram of gradient features and Kalman filters10.1177/1729881417749949 ↗
33. A collision warning system for rear-end collision: A driving simulator study10.1016/j.sbspro.2011.08.075 ↗
34. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗