journal article·2021-11-15Open access

ROADLANE—The Modular Framework to Support Recognition Algorithms of Road Lane Markings

Felipe Franco, Max Mauro Dias Santos, Rui Tadashi Yoshino, Leopoldo Rideki Yoshioka, João Francisco Justo

Applied Sciences· Volume 11· Issue 22

Abstract

One of the main actions of the driver is to keep the vehicle in a road lane within its markings, which could be aided with modern driver-assistance systems. Forward digital cameras in vehicles allow deploying computer vision strategies to extract the road recognition characteristics in real-time to support several features, such as lane departure warning, lane-keeping assist, and traffic recognition signals. Therefore, the road lane marking needs to be recognized through computer vision strategies providing the functionalities to decide on the vehicle’s drivability. This investigation presents a modular architecture to support algorithms and strategies for lane recognition, with three principal layers defined as pre-processing, processing, and post-processing. The lane-marking recognition is performed through statistical methods, such as buffering and RANSAC (RANdom SAmple Consensus), which selects only objects of interest to detect and recognize the lane markings. This methodology could be extended and deployed to detect and recognize any other road objects.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Image and Object Detection Techniques · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electronics, Federal University of Technology, Ponta Grossa 84017-220, PR, Brazil

Graduate Program in Industrial Engineering, Federal University of Technology, Ponta Grossa 84017-220, PR, Brazil

Escola Politécnica, Universidade de São Paulo, Butantã 05508-010, SP, Brazil

Funding

Federal University of Technology - Paraná

References (36)

Show source-provided references
1. Sjafrie, H. (2019). Introduction to Self-Driving Vehicle Technology, Chapman and Hall/CRC Publishing.10.1201/9780429316777 ↗
2. Denton, T. (2019). Automated Driving and Driver Assistance Systems, Routledge.10.1201/9780429293856 ↗
3. Autonomous vehicles: Challenges, opportunities, and future implications for transportation policies10.1007/s40534-016-0117-3 ↗
4. NHTSA (2015). Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey.
5. NTSB (2015). The Use of Forward Collision Avoidance Systems to Prevent and Mitigate Rear-End Crashes.
6. Krotosky, S., and Trivedi, M. (2006, January 17–20). Multimodal Stereo Image Registration for Pedestrian Detection. Proceedings of the 2006 IEEE Intelligent Transportation Systems Conference, Toronto, ON, Canada.10.1109/ITSC.2006.1706727 ↗
7. On Color-, Infrared-, and Multimodal-Stereo Approaches to Pedestrian Detection10.1109/TITS.2007.908722 ↗
8. Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis10.1109/TIP.2006.875174 ↗
9. Jung, C.R., and Kelber, C.R. (2004, January 14–17). A lane departure warning system based on a linear-parabolic lane model. Proceedings of the Intelligent Vehicles Symposium, Parma, Italy.
10. Borkar, M.H., and Smith, M.T. (2009, January 7–10). Robust lane detection and tracking with ransac and kalman filter. Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.10.1109/ICIP.2009.5413980 ↗
11. Fangfang, X., Bo, W., Zhiqiang, Z., and Zhihui, Z. (2012, January 25–27). Real-time lane detection for intelligent vehicles based on monocular vision. Proceedings of the 31st Chinese Control Conference (CCC), Hefei, China.
12. Kang, J.-S., Kim, J., and Lee, M. (2014, January 10–13). Advanced driver assistant system based on monocular camera. Proceedings of the 2014 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.10.1109/ICCE.2014.6775905 ↗
13. Beyeler, M., Mirus, F., and Verl, A. (June, January 31). Vision-based robust road lane detection in urban environments. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.10.1109/ICRA.2014.6907580 ↗
14. Guo, J., Wei, Z., and Miao, D. (2015, January 25–27). Lane detection method based on improved RANSAC algorithm. Proceedings of the 2015 IEEE Twelfth International Symposium on Autonomous Decentralized Systems, Taichung, Taiwan.10.1109/ISADS.2015.24 ↗
15. Xu, S., Ye, P., Han, S., Sun, H., and Jia, Q. (2016, January 19–21). Road lane modeling based on RANSAC algorithm and hyperbolic model. Proceedings of the 2016 3rd International Conference on Systems and Informatics (ICSAI), Shanghai, China.10.1109/ICSAI.2016.7810937 ↗
16. Zhu, S., Wang, J., Yu, T., and Wang, J. (2017, January 2–4). A method of lane detection and tracking for expressway based on RANSAC. Proceedings of the 2017 2nd International Conference on Image, Vision and Computing (ICIVC), Chengdu, China.
17. Characteristic Analysis of Out Threshrold and its Applications10.1016/j.patrec.2011.01.021 ↗
18. Weibin, R., Zhanjing, L., Wei, Z., and Lining, S. (2014, January 3–6). An improved Canny edge detection algorithm. Proceedings of the IEEE International Conference on Mechatronics and Automation, Tianjin, China.
19. Gonzalez, R.C., and Woods, R.E. (2012). Digital Image Processing, Prentice Hall.
20. Andrade, D., Adamshuk, R., Omoto, W., Franco, F., Neme, J.H., Okida, S., Tusset, A., Amaral, R., Ventura, A., and Santos, M.M.D. (2017). Lane Detection Using Orientation of Gradient and Vehicle Network Signals, SAE. SAE Technical Paper.10.4271/2017-01-0042 ↗
21. Adamshuk, R., Carvalho, D., Neme, J.H.Z., Margraf, E., Okida, S., Tusset, A., Santos, M.M., Amaral, R., Ventura, A., and Carvalho, S. (2017, January 22–25). On the applicability of inverse perspective mapping for the forward distance estimation based on the HSV colormap. Proceedings of the 2017 IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.10.1109/ICIT.2017.7915504 ↗
22. Advances in image pre-processing to improve automated 3D reconstruction10.5194/isprsarchives-XL-5-W4-315-2015 ↗
23. Sonka, M., Hlavac, V., and Boyle, R. (2014). Image Processing, Analysis, and Machine Vision, Cengage Learning.
24. Tri-state median filter for image denoising10.1109/83.806630 ↗
25. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
26. Fischler, M.A., and Bolles, R.C. (1987). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Readings in Computer Vision, Elsevier.10.1016/B978-0-08-051581-6.50070-2 ↗
27. Outlier detection by means of robust regression estimators for use in engineering science10.1631/jzus.A0820140 ↗
28. Satzoda, R.K., and Trivedi, M.M. (2014, January 24–28). On Performance Evaluation Metrics for Lane Estimation. Proceedings of the 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden.10.1109/ICPR.2014.453 ↗
29. Karpushin, M., Valenzise, G., and Dufaux, F. (2016, January 20–25). An image smoothing operator for fast and accurate scale space approximation. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing Pattern Recognition (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7471999 ↗
30. Padhy, S., and Padhi, S.S. (2013, January 22–25). Suppresion of gaussian noise using baysian classifier in an image. Proceedings of the 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Mysore, India.10.1109/ICACCI.2013.6637262 ↗
31. Whe standard RANSAC is not enough cross-media visual matching with hypothesis relevancy10.1007/s00138-013-0571-4 ↗
32. Choi, S., Kim, T., and Yu, W. (2009, January 7–10). Performance evaluation of RANSAC family. Proceedings of the British Machine Vision Conference (BMVC), London, UK.10.5244/C.23.81 ↗
33. Zhang, Y., Zongqing, L., Zhang, X., Xue, J.-H., and Liao, Q. (2021). Deep Learning in Lane Marking Detection: A Survey. IEEE Transactions on Intelligent Transportation Systems, IEEE.10.1109/TITS.2021.3070111 ↗
34. Lane Detection: A Survey with New Results10.1007/s11390-020-0476-4 ↗
35. Pizzati, F., Allodi, M., Barrera, A., and García, F. (2020). Lane detection and classification using cascaded CNNs. EUROCAST 2019, Springer. Lecture Notes in Computer Science.10.1007/978-3-030-45096-0_12 ↗
36. Deep neural network for structural prediction and lane detection in traffic scene10.1109/TNNLS.2016.2522428 ↗