Pothole Classification Model Using Edge Detection in Road Image
Source abstract
Abstract
Since the image related to road damage includes objects such as potholes, cracks, shadows, and lanes, there is a problem that it is difficult to detect a specific object. In this paper, we propose a pothole classification model using edge detection in road image. The proposed method converts RGB (red green and blue) image data, including potholes and other objects, to gray-scale to reduce the amount of computation. It detects all objects except potholes using an object detection algorithm. The detected object is removed, and a pixel value of 255 is assigned to process it as a background. In addition, to extract the characteristics of a pothole, the contour of the pothole is extracted through edge detection. Finally, potholes are detected and classified based by the (you only look once) YOLO algorithm. The performance evaluation evaluates the distortion rate and restoration rate of the image, and the validity of the model and accuracy of the classification. The result of the evaluation shows that the mean square error (MSE) of the distortion rate and restoration rate of the proposed method has errors of 0.2–0.44. The peak signal to noise ratio (PSNR) is evaluated as 50 db or higher. The structural similarity index map (SSIM) is evaluated as 0.71–0.82. In addition, the result of the pothole classification shows that the area under curve (AUC) is evaluated as 0.9.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Concrete Corrosion and Durability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, Kyonggi University, Suwon 16227, Korea
Division of Computer Science and Engineering, Kyonggi University, Suwon 16227, Korea
References (55)
Show source-provided references
1. Machine Learning in Computer Vision10.1016/j.procs.2020.03.355 ↗
2. An intelligent fire detection approach through cameras based on computer vision methods10.1016/j.psep.2019.05.016 ↗
3. An image processing and computer vision framework for efficient robotic sketching10.1016/j.procs.2018.07.035 ↗
4. Computer-vision-based bare-hand augmented reality interface for controlling an AR object10.1504/IJCAET.2018.090527 ↗
5. An Automatic Detection of a Natural Marker and Augmentation of 3D Models in AR with Sketch-based Object Matching
6. Segmentation based rotated bounding boxes prediction and image synthesizing for object detection of high resolution aerial images10.1016/j.neucom.2020.01.039 ↗
7. Cascade region proposal and global context for deep object detection10.1016/j.neucom.2017.12.070 ↗
8. Object detection with class aware region proposal network and focused attention objective10.1016/j.patrec.2018.09.025 ↗
9. A New Hyper Parameter of Hounsfield Unit Range in Liver Segmentation
10. Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., and Cottrell, G. (2018, January 12–15). Understanding convolution for semantic segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Nevada, CA, USA.10.1109/WACV.2018.00163 ↗
11. Neven, D., De Brabandere, B., Georgoulis, S., Proesmans, M., and Van Gool, L. (2018, January 26–30). Towards end-to-end lane detection: An instance segmentation approach. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium, Changshu, Suzhou, China.10.1109/IVS.2018.8500547 ↗
12. Vigneshwar, K., and Kumar, B.H. (2016, January 15–17). Detection and counting of pothole using image processing techniques. Proceedings of the 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), Chennai, India.10.1109/ICCIC.2016.7919622 ↗
13. (2020, July 10). Ministry of Land, Infrastructure and Transport. Available online: http://www.molit.go.kr.
14. Real Time Pothole Detection System based on Video Data for Automatic Maintenance of Road Surface Distress10.5626/KTCP.2016.22.1.8 ↗
15. Microstructural evolution and mechanical properties of welding seams in aluminum alloy profiles extruded by a porthole die under different billet heating temperatures and extrusion speeds10.1016/j.jmatprotec.2017.04.030 ↗
16. Kang, B.H., and Choi, S.I. (2017, January 4–7). Pothole detection system using 2D LiDAR and camera. Proceedings of the 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN), Milan, Italy.10.1109/ICUFN.2017.7993890 ↗
17. Using convolutional neural networks for recognition of objects varied in appearance in computer vision for intellectual robots10.1016/j.procs.2020.02.129 ↗
18. 2D Human Pose Estimation based on Object Detection using RGB-D information
19. Moving object detection under different weather conditions using full-spectrum light sources10.1016/j.patrec.2019.11.004 ↗
20. AU R-CNN: Encoding expert prior knowledge into R-CNN for action unit detection10.1016/j.neucom.2019.03.082 ↗
21. Scale-aware fast R-CNN for pedestrian detection
22. Intelligent fault detection of high voltage line based on the Faster R-CNN10.1016/j.measurement.2019.01.072 ↗
23. Real-time Bhutanese license plate localization using YOLO10.1016/j.icte.2019.11.001 ↗
24. A real-time object detection algorithm for video10.1016/j.compeleceng.2019.05.009 ↗
25. Using multi-label classification to improve object detection10.1016/j.neucom.2019.08.089 ↗
26. A multioutcrop sharing and interpretation system: Exploring 3-d surface and subsurface data10.1109/MGRS.2018.2825990 ↗
27. Cryogenic flow rate measurement with a laser Doppler velocimetry standard10.1088/1361-6501/aa9dd1 ↗
28. Stability Analysis for Interval Pillar of Small-distance Tunnel under Different Types of Surrounding Rock and Construction Countermeasures
29. Pothole Detection Algorithm Based on Saliency Map for Improving Detection Performance10.12815/kits.2016.15.4.104 ↗
30. Image fusion with saliency map and interest points10.1016/j.neucom.2015.10.080 ↗
31. Chen, C., Seo, H.S., Zhao, Y., Chen, B., Kim, J.W., Choi, Y., and Bang, M. (2019, January 8–10). Pavement Damage Detection System Using Big Data Analysis of Multiple Sensor. Proceedings of the International Conference on Smart Infrastructure and Construction 2019 (ICSIC) Driving Data-Informed Decision-Making, Churchill College, Cambridge, UK.10.1680/icsic.64669.559 ↗
32. Romanuke, V.V. (2019). An infinitely scalable dataset of single-polygon grayscale images as a fast test platform for semantic image segmentation. KPI Sci. News, 24–34.10.20535/kpi-sn.2019.1.157259 ↗
33. Reversible data hiding in encrypted binary images by pixel prediction10.1016/j.sigpro.2019.07.020 ↗
34. Arnal, J., and Súcar, L. (2020). Hybrid filter based on fuzzy techniques for mixed noise reduction in color images. Appl. Sci., 10.10.3390/app10010243 ↗
35. Vehicle detection in aerial images using rotation-invariant cascaded forest10.1109/ACCESS.2019.2915368 ↗
36. The algorithm development for operation of a computer vision system via the OpenCV library10.1016/j.procs.2020.02.193 ↗
37. Cui, W., Strazdins, G., and Wang, H. (2020, January 2). Web-based Scalable Visual Exploration of Large Multidimensional Data Using Human-in-the-Loop Edge Bundling in Parallel Coordinates. Proceedings of the EDBT/ICDT Workshops, Copenhagen, Denmark.
38. Influence of Additives on the Interfacial Width and Line Edge Roughness in Block Copolymer Lithography10.1021/acs.chemmater.9b04833 ↗
39. Hydrogen-induced step-edge roughening of platinum electrode surfaces10.1021/acs.jpclett.9b02544 ↗
40. Jin, M., Noh, H., Song, M., and Kim, S.Y. (2020). Design of an Edge-Detection CMOS Image Sensor with Built-in Mask Circuits. Sensors, 20.10.3390/s20133649 ↗
41. An accurate and efficient multi-category edge detection method10.1016/j.cogsys.2019.06.002 ↗
42. Multidirectional edge detection based on gradient ghost imaging10.1016/j.ijleo.2019.163768 ↗
43. Image quality assessment based on Prewitt magnitude10.1016/j.aeue.2013.04.001 ↗
44. A roberts’ adaptive edge detection method
45. Laplacian pyramid-based change detection in multitemporal SAR images10.1080/22797254.2019.1640077 ↗
46. Real Time Identification of Railway Track Surface Faults using Canny Edge Detector and 2D Discrete Wavelet Transform10.33166/AETiC.2020.02.005 ↗
47. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2015). You Only Look Once: Unified, Real-Time Object Detection. arXiv.10.1109/CVPR.2016.91 ↗
48. Road damage detection and classification using deep neural networks with smartphone images10.1111/mice.12387 ↗
49. (2020, July 05). KBS (Korea Broadcasting System). Available online: http://www.kbs.co.kr.
50. YTN (2020, July 05). Available online: https://www.ytn.co.kr.
51. (2020, July 05). SBS (Seoul Broadcasting System). Available online: https://www.sbs.co.kr.
52. Process monitoring ROC curve for evaluating dynamic screening methods10.1080/00401706.2019.1604434 ↗
53. The area under the precision-recall curve as a performance metric for rare binary events10.1111/2041-210X.13140 ↗
54. Akula, A., Bhatia, Y., Rai, R., Gupta, V., and Aggarwal, N. (2020). Pothole Detection Based on Convolutional Neural Network Using Computer Vision. J. King Saud Univ. Comput. Inf. Sci.
55. Visual analysis of asphalt pavement for detection and localization of potholes10.1016/j.aei.2018.09.002 ↗