Improvement of Damage Segmentation Based on Pixel-Level Data Balance Using VGG-Unet
Source abstract
Abstract
In this research, 200 corrosion images of steel and 500 crack images of rubber bearing are collected and manually labeled to build the data set. Then the two data sets are respectively adopted to train VGG-Unet models in two methods, aiming to conduct Damage Segmentation by inputting different size of data set. One method is Squashing Segmentation to input squashed images from high resolution directly into VGG-Unet model while Cropping Segmentation uses cropped image with size 224 × 224 as input images. Because the proportion of damage pixels in the data set is different, the results produced by the two data sets are quite different. For large size damage (such as corrosion) segmentation, Cropping Segmentation has a better result while for minor damage (such as crack) segmentation, the result is opposite. The main reason is the gap in the concentration of valid data from the data set. To improve the capability of crack segmentation based on Cropping Segmentation, Background Data Drop Rate (BDDR) is adopted to reduce the quantity of background images to control the proportion of damage pixels from the data set in pixel-level. The ratio of damage pixels from the data set can be decided by different value of BDDR. By testing, the accuracy of Cropping Segmentation becomes relatively higher under BDDR being 0.8.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Civil and Environmental Engineering, Saitama University, 645 Shimo-okubo, Sakura-ku, Saitama-shi 338-8570, Japan
Department of Civil Engineering, Southeast University, No. 2 Southeast University Road, Jiangning District, Nanjing 211189, China
Kawakin Core-Tech Co., Ltd., 2 Chome-2-7 Kawaguchi, Saitama-ken 332-0015, Japan
References (39)
Show source-provided references
1. Social impact of a bridge accident in Minnesota, USA
2. Ministry of Land, Infrastructure, Transport, and Tourism (2016). White Paper on Present State and Future of Social Capital Aging Infrastructure Maintenance Information, (In Japanese).
3. Current status of domestic bridges and problems to be solved
4. Visual inspection of highway bridges10.1023/A:1022508121821 ↗
5. Hoskere, V., Narazaki, Y., Hoang, T.A., and Spencer, B.F. (2018). Towards automated post-earthquake inspections with deep learning-based condition-aware models. arXiv.
6. Deep transfer learning for image-based structural damage recognition10.1111/mice.12363 ↗
7. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure10.1016/j.aei.2015.01.008 ↗
8. Analysis of edge-detection techniques for crack identification in bridges
9. Concrete crack detection by multiple sequential image filtering10.1111/j.1467-8667.2011.00716.x ↗
10. Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments10.1016/j.aei.2012.06.005 ↗
11. The fast Haar transform10.1109/45.666645 ↗
12. Nussbaumer, H.J. (1981). The fast Fourier transform. Fast Fourier Transform and Convolution Algorithms, Springer.10.1007/978-3-662-00551-4 ↗
13. Image recognition with deep neural networks in presence of noise–dealing with and taking advantage of distortions10.3233/ICA-170551 ↗
14. Pseudospectra, MUSIC, and dynamic wavelet neural network for damage detection of highrise buildings10.1002/nme.1964 ↗
15. Defect detection in reinforced concrete using random neural architectures10.1111/mice.12039 ↗
16. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
17. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 1097–1105.
18. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
19. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
20. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
21. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
22. Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25–28). Road crack detection using deep convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
23. Soukup, D., and Huber-Mörk, R. (2014). Convolutional neural networks for steel surface defect detection from photometric stereo images. International Symposium on Visual Computing, Springer.10.1007/978-3-319-14249-4_64 ↗
24. Faster r-cnn: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
25. Wang, W., Wu, B., Yang, S., and Wang, Z. (2018, January 10–13). Road damage detection and classification with Faster R-CNN. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.10.1109/BigData.2018.8622354 ↗
26. Concrete crack detection with handwriting script interferences using faster region-based convolutional neural network10.1111/mice.12497 ↗
27. Automatic damage detection of historic masonry buildings based on mobile deep learning10.1016/j.autcon.2019.03.003 ↗
28. Damage Detection and Localization in Masonry Structure using Faster Region Convolutional Networks
29. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types10.1111/mice.12334 ↗
30. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
31. Zhang, C., Chang, C.C., and Jamshidi, M. (2018). Bridge Damage Detection using a Single-Stage Detector and Field Inspection Images. arXiv.
32. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2014). Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv.
33. Iglovikov, V., and Shvets, A. (2018). Ternausnet: U-net with vgg11 encoder pre-trained on imagenet for image segmentation. arXiv.
34. Pixel-level crack delineation in images with convolutional feature fusion10.1002/stc.2286 ↗
35. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network10.1111/mice.12433 ↗
36. Structural Context Based Pixel-level Damage Detection for Rubber Bearing
37. Vision-based automated bridge component recognition with high-level scene consistency10.1111/mice.12505 ↗
38. Fawakherji, M., Youssef, A., Bloisi, D., Pretto, A., and Nardi, D. (2019, January 25–27). Crop and weeds classification for precision agriculture using context-independent pixel-wise segmentation. Proceedings of the 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy.10.1109/IRC.2019.00029 ↗
39. Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., and Garcia-Rodriguez, J. (2017). A review on deep learning techniques applied to semantic segmentation. arXiv.10.1016/j.asoc.2018.05.018 ↗