Manhole Cover Classification Based on Super-Resolution Reconstruction of Unmanned Aerial Vehicle Aerial Imagery
Source abstract
Abstract
Urban underground pipeline networks are a key component of urban infrastructure, and a large number of older urban areas lack information about their underground pipelines. In addition, survey methods for underground pipelines are often time-consuming and labor-intensive. While the manhole cover serves as the hub connecting the underground pipe network with the ground, the generation of underground pipe network can be realized by obtaining the location and category information of the manhole cover. Therefore, this paper proposed a manhole cover detection method based on UAV aerial photography to obtain ground images, using image super-resolution reconstruction and image positioning and classification. Firstly, the urban image was obtained by UAV aerial photography, and then the YOLOv8 object detection technology was used to accurately locate the manhole cover. Next, the SRGAN network was used to perform super-resolution processing on the manhole cover text to improve the clarity of the recognition image. Finally, the clear manhole cover text image was input into the VGG16_BN network to realize the manhole cover classification. The experimental results showed that the manhole cover classification accuracy of this paper’s method reached 97.62%, which verified its effectiveness in manhole cover detection. The method significantly reduces the time and labor cost and provides a new method for manhole cover information acquisition.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Measurement and Detection Methods · Image and Object Detection Techniques · Optical Systems and Laser Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanics and Engineering Science, Shanghai University, Shanghai 200444, China
References (30)
Show source-provided references
1. Automated localization of urban drainage infrastructure from public-access street-level images10.1080/1573062X.2019.1687743 ↗
2. Automatic mapping of urban wastewater networks based on manhole cover locations10.1016/j.compenvurbsys.2019.101370 ↗
3. Detection and localization of manhole and joint covers in radar images by support vector machine and Hough transform10.1016/j.autcon.2021.103651 ↗
4. Luo, X., Wu, Y., and Zhao, L. (2022). YOLOD: A Target Detection Method for UAV Aerial Imagery. Remote Sens., 14.10.3390/rs14143240 ↗
5. Eslami, E., and Yun, H.-B. (2021). Attention-Based Multi-Scale Convolutional Neural Network (A+MCNN) for Multi-Class Classification in Road Images. Sensors, 21.10.3390/s21155137 ↗
6. Hu, Q., Li, L., Duan, J., Gao, M., Liu, G., Wang, Z., and Huang, D. (2023). Object Detection Algorithm of UAV Aerial Photography Image Based on Anchor-Free Algorithms. Electronics, 12.10.3390/electronics12061339 ↗
7. Multi-Attention Object Detection Model in Remote Sensing Images Based on Multi-Scale10.1109/ACCESS.2019.2928522 ↗
8. Liu, W., Cheng, D., Yin, P., Yang, M., Li, E., Xie, M., and Zhang, L. (2019). Small Manhole Cover Detection in Remote Sensing Imagery with Deep Convolutional Neural Networks. ISPRS Int. J. Geo Inf., 8.10.3390/ijgi8010049 ↗
9. Automated Detection of Urban Road Manhole Covers Using Mobile Laser Scanning Data10.1109/TITS.2015.2413812 ↗
10. Road Manhole Cover Delineation Using Mobile Laser Scanning Point Cloud Data10.1109/LGRS.2019.2916156 ↗
11. Wei, Z., Yang, M., Wang, L., Ma, H., Chen, X., and Zhong, R. (2019). Customized Mobile LiDAR System for Manhole Cover Detection and Identification. Sensors, 19.10.3390/s19102422 ↗
12. Real-time detection of road manhole covers with a deep learning model10.1038/s41598-023-43173-z ↗
13. Mattheuwsen, L., and Vergauwen, M. (2020). Manhole Cover Detection on Rasterized Mobile Mapping Point Cloud Data Using Transfer Learned Fully Convolutional Neural Networks. Remote Sens., 12.10.3390/rs12223820 ↗
14. Wang, Y., Sun, G., and Guo, S. (2021). Target Detection Method for Low-Resolution Remote Sensing Image Based on ESRGAN and ReDet. Photonics, 8.10.3390/photonics8100431 ↗
15. Gong, Y., Liao, P., Zhang, X., Zhang, L., Chen, G., Zhu, K., Tan, X., and Lv, Z. (2021). Enlighten-GAN for Super Resolution Reconstruction in Mid-Resolution Remote Sensing Images. Remote Sens., 13.10.3390/rs13061104 ↗
16. Clabaut, É., Lemelin, M., Germain, M., Bouroubi, Y., and St-Pierre, T. (2021). Model Specialization for the Use of ESRGAN on Satellite and Airborne Imagery. Remote Sens., 13.10.3390/rs13204044 ↗
17. Fan, C., Wu, C., Li, G., and Ma, J. (2017). Projections onto Convex Sets Super-Resolution Reconstruction Based on Point Spread Function Estimation of Low-Resolution Remote Sensing Images. Sensors, 17.10.3390/s17020362 ↗
18. Superresolution Reconstruction of Remote Sensing Image Based on Generative Adversarial Network
19. IRE: Improved Image Super-Resolution Based on Real-ESRGAN10.1109/ACCESS.2023.3256086 ↗
20. Text Prior Guided Scene Text Image Super-Resolution10.1109/TIP.2023.3237002 ↗
21. Yue, X., Liu, D., Wang, L., Benediktsson, J.A., Meng, L., and Deng, L. (2023). IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction. Remote Sens., 15.10.3390/rs15143490 ↗
22. Research on text detection on building surfaces in smart cities based on deep learning10.1007/s00500-022-07391-3 ↗
23. Saydirasulovich, S.N., Mukhiddinov, M., Djuraev, O., Abdusalomov, A., and Cho, Y.-I. (2023). An Improved Wildfire Smoke Detection Based on YOLOv8 and UAV Images. Sensors, 23.10.3390/s23208374 ↗
24. Zhai, X., Huang, Z., Li, T., Liu, H., and Wang, S. (2023). YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection. Electronics, 12.10.3390/electronics12173664 ↗
25. Luan, X., Zhang, J., Xu, M., Silamu, W., and Li, Y. (2023). Lightweight Scene Text Recognition Based on Transformer. Sensors, 23.10.3390/s23094490 ↗
26. Natural Scene Text Recognition Based on Encoder-Decoder Framework10.1109/ACCESS.2019.2916616 ↗
27. A Super Resolution Algorithm Based on Attention Mechanism and SRGAN Network10.1109/ACCESS.2021.3100069 ↗
28. A texture-based approach for word script and nature identification10.1007/s10044-016-0555-x ↗
29. Pattern Matching Model for Recognition of Stone Inscription Characters10.1093/comjnl/bxab177 ↗
30. Crack Detection of Concrete Pavement with Cross-Entropy Loss Function and Improved VGG16 Network Model10.1109/ACCESS.2020.2981561 ↗