Intelligent Structural Health Monitoring and Noncontact Measurement Method of Small Reservoir Dams Using UAV Photogrammetry and Anomaly Detection
Source abstract
Abstract
This study proposes a UAV-based remote measurement method for accurately locating pedestrians and other small targets within small reservoir dams. To address the imprecise coordinate information in reservoir areas after prolonged operations, a transformation method for converting UAV coordinates into the local coordinate system without relying on preset parameters is introduced, accomplished by integrating the Structure from Motion (SfM) algorithm to calculate the transformation parameters. An improved YOLOv8 network is introduced for the high-precision detection of small pedestrian targets, complemented by a laser rangefinder to facilitate accurate 3D locating of targets from varying postures and positions. Furthermore, the integration of a thermal infrared camera facilitates the detection and localization of potential seepage. The experimental validation and application across two real small reservoir dams confirm the accuracy and applicability of the proposed approach, demonstrating the efficiency of the proposed routine UAV surveillance strategy and proving its potential to establish electronic fences and enhance maintenance operations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage · Infrastructure Maintenance and Monitoring · Remote Sensing and LiDAR Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Water Conservancy and Hydropower Engineering, Hohai University, Nanjing 210098, China
School of Hydraulic Engineering, Faculty of Infrastructure Engineering, Dalian University of Technology, Dalian 116024, China
School of Earth Sciences and Engineering, Hohai University, Nanjing 211100, China
Chongqing Surveying and Design Institute Co. Ltd. of Water Resources, Electric Power and Architecture, Chongqing 401120, China
Chongqing Water Resources and Electric Engineering College, Chongqing 402160, China
Funding
National Key R & D Program of China · National Natural Science Foundation of China · Chongqing Water Conservancy Science and Technology Project · China Postdoctoral Science Foundation · Natural Science Foundation of Jiangsu Province · Water Conservancy Science and Technology Project of Jiangsu Province · Guangxi Key R&D Program Project · Fundamental Research Funds for the Central Universities
References (72)
Show source-provided references
1. The cumulative impacts of small reservoirs on hydrology: A review10.1016/j.scitotenv.2018.06.188 ↗
2. Structural health monitoring of concrete dams using long-term air temperature for thermal effect simulation10.1016/j.engstruct.2018.11.065 ↗
3. An approach for simulating the interaction between soil and discontinuous structure with mixed interpolation interface10.1016/j.engstruct.2021.112035 ↗
4. A three-dimensional large-deformation random finite-element study of landslide runout considering spatially varying soil10.1007/s10346-021-01699-1 ↗
5. Monitoring thirty years of small water reservoirs proliferation in the southern Brazilian Amazon with Landsat time series10.1016/j.isprsjprs.2018.03.015 ↗
6. Hydraulic modelling of inland urban flooding: Recent advances10.1016/j.jhydrol.2022.127763 ↗
7. Experimental study on leakage detection of grassed earth dam by passive infrared thermography10.1016/j.ndteint.2021.102583 ↗
8. A closer look at sedimentation processes in two dam reservoirs10.1016/j.jhydrol.2021.127397 ↗
9. Seepage detection in earth-filled dam from self-potential and electrical resistivity tomography10.1016/j.enggeo.2022.106750 ↗
10. A review of UAV integration in forensic civil engineering: From sensor technologies to geotechnical, structural and water infrastructure applications10.1016/j.measurement.2023.113886 ↗
11. Advances in computer vision-based civil infrastructure inspection and monitoring10.1016/j.eng.2018.11.030 ↗
12. Zhu, Y., and Tang, H. (2023). Automatic damage detection and diagnosis for hydraulic structures using drones and artificial intelligence techniques. Remote Sens., 15.10.3390/rs15030615 ↗
13. A reliable methodology to estimate cable tension force in cable-stayed bridges using Unmanned Aerial Vehicle (UAV)10.1016/j.measurement.2024.114498 ↗
14. Full-field deformation measurement of structural nodes based on panoramic camera and deep learning-based tracking method10.1016/j.compind.2022.103840 ↗
15. Photo-realistic visualization of seismic dynamic responses of urban building clusters based on oblique aerial photography10.1016/j.aei.2019.101025 ↗
16. UAV imagery based potential safety hazard evaluation for high-speed railroad using Real-time instance segmentation10.1016/j.aei.2022.101819 ↗
17. Fine-grained damage detection of cement concrete pavement based on UAV remote sensing image segmentation and stitching10.1016/j.measurement.2023.113844 ↗
18. Vision-based navigation planning for autonomous post-earthquake inspection of reinforced concrete railway viaducts using unmanned aerial vehicles10.1016/j.autcon.2022.104214 ↗
19. UAV-based bridge geometric shape measurement using automatic bridge component detection and distributed multi-view reconstruction10.1016/j.autcon.2022.104376 ↗
20. Homography-based measurement of bridge vibration using UAV and DIC method10.1016/j.measurement.2020.108683 ↗
21. Automatic recognition of earth rock embankment leakage based on UAV passive infrared thermography and deep learning10.1016/j.isprsjprs.2022.07.009 ↗
22. High-resolution spatio-temporal characteristics of urban evapotranspiration measured by unmanned aerial vehicle and infrared remote sensing10.1016/j.buildenv.2022.109389 ↗
23. A retrieval method for land surface temperatures based on UAV broadband thermal infrared images via the three-dimensional look-up table10.1016/j.buildenv.2022.109793 ↗
24. The full-field displacement intelligent measurement of retaining structures using UAV and 3D reconstruction10.1016/j.measurement.2024.114311 ↗
25. Structural health monitoring and inspection of dams based on UAV photogrammetry with image 3D reconstruction10.1016/j.autcon.2021.103832 ↗
26. Improving completeness and accuracy of 3D point clouds by using deep learning for applications of digital twins to civil structures10.1016/j.aei.2023.102196 ↗
27. Methodology for performing bathymetric measurements of shallow waterbodies using an UAV, and their processing based on the SVR algorithm10.1016/j.measurement.2023.113720 ↗
28. Development of a real-time noise estimation model for construction sites10.1016/j.aei.2023.102133 ↗
29. Bridge coating inspection based on two-stage automatic method and collision-tolerant unmanned aerial system10.1016/j.autcon.2022.104685 ↗
30. Align to locate: Registering photogrammetric point clouds to BIM for robust indoor localization10.1016/j.buildenv.2021.108675 ↗
31. Mapping and modelling defect data from UAV captured images to BIM for building external wall inspection10.1016/j.autcon.2022.104284 ↗
32. Optimal camera focal length detection method for GPS-supported bundle adjustment in UAV photogrammetry10.1016/j.measurement.2024.114329 ↗
33. Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic-rich building information model10.1111/mice.12928 ↗
34. An automatic measurement system for the wall thickness of corrugated plate based on laser triangulation method10.1016/j.aei.2022.101814 ↗
35. Integration of high-precision UAV laser scanning and terrestrial scanning measurements for determining the shape of a water tower10.1016/j.measurement.2023.113178 ↗
36. Noncontact deflection measurement for bridge through a multi-UAVs system10.1111/mice.12771 ↗
37. 3D reconstruction and measurement of surface defects in prefabricated elements using point clouds10.1061/(ASCE)CP.1943-5487.0000920 ↗
38. Automatic inspection data collection of building surface based on BIM and UAV10.1016/j.autcon.2021.103881 ↗
39. Dynamic BIM-augmented UAV safety inspection for water diversion project10.1016/j.compind.2019.03.004 ↗
40. Error analysis of the 3D similarity coordinate transformation10.1007/s10291-016-0585-2 ↗
41. Enhancement of low-cost UAV-based photogrammetric point cloud using MMS point cloud and oblique images for 3D urban reconstruction10.1016/j.measurement.2024.114158 ↗
42. Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999, January 21–22). Bundle adjustment—A modern synthesis. Proceedings of the Vision Algorithms: Theory and Practice: International Workshop on Vision Algorithms, Corfu, Greece.10.1007/3-540-44480-7_21 ↗
43. Efficient transformation from Cartesian to geodetic coordinates10.1016/j.cageo.2019.104307 ↗
44. Kern, A., Bobbe, M., Khedar, Y., and Bestmann, U. (2020, January 1–4). OpenREALM: Real-time mapping for unmanned aerial vehicles. Proceedings of the 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece.10.1109/ICUAS48674.2020.9213960 ↗
45. Vision-based displacement measurement using an unmanned aerial vehicle10.1002/stc.3025 ↗
46. Bridge Deformation Measurement Using Unmanned Aerial Dual Camera and Learning-Based Tracking Method10.1155/2023/4752072 ↗
47. STF-YOLO: A small target detection algorithm for UAV remote sensing images based on improved SwinTransformer and class weighted classification decoupling head10.1016/j.measurement.2023.113936 ↗
48. A robust real-time method for identifying hydraulic tunnel structural defects using deep learning and computer vision10.1111/mice.12949 ↗
49. Jocher, G., Chaurasia, A., and Qiu, J. (2024, March 11). YOLO by Ultralytics. Available online: https://github.com/ultralytics/ultralytics.
50. An improved fire detection approach based on YOLO-v8 for smart cities10.1007/s00521-023-08809-1 ↗
51. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 18–24). A convnet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01167 ↗
52. Woo, S., Debnath, S., Hu, R., Chen, X., Liu, Z., Kweon, I.S., and Xie, S. (2023, January 17–24). Convnext v2: Co-designing and scaling convnets with masked autoencoders. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01548 ↗
53. Li, C., Zhou, A., and Yao, A. (2022). Omni-dimensional dynamic convolution. arXiv.
54. MS-IRTNet: Multistage information interaction network for RGB-T semantic segmentation10.1016/j.ins.2023.119442 ↗
55. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCVW54120.2021.00312 ↗
56. Concrete dam damage detection and localisation based on YOLOv5s-HSC and photogrammetric 3D reconstruction10.1016/j.autcon.2022.104555 ↗
57. Wang, G., Chen, Y., An, P., Hong, H., Hu, J., and Huang, T. (2023). UAV-YOLOv8: A small-object-detection model based on improved YOLOv8 for UAV aerial photography scenarios. Sensors, 23.10.3390/s23167190 ↗
58. High-through counting of Chinese cabbage trichomes based on deep learning and trinocular stereo microscope10.1016/j.compag.2023.108134 ↗
59. Tong, Z., Chen, Y., Xu, Z., and Yu, R. (2023). Wise-IoU: Bounding box regression loss with dynamic focusing mechanism. arXiv.
60. (2023, March 11). Agisoft Metashape. Available online: www.agisoft.com.
61. Widerperson: A diverse dataset for dense pedestrian detection in the wild10.1109/TMM.2019.2929005 ↗
62. Du, D., Zhu, P., Wen, L., Bian, X., Lin, H., Hu, Q., Peng, T., Zheng, J., Wang, X., and Zhang, Y. (2019, January 27–28). VisDrone-DET2019: The vision meets drone object detection in image challenge results. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea.
63. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
64. Real-time smart video surveillance to manage safety: A case study of a transport mega-project10.1016/j.aei.2020.101100 ↗
65. Field experimental verifications of 3D DDA and its applications to kinematic evolutions of rockfalls10.1016/j.ijrmms.2024.105687 ↗
66. High resolution bolt pre-load looseness monitoring using coda wave interferometry10.1177/14759217211063420 ↗
67. A new approach for estimating geocenter motion based on BDS-3 plane-specific orbit error correction model10.1007/s10291-023-01541-2 ↗
68. Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography10.1016/j.ndteint.2020.102341 ↗
69. He, Z., Wang, Y.H., and Zhang, J. (2023). Generative Structural Design Integrating BIM and Diffusion Model. arXiv.
70. A critical review of statistical model of dam monitoring data10.1016/j.jobe.2023.108106 ↗
71. Development of a moving vehicle identification framework using structural vibration response and deep learning algorithms10.1016/j.ymssp.2023.110667 ↗
72. Displacement behavior interpretation and prediction model of concrete gravity dams located in cold area10.1177/14759217221122368 ↗