journal article·2025-05-22Open access

Structural Vibration Detection Using the Optimized Optical Flow Technique and UAV After Removing UAV’s Motions

Xin Bai, Rongliang Xie, Ning Liu, Zi Zhang

Applied Sciences· Volume 15· Issue 11

Abstract

Traditional structural damage detection relies on multi-sensor arrays (e.g., total stations, accelerometers, and GNSS). However, these sensors have some inherent limitations such as high cost, limited accuracy, and environmental sensitivity. Advances in computer vision technology have driven the research on vision-based structural vibration analysis and damage identification. In this study, an optimized Lucas–Kanade optical flow algorithm is proposed, and it integrates feature point trajectory analysis with an adaptive thresholding mechanism, and improves the accuracy of the measurements through an innovative error vector filtering strategy. Comprehensive experimental validation demonstrates the performance of the algorithm in a variety of test scenarios. The method tracked MTS vibrations with 97% accuracy in a laboratory environment, and the robustness of the environment was confirmed by successful noise reduction using a dedicated noise-suppression algorithm under camera-induced interference conditions. UAV field tests show that it effectively compensates for UAV-induced motion artifacts and maintains over 90% measurement accuracy in both indoor and outdoor environments. Comparative analyses show that the proposed UAV-based method has significantly improved accuracy compared to the traditional optical flow method, providing a highly robust visual monitoring solution for structural durability assessment in complex environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Measurement and Detection Methods · Advanced Vision and Imaging · Image and Video Stabilization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Architectural Cold Climate Energy Management, Ministry of Education, Jilin Jianzhu University, Changchun 130118, China

School of Civil Engineering, Jilin Jianzhu University, Changchun 130118, China

Funding

Key Laboratory of Architectural Cold Climate Energy Management, Ministry of Education, Jilin Jianzhu University · Department of Housing and Urban Rural Development of Jilin Province, China · The Eighth Batch of Jilin Province’s Youth Science and Technology Talent Support Program · International Science and Technology Cooperation Project of the Jilin Provincial Department of Science and Technology

References (33)

Show source-provided references
1. Detection and Location of Steel Structure Surface Cracks Based on Unmanned Aerial Vehicle Images10.1016/j.jobe.2022.104098 ↗
2. Image-based assessment of seismic damage in RC exterior beam-column joints10.1016/j.jobe.2024.110971 ↗
3. Luo, Y., Chen, J., Xi, W., Zhao, P., Li, J., Qiao, X., and Liu, Q. (2017). Application of a Total Station with RDM to Monitor Tunnel Displacement. J. Perform. Constr. Facil., 04017030.10.1061/(ASCE)CF.1943-5509.0001027 ↗
4. Component extraction method for GNSS displacement signals of long-span bridges10.1007/s13349-022-00661-6 ↗
5. Dai, W., Li, X., Yu, W., Qu, X., and Ding, X. (2024). Multi-Antenna Global Navigation Satellite System/Inertial Measurement Unit Tight Integration for Measuring Displacement and Vibration in Structural Health Monitoring. Remote Sens., 16.10.3390/rs16061072 ↗
6. Klun, M., Zupan, D., Lopatič, J., and Kryžanowski, A. (2019). On the Application of Laser Vibrometry to Perform Structural Health Monitoring in Non-Stationary Conditions of a Hydropower Dam. Sensors, 19.10.3390/s19173811 ↗
7. Towards airborne laser Doppler vibrometry for structural health monitoring of large and curved structures10.1784/insi.2021.63.5.280 ↗
8. Identification of damages in a concrete beam: A modal analysis based method10.1088/1742-6596/2698/1/012014 ↗
9. Khun, N.N., Robinson, T., and Yu, T. (2022). Investigating the effect of mass redistribution on damping of building models using a shake table and a laser Doppler vibrometer. Nondestructive Characterization and Monitoring of Advanced Materials, Aerospace, Civil Infrastructure, and Transportation XVI, SPIE.10.1117/12.2612706 ↗
10. Ensemble learning-based structural health monitoring of a bridge using an interferometric radar system10.1007/s13349-024-00789-7 ↗
11. Morris, I., Abdel-Jaber, H., and Glisic, B. (2019). Quantitative Attribute Analyses with Ground Penetrating Radar for Infrastructure Assessments and Structural Health Monitoring. Sensors, 19.10.3390/s19071637 ↗
12. Development of video analytics with template matching methods for using camera as sensor and application to highway bridge structural health monitoring10.1007/s13349-020-00392-6 ↗
13. Single-camera single-axis vision method applied to measure vibrations10.1016/j.jsv.2019.115012 ↗
14. Mastrodicasa, D., Ferreira, C., Lorenzo, E.D., Peeters, B., Vaz, M.A.P., and Guillaume, P. (2022, January 7–10). DIC using low speed cameras on a scaled wind turbine blade. Proceedings of the 40th Conference And Exposition On Structural Dynamics (IMAC), Orlando, Fl, USA.10.1007/978-3-031-04098-6_2 ↗
15. Wang, Y., Surahman, R., and Nagai, K. (2023). Shear cracking behavior of pre-damaged PVA-aggregate mixed ECC beams: Direct observation using DIC. Eng. Fract. Mech., 109757.10.1016/j.engfracmech.2023.109757 ↗
16. Improved image-based, full-field structural displacement measurement using template matching and camera calibration methods10.1016/j.measurement.2023.112650 ↗
17. Image-Based Displacement Monitoring When Considering Translational and Rotational Camera Motions10.1007/s40999-021-00653-5 ↗
18. Zhao, C., Bai, B., Liang, L., Cheng, Z., Chen, X., Li, W., and Zhao, X. (2023). Design and Verification of a Novel Structural Strain Measuring Method Based on Template Matching and Microscopic Vision. Buildings, 13.10.3390/buildings13092395 ↗
19. Integrated video analysis framework for vision-based comparison study on structural displacement and tilt measurements10.1061/(ASCE)ST.1943-541X.0003104 ↗
20. Applications of optical flow methods and computer vision in structural health monitoring for enhanced modal identification10.1016/j.istruc.2024.107414 ↗
21. Extracting high-precision full-field displacement from videos via pixel matching and optical flow10.1016/j.jsv.2021.116142 ↗
22. Structural displacement monitoring using deep learning-based full field optical flow methods10.1080/15732479.2019.1650078 ↗
23. Zheng, J., Wang, Y., Pan, F., Zhou, Z., Li, Q., and Xu, C. (2021, January 9–11). Research on Dynamic Structure Displacement Monitoring Based on Feature Optical Flow Method. Proceedings of the 2021 6th International Conference on Minerals Source, Geotechnology and Civil Engineering MSGCE, Guangzhou, China. Available online: https://iopscience.iop.org/article/10.1088/1755-1315/768/1/012127/pdf.
24. Al-Qudah, S., and Yang, M. (2023). Large Displacement Detection Using Improved Lucas–Kanade Optical Flow. Sensors, 23.10.3390/s23063152 ↗
25. Assessment and monitoring of bridges using various camera placements and structural analysis10.1007/s13349-023-00720-6 ↗
26. Ghyabi, M., and Lattanzi, D. (2025). Computer vision-based video signal fusion using deep learning architectures. J. Civ. Struct. Health Monit., 1–16.10.1007/s13349-024-00891-w ↗
27. Xin, J., Cao, X., Xiao, H., Liu, T., Liu, R., and Xin, Y. (2023). Infrared Small Target Detection Based on Multiscale Kurtosis Map Fusion and Optical Flow Method. Sensors, 23.10.3390/s23031660 ↗
28. Computer vision-based displacement measurement using spatio-temporal context and optical flow considering illumination variation10.1007/s13349-024-00812-x ↗
29. Nie, G.-Y., Bodda, S.S., Sandhu, H.K., Han, K., and Gupta, A. (2022). Computer-Vision-Based Vibration Tracking Using a Digital Camera: A Sparse-Optical-Flow-Based Target Tracking Method. Sensors, 22.10.3390/s22186869 ↗
30. Choi, H., Kang, B., and Kim, D. (2022). Moving Object Tracking Based on Sparse Optical Flow with Moving Window and Target Estimator. Sensors, 22.10.3390/s22082878 ↗
31. Zhao, W., Li, W., Fan, B., and Du, Y. (2022). Dynamic Characteristic Monitoring of Wind Turbine Structure Using Smartphone and Optical Flow Method. Buildings, 12.10.3390/buildings12112021 ↗
32. Chen, T., and Zhou, Z. (2020). An Improved Vision Method for Robust Monitoring of Multi-Point Dynamic Displacements with Smartphones in an Interference Environment. Sensors, 20.10.3390/s20205929 ↗
33. UAV based accurate displacement monitoring through automatic filtering out its camera’s translations and rotations10.1016/j.jobe.2021.102992 ↗