journal article·2022-03-22Open access

An Operational Image-Based Digital Twin for Large-Scale Structures

Hans-Henrik Benzon, Xiao Chen, Lewis Belcher, Oscar Castro, Kim Branner, Jesper Smit

Applied Sciences· Volume 12· Issue 7

Abstract

This study presents a novel methodology to create an operational Digital Twin for large-scale structures based on drone inspection images. The Digital Twin is primarily used as a virtualized representation of the structure, which will be updated according to physical changes during the life cycle of the structure. The methodology is demonstrated on a wind turbine transition piece. A three-dimensional geometry reconstruction of a transition piece as manufactured is created using a large number (>500) of RGB images collected from a drone and/or several LiDAR scans. Comparing the reconstruction to the original design will locate and quantify geometric deviations and production tolerances. An artificial intelligence algorithm is used to detect and classify paint defects/damages from images. The detected and classified paint defects/damages are subsequently digitalized and mapped to the three-dimensional geometric reconstruction of the structure. These developed functionalities allow the Digital Twin of the structure to be updated with manufacturing-induced geometric deviations and paint defects/damages using inspection images at regular time intervals. The key enabling technologies to realize the Digital Twin are presented in this study. The proposed methodology can be used in different industrial sectors, such as the wind energy, oil, and gas industries, aerospace, the marine and transport sector, and other large infrastructures.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Surveying and Cultural Heritage · Digital Transformation in Industry · Augmented Reality Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Wind Energy, Technical University of Denmark, Frederiksborgvej 399, 4000 Roskilde, Denmark

Desupervised ApS, Njalsgade 76, 3, 2300 Copenhagen, Denmark

Quali Drone ApS, Mariagervej 3, 9560 Hadsund, Denmark

Funding

Danish Energy Technology Development and Demonstration Program (EUDP)

References (16)

Show source-provided references
1. European Commission (2021, December 01). Industrial Research and Innovation: Why the EU Supports Industrial Research and Innovation. Available online: https://ec.europa.eu/info/research-and-innovation/research-area/industrial-research-and-innovation_en.
2. A survey on Digital Twin: Definitions, characteristics, applications, and design implications10.1109/ACCESS.2019.2953499 ↗
3. Customer experience challenges: Bringing together digital, physical and social realms10.1108/JOSM-04-2018-0113 ↗
4. Jørgensen, B.H., Madsen, P.H., Giebel, G., Martí, I., and Thomsen, K. (2021). Towards more smart, efficient and reliable wind-turbine structures. DTU International Energy Report 2021: Perspectives on Wind Energy, DTU Wind Energy. Available online: https://backend.orbit.dtu.dk/ws/portalfiles/portal/264478705/Chapter_12_DTU_International_Energy_Report_2021.pdf.
5. FORCE Technology (2021, December 01). Autonomous Robot 3D Scans Wind Turbine Blades. Available online: https://forcetechnology.com/en/about-force-technology/news/2019/autonomous-robot-3d-scans-wind-turbine-blades.
6. Rashidi, M., Mohammadi, M., Sadeghlou Kivi, S., Abdolvand, M.M., Truong-Hong, L., and Samali, B.A. (2020). Decade of modern bridge monitoring using terrestrial laser scanning: Review and future directions. Remote Sens., 12.10.3390/rs12223796 ↗
7. Health Monitoring of Bridges Using RPAs10.1007/978-981-15-8079-6_20 ↗
8. Masoud, M., Vahid Mousavi, M.R., Yang Yu, L.K., and Samali, B. (2021). Quality evaluation of Digital Twins generated based on UAV photogrammetry and TLS: Bridge case study. Remote Sens., 13.10.3390/rs13173499 ↗
9. Szeliski, R. (2011). Computer Vision: Algorithms and Applications, Springer.10.1007/978-1-84882-935-0 ↗
10. Shihavuddin, A.S.M., Chen, X., Fedorov, V., Christensen, A.N., Riis, N.A.B., Branner, K., Dahl, A.B., and Paulsen, R.R. (2019). Wind Turbine Surface Damage Detection by Deep Learning Aided Drone Inspection Analysis. Energies, 12.10.20944/preprints201901.0281.v1 ↗
11. Jocher, G., Stoken, A., Chaurasia, A., Borovec, J., Xie, T., Kwon, Y., Michael, K., Changyu, L., and Fang, J. (2021). Ultralytics/yolov5: V4.0-nn.SiLU() Activations, Weights & Biases Logging, PyTorch Hub Integration (v4.0). Available online: https://github.com/ultralytics/yolov5.
12. Bentley Institute Inc (2021). ContextCapture: 4D Digital Context for Digital Twins, Bentley Institute Inc.. Available online: https://www.bentley.com/en/products/product-line/reality-modeling-software/contextcapture.
13. Jain, S., Kumar, B.L.S., and Shettigar, R. (2017, January 10–11). Comparative study on SIFT and SURF face feature descriptors. Proceedings of the 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT), Coimbatore, India.10.1109/ICICCT.2017.7975187 ↗
14. Comparison of Feature Detection and Matching Approaches: SIFT and SURF
15. (2021, December 01). Meshlab. Available online: https://www.meshlab.net/#description.
16. Hata, K., and Savarese, S. (2021). Notes from Stanford Course CS231A: Computer Vision, From 3D Reconstruction to Recognition, Stanford University. Available online: https://web.stanford.edu/class/cs231a/course_notes.html.