3D-Visualization of Ultrasonic NDT Data Using Mixed Reality
Source abstract
Abstract
Abstract In this paper we present an approach where ultrasonic testing data (UT) is linked with its spatial coordinates and direction vector to the examined specimen. Doing so, the processed nondestructive testing (NDT) results can be visualized directly on the sample in real-time using augmented or virtual reality. To enable the link between NDT data and physical object, a 3D-tracking system is used. Spatial coordinates and NDT sensor data are stored together. For visualization, texture mapping was applied on a 3D model. The testing process consists of data recording, processing and visualization. All three steps are performed in real-time. The data is recorded by an UT-USB interface, processed on a PC workstation and displayed using a Mixed-Reality-system (MR). Our system allows real-time 3D visualization of ultrasonic NDT data, which is directly drawn into the virtual representation. Therefore, the possibility arises to assist the operator during the manual testing process. This new approach results in a much more intuitive testing process and a data set optimally prepared to be saved in a digital twin environment. The size of the samples is not limited to a laboratory scale, but also works for larger objects, e.g. a helicopter fuselage. Our approach is inspired by concepts of NDE 4.0 to create a new kind of smart inspection systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Digital Transformation in Industry · Augmented Reality Applications · Engineering Education and Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (31)
Show source-provided references
1. Ewert, U., Redmer, B., Kreutbruck, M., et al.: Quantitative tomographic non-destructive testing for flaw size measurement and life time prediction. In: European Conference on Fracture (ECF) (2010)
2. Vrana, J., Schörner, K., Mooshofer, H., et al.: Ultrasonic computed tomography: pushing the boundaries of the ultrasonic inspection of forgings. Steel Res. Int. 89, 1700448 (2018). https://doi.org/10.1002/srin.20170044810.1002/srin.201700448 ↗
3. Valeske, B., Osman, A., Römer, F., et al.: Next generation NDE sensor systems as IIoT elements of industry 4.0. Res. Nondestr. Eval. 31, 340–369 (2020). https://doi.org/10.1080/09349847.2020.184186210.1080/09349847.2020.1841862 ↗
4. Vrana J, Singh R (2021) NDE 4.0-A Design Thinking Perspective. J Nondestr Eval 40:8. https://doi.org/10.1007/s10921-020-00735-910.1007/s10921-020-00735-9 ↗
5. Vrana, J.: The core of the fourth revolutions: industrial internet of things, digital twin, and cyber-physical loops. J Nondestruct Eval (2021). https://doi.org/10.1007/s10921-021-00777-710.1007/s10921-021-00777-7 ↗
6. Kuhn, T.: Digitaler zwilling. Informatik Spektrum 40, 440–444 (2017). https://doi.org/10.1007/s00287-017-1061-210.1007/s00287-017-1061-2 ↗
7. Ramm, S., Wache, H., Dinter, B., et al.: Der kollaborative digitale zwilling. Zeitschrift für wirtschaftlichen Fabrikbetrieb 115, 94–96 (2020). https://doi.org/10.3139/104.11231910.3139/104.112319 ↗
8. Dini, G., Mura, M.D.: Application of augmented reality techniques in through-life engineering services. Procedia CIRP 38, 14–23 (2015). https://doi.org/10.1016/j.procir.2015.07.04410.1016/j.procir.2015.07.044 ↗
9. de Pace, F., Manuri, F., Sanna, A.: Augmented reality in industry 40. Am. J. Comput. Sci. Inform. Technol. 6, 17 (2018)
10. Casari, F., Navab, N., Hruby, L., et al.: Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art. Curr Rev Musculoskelet Med 14, 192–203 (2021). https://doi.org/10.1007/s12178-021-09699-310.1007/s12178-021-09699-3 ↗
11. García-Vázquez, V., von Haxthausen, F., Jäckle, S., et al.: Navigation and visualisation with HoloLens in endovascular aortic repair. Innov Surg Sci 3, 167–177 (2018). https://doi.org/10.1515/iss-2018-200110.1515/iss-2018-2001 ↗
12. Schickert, M., Koch, C., Bonitz, F.: Prospects for integrating augmented reality visualization of nondestructive testing results into model-based infrastructure inspection. In: NDE/NDT for Highways & Bridges: SMT (2018)
13. Meyer, J., Rehbein, J., de Freese, J., et al.: Visualisation of ultrasonic testing data using augmented reality. In: 7th International Symposium on NDT in Aerospace (2015)
14. Deppe R, Nemitz O, Herder J (2018) Augmented reality for supporting manual non-destructive ultrasonic testing of metal pipes and plates. Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR:45–52. https://doi.org/10.2370/978384406215110.2370/9783844062151 ↗
15. Fraunhofer IZFP: 3D-SmartInspect: Intelligente Prüfüberwachung und -dokumentation durch optisches Trackingsystem für Ultraschall- und Wirbelstromprüfung (2017). https://www.izfp.fraunhofer.de/content/dam/izfp/de/documents/aktuelles/2017/3D-SmartInspect-de.pdf. Accessed 22 Sep 2021
16. Prado, G., Silva, P., Simomura, F., et al.: SHM with augmented reality for aircraft maintenance. In: 31st Congress of the International Council of the Aeronautical Sciences (2018)
17. Beck, T.: Blender 2.7: Das umfassende Handbuch, 2., aktualisierte und erweiterte Auflage. Rheinwerk Design. Rheinwerk Verlag, Bonn (2018)
18. Unity Technologies: Unity Pro (2021). https://store.unity.com/de/products/unity-pro. Accessed 16 Sep 2021
19. HTC Corporation: VIVE Pro (2021). https://www.vive.com/de/product/vive-pro/. Accessed 16 Sep 2021
20. Valve Corporation: SteamVR (2021). https://store.steampowered.com/app/250820/SteamVR/. Accessed 16 Sep 2021
21. Advanced Realtime Tracking GmbH & Co. KG: ARTTRACK5 (2021). https://ar-tracking.com/en/product-program/arttrack5. Accessed 16 Sep 2021
22. Varjo HQ (2021). https://varjo.com. Accessed 16 Sep 2021
23. Fraunhofer IKTS: PCUS pro Single (2016). Accessed 13 Sep 2021
24. Unity Technologies: Unity - Scripting API: Physics.Raycast (2022). https://docs.unity3d.com/ScriptReference/Physics.Raycast.html. Accessed 09 Feb 2022
25. Shimodaira, H.: Gaussians, University of Edinburgh (2020)
26. Advanced Realtime Tracking GmbH & Co. KG: Accuracy of an ART Tracking System (2020)
27. Holtmannspötter, J., von Czarnecki, J., Feucht, F., et al.: On the fabrication and automation of reliable bonded composite repairs. J. Adhes. 91, 39–70 (2015). https://doi.org/10.1080/00218464.2014.89621110.1080/00218464.2014.896211 ↗
28. Advanced Realtime Tracking GmbH & Co. KG: Products in connection with the software CAPTA (2021). https://www.ar-tracking.com/en/product-program/products-connection-software-capta. Accessed 22 Sep 2021
29. Vrana, J.: Determination of an optimal examination grid for the automated ultrasonic inspection of heavy rotor forgings. In: 11th European Conference on Non-Destructive Testing (ECNDT 2014)
30. Meyendorf, N., Schallert, R., Pal, S., et al.: Using remote NDE, including external experts in the inspection process, to enhance reliability and address todays NDE challenges. In: 7th European–American Workshop on Reliability of NDE (2017)
31. Westerkamp, C., Behrens, R., Kolesnikow, A., et al.: Online maintenance assistance (OMA)—remote control of service and lab experiments. In: International Conference on Remote Engineering and Virtual Instrumentation (REV), pp. 353–356 (2014)10.1109/REV.2014.6784188 ↗