A State-of-the-Art Review of Non-Destructive Testing Image Fusion and Critical Insights on the Inspection of Aerospace Composites towards Sustainable Maintenance Repair Operations
Source abstract
Abstract
Non-destructive testing (NDT) of aerospace structures has gained significant interest, given its non-destructive and economic inspection nature enabling future sustainable aerospace maintenance repair operations (MROs). NDT has been applied to many different domains, and there is a number of such methods having their individual sensor technology characteristics, working principles, pros and cons. Increasingly, NDT approaches have been investigated alongside the use of data fusion with the aim of combining sensing information for improved inspection performance and more informative structural health condition outcomes for the relevant structure. Within this context, image fusion has been a particular focus. This review paper aims to provide a comprehensive survey of the recent progress and development trends in NDT-based image fusion. A particular aspect included in this work is providing critical insights on the reliable inspection of aerospace composites, given the weight-saving potential and superior mechanical properties of composites for use in aerospace structures and support for airworthiness. As the integration of NDT approaches for composite materials is rather limited in the current literature, some examples from non-composite materials are also presented as a means of providing insights into the fusion potential.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Ultrasonics and Acoustic Wave Propagation · Non-Destructive Testing Techniques · Thermography and Photoacoustic Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Aerospace, Transportation and Manufacturing, Cranfield University, Cranfield MK43 0AL, UK
References (100+)
Show source-provided references
1. Maintenance, repair and overhaul (MRO) fundamentals and strategies: An aeronautical industry overview
2. Sahay, A. (2012). Leveraging Information Technology for Optimal Aircraft Maintenance, Repair and Overhaul (MRO), Woodhead Publishing.10.1533/9780857091437 ↗
3. Anon (2022, December 09). Inmarsat Report: The Aircraft-Connectivity and Consciousness. Available online: https://www.inmarsat.com/en/insights/aviation/2022/future-aviation-connectivity.html.
4. Modeling of an aircraft structural health monitoring sensor network for operational impact assessment10.1177/14759217211048149 ↗
5. Rapid thermal non-destructive testing of aircraft components10.1016/S1359-8368(00)00005-6 ↗
6. Successes and challenges in non-destructive testing of aircraft composite structures10.1016/j.cja.2019.09.017 ↗
7. (2022). Air Industry Faces Summer Chaos. Aerosp.-R. Aeronaut. Soc., 10–11.
8. Ullmann, T., Schmidt, T., Hoffmann, S., and Jemmali, R. (2010, January 5–7). In-line quality assurance for the manufacturing of carbon fiber reinforced aircraft structures. Proceedings of the 2nd International Symposium on NDT in Aerospace 2010, Williamsburg, VA, USA.
9. Fibre reinforced composites in aircraft construction10.1016/j.paerosci.2005.02.004 ↗
10. Advanced design for lightweight structures: Review and prospects10.1016/j.paerosci.2014.03.003 ↗
11. Giurgiutiu, V. (2020). Polymer Composites in the Aerospace Industry, Elsevier.
12. A robust Bayesian methodology for damage localization in plate-like structures using ultrasonic guided-waves10.1016/j.ymssp.2018.12.021 ↗
13. Brethee, K.F., Uwayed, A.N., and Alden Qwam, A.Y. (2023). A novel index for vibration-based damage detection technique in laminated composite plates under forced vibrations: Experimental study. Struct. Health Monit., 14759217221145622.10.1177/14759217221145622 ↗
14. A global-local damage localization and quantification approach in composite structures using ultrasonic guided waves and active infrared thermography10.1088/1361-665X/acb578 ↗
15. Ni, T., Guo, B., and Yang, C. (2021, January 18–19). Design of Ultrasonic Testing System for Defects of Composite Material Bonding Structure Based on Deep Learning Technology. Proceedings of the 2020 International Conference on Virtual Reality and Intelligent Systems (ICVRIS), Zhangjiajie, China.10.1109/ICVRIS51417.2020.00068 ↗
16. Review of Non-destructive Testing (NDT) Techniques and their Applicability to Thick Walled Composites10.1016/j.procir.2015.07.043 ↗
17. Heslehurst, R.B. (2014). Defects and Damage in Composite Materials and Structures, CRC Press.10.1201/b16765 ↗
18. Thermal (IR) and other NDT techniques for improved material inspection10.1007/s10921-015-0331-7 ↗
19. Yu, Y., Zhang, R., Lu, L., and Yang, Y. (2021). The bimodal neutron and x-ray imaging driven by a single electron linear accelerator. Appl. Sci., 11.10.21203/rs.3.rs-511167/v1 ↗
20. Nondestructive damage evaluation of composites based on terahertz and X-ray image fusion10.1016/j.ndteint.2022.102616 ↗
21. Enhanced damage measurement in a metal specimen through the image fusion of tone-burst vibro-acoustography and pulse-echo ultrasound data
22. Mohammadkhani, R., Zanotti Fragonara, L., Padiyar M, J., Petrunin, I., Raposo, J., Tsourdos, A., and Gray, I. (2020). Improving depth resolution of ultrasonic phased array imaging to inspect aerospace composite structures. Sensors, 20.10.3390/s20020559 ↗
23. Automatic reconstruction of irregular shape defects in pulsed thermography using deep learning neural network10.1007/s00521-022-07622-6 ↗
24. Diogo, A.R., Moreira, B., Gouveia, C.A.J., and Tavares, J.M.R.S. (2022). A Review of Signal Processing Techniques for Ultrasonic Guided Wave Testing. Metals, 12.10.3390/met12060936 ↗
25. E. Farag, H., Toyserkani, E., and Khamesee, M.B. (2022). Non-Destructive Testing Using Eddy Current Sensors for Defect Detection in Additively Manufactured Titanium and Stainless-Steel Parts. Sensors, 22.10.3390/s22145440 ↗
26. Low-velocity impact damage detection and characterization in composite sandwich panels using infrared thermography10.1016/j.compstruct.2021.114008 ↗
27. Avdelidis, N., Gan, T.H., Ibarra-Castanedo, C., and Maldague, X. (2011, January 26–28). Infrared thermography as a nondestructive tool for materials characterisation and assessment. Proceedings of the Thermosense: Thermal Infrared Applications XXXIII, Orlando, FL, USA.10.1117/12.887403 ↗
28. Advances in applications of Non-Destructive Testing (NDT): A review
29. Non-destructive testing—current capabilities and future directions
30. Damage classification in reinforced concrete beam by acoustic emission signal analysis10.1016/j.conbuildmat.2013.03.095 ↗
31. Sounds and acoustic emission-based early fault diagnosis of induction motor: A review study10.1177/1687814021996915 ↗
32. Petrou, M.M., and Petrou, C. (2010). Image Processing: The Fundamentals, John Wiley & Sons, Ltd.. Chapter 1.10.1002/9781119994398 ↗
33. Detection of surface defects and subsurface defects of polished optics with multisensor image fusion10.1186/s43074-022-00051-7 ↗
34. Omar, Z., and Stathaki, T. (2014, January 27–29). Image fusion: An overview. Proceedings of the 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, Langkawi, Malaysia.10.1109/ISMS.2014.58 ↗
35. Raol, J.R. (2009). Multi-Sensor Data Fusion with MATLAB, CRC Press, Inc.. [1st ed.].10.1201/9781439800058 ↗
36. Advances, limitations and prospects of nondestructive testing and evaluation of thick composites and sandwich structures: A state-of-the-art review10.1016/j.compstruct.2020.112951 ↗
37. Image fusion for infrared thermography and inspection of pressure vessel10.1115/1.3066801 ↗
38. Medical image registration10.1088/0031-9155/46/3/201 ↗
39. Medical image registration: A review10.1080/10255842.2012.670855 ↗
40. A comprehensive review on remote sensing image registration10.1080/01431161.2021.1906985 ↗
41. Deep learning in medical image registration: A review10.1088/1361-6560/ab843e ↗
42. A survey on region based image fusion methods10.1016/j.inffus.2018.07.010 ↗
43. Combining Simulated and Experimental Data to Simulate Ultrasonic Array Data From Defects in Materials With High Structural Noise10.1109/TUFFC.2016.2614492 ↗
44. Gong, S., Liu, C., Ji, Y., Zhong, B., Li, Y., and Dong, H. (2019). Advanced Image and Video Processing Using MATLAB, Springer International Publishing.10.1007/978-3-319-77223-3 ↗
45. Application of image fusion for the IR images in frequency modulated thermal wave imaging for Non Destructive Testing (NDT)10.1016/j.matpr.2017.11.116 ↗
46. Application of Pseudo-color Image Feature-Level Fusion in Nondestructive Testing of Wire Ropes10.1007/s11668-020-00958-y ↗
47. Heideklang, R., and Shokouhi, P. (2016). Decision-level fusion of spatially scattered multi-modal data for nondestructive inspection of surface defects. Sensors, 16.10.3390/s16010105 ↗
48. Evaluation of radar and complementary echo methods for NDT of concrete elements10.1007/s10921-008-0030-8 ↗
49. Fusion of multi-sensory NDT data for reliable detection of surface cracks: Signal-level vs. decision-level10.1063/1.4940634 ↗
50. Multi-energy image stack fusion in computed tomography
51. Toolbox with nondestructive testing methods for condition assessment of railway bridges10.1177/0361198106194300109 ↗
52. Transport Infrastructure Monitoring by InSAR and GPR Data Fusion10.1007/s10712-019-09563-7 ↗
53. Nondestructive Testing of Wire Ropes Based on Image Fusion of Leakage Flux and Visible Light10.1007/s11668-019-00634-w ↗
54. Elshafiey, I., Algarni, A., and Alkanhal, M.A. (2011). Image Fusion, IntechOpen.
55. Metwalli, M.R., Nasr, A.H., Farag Allah, O.S., and El-Rabaie, S. (2009, January 14–16). Image fusion based on principal component analysis and high-pass filter. Proceedings of the 2009 International Conference on Computer Engineering and Systems, ICCES’09, Cairo, Egypt.10.1109/ICCES.2009.5383308 ↗
56. Jolliffe, I. (2002). Principal Component Analysis, Springer.
57. An Overview of Principal Component Analysis
58. A review of principal component analysis algorithm for dimensionality reduction
59. Báscones, D., González, C., and Mozos, D. (2018). Hyperspectral image compression using vector quantization, PCA and JPEG2000. Remote Sens., 10.10.3390/rs10060907 ↗
60. Feature extraction by PCA and diagnosis of breast tumors using SVM with DE-based parameter tuning10.1007/s13042-017-0741-1 ↗
61. Detection and quantification of artificial delaminations in CFRP composites using ultrasonic thermography10.1016/j.infrared.2023.104579 ↗
62. Comparative study of active thermography techniques for the nondestructive evaluation of honeycomb structures10.1080/09349840802366617 ↗
63. Laser ultrasonics and machine learning for automatic defect detection in metallic components10.1016/j.ndteint.2022.102752 ↗
64. Comparative analysis on thermal non-destructive testing imagery applying Candid Covariance-Free Incremental Principal Component Thermography (CCIPCT)10.1016/j.infrared.2017.06.008 ↗
65. Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures10.1016/S0263-8223(02)00161-7 ↗
66. Non-destructive testing and evaluation of materials using active thermography and enhancement of signal to noise ratio through data fusion10.1016/j.infrared.2018.08.027 ↗
67. Multi-frequency Fused Lock-in Thermography in Detecting Defects at Different Depths10.1007/s10921-022-00889-8 ↗
68. Local sparseness and image fusion for defect inspection in eddy current pulsed thermography10.1109/JSEN.2018.2882131 ↗
69. Principal component analysis-based image fusion routine with application to automotive stamping split detection10.1080/09349847.2011.553348 ↗
70. Thermographic Inspection of CLP Defects on the Subsurface Based on Binary Image10.1007/s12541-021-00616-9 ↗
71. Proakis, J.G. (1996). Digital Signal Processing Principles, Algorithms, and Applications, Prentice-Hall, Inc.. [3rd ed.].
72. Fourier method for 3-dimensional data fusion of X-ray Computed Tomography and ultrasound10.1016/j.ndteint.2021.102600 ↗
73. Wavelet-based image fusion and quality assessment
74. Zhou, Y., Yu, L., Zhi, C., Huang, C., Wang, S., Zhu, M., Ke, Z., Gao, Z., Zhang, Y., and Fu, S. (2022). A Survey of Multi-Focus Image Fusion Methods. Appl. Sci., 12.10.3390/app12126281 ↗
75. Fusion Algorithms for Images Based on Principal Component Analysis and Discrete Wavelet Transform
76. Development of image fusion methodology using discrete wavelet transform for eddy current images10.1016/j.ndteint.2012.06.006 ↗
77. Image fusion of ultrasonic and thermographic inspection of carbon/epoxy patches bonded to an aluminum plate10.1016/j.ndteint.2017.04.004 ↗
78. Zhang, X.W., Liang, R.Y., and Lv, Y.Y. (2009, January 11–13). Research on multi-sensor information fusion for the detection of surface defects in copper strip. Proceedings of the 2009 International Conference on Computational Intelligence and Software Engineering, CiSE 2009, Wuhan, China.10.1109/CISE.2009.5365587 ↗
79. Muduli, P.R., and Pati, U.C. (2013, January 4–6). A novel technique for wall crack detection using image fusion. Proceedings of the 2013 International Conference on Computer Communication and Informatics, ICCCI 2013, Coimbatore, India.10.1109/ICCCI.2013.6466288 ↗
80. A pipeline for enhanced multimodal 2D imaging of concrete structures10.1617/s11527-021-01803-w ↗
81. Method for detecting damage in carbon-fibre reinforced plastic-steel structures based on eddy current pulsed thermography10.1080/10589759.2016.1254213 ↗
82. Experimenting with pixel-level NDT data fusion techniques10.1109/19.872934 ↗
83. Deng, W., Matuszewski, B., Shark, L., Smith, J., and Cavaccini, G. (September, January 30). Multi-modality NDT image fusion and its mapping on curved 3D CAD surface. Proceedings of the 16th World Conference on NDT, Montreal, QC, Canada.
84. Multi-sensor image fusion at signal level for improved near-surface crack detection10.1016/j.ndteint.2014.12.008 ↗
85. Time Segmented Image Fusion Based Multi-Depth Defects Imaging Method in Composites With Pulsed Terahertz10.1109/ACCESS.2020.3019319 ↗
86. State-of-the-art in artificial neural network applications: A survey10.1016/j.heliyon.2018.e00938 ↗
87. Millidere, M., Gomec, F.S., Kurt, H.B., and Akgul, F. (2021, January 2–6). Multi-Fidelity Aerodynamic Dataset Generation of a Fighter Aircraft with a Deep Neural-Genetic Network. Proceedings of the AIAA AVIATION 2021 FORUM, Virtual.10.2514/6.2021-3007 ↗
88. Gurney, K. (1997). An Introduction to Neural Networks, Taylor & Francis, Inc.10.4324/9780203451519 ↗
89. Shin, H., Rüttgers, M., and Lee, S. (2022). Neural Networks for Improving Wind Power Efficiency: A Review. Fluids, 7.10.3390/fluids7120367 ↗
90. Cormerais, R., Duclos, A., Wasselynck, G., Berthiau, G., and Longo, R. (2021). A data fusion method for non-destructive testing by means of artificial neural networks. Sensors, 21.10.3390/s21082598 ↗
91. Hu, J., Zhang, H., Sfarra, S., Perilli, S., Sergi, C., Sarasini, F., and Maldague, X. (2021). Multi-Excitation Infrared Fusion for Impact Evaluation of Aluminium-BFRP/GFRP Hybrid Composites. Sensors, 21.10.3390/s21175961 ↗
92. Pereira, F., Burges, C., Bottou, L., and Weinberger, K. (2012). Advances in Neural Information Processing Systems, Curran Associates, Inc.
93. Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, Springer International Publishing.10.1007/978-3-319-24553-9 ↗
94. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
95. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
96. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
97. Quantitative Nondestructive Testing of Wire Ropes Based on Features Fusion of Magnetic Image and Infrared Image10.1155/2019/2041401 ↗
98. Jing, L., Wang, T., Zhao, M., and Wang, P. (2017). An adaptive multi-sensor data fusion method based on deep convolutional neural networks for fault diagnosis of planetary gearbox. Sensors, 17.10.3390/s17020414 ↗
99. Novel infrared-terahertz fusion 3D non-invasive imaging of plant fibre-reinforced polymer composites10.1016/j.compscitech.2022.109526 ↗
100. Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces10.1016/j.ymssp.2022.109109 ↗