Autonomous damage recognition in visual inspection of laminated composite structures using deep learning
Source abstract
Abstract
This study proposes the exploitation of deep learning for quantitative assessment of visual detectability of different types of in-service damage in laminated composite structures such as aircraft and wind turbine blades. A comprehensive image-based data set is collected from the literature containing common microscale damage mechanisms (matrix cracking and fibre breakage) and macroscale damage mechanisms (impact and erosion). Then, automated classification of the damage type and severity was done by pre-trained version of AlexNet that is a stable convolutional neural network for image processing. Pre-trained ResNet-50 and 5 other user-defined convolutional neural networks were also used to evaluate the performance of AlexNet. The results demonstrated that employing AlexNet network, using the relatively small image dataset, provided the highest accuracy level (87%–96%) for identifying the damage severity and types in a reasonable computational time. The generated knowledge and the collected image data in this paper will facilitate further research and development in the field of autonomous visual inspection of composite structures with the potential to significantly reduce the costs, health & safety risks and downtime associated with integrity assessment.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Structural Health Monitoring Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (78)
Show source-provided references
1. Carbon fibre composites poised for dramatic growth10.1016/S0034-3617(09)70148-1 ↗
2. Fatigue behaviour of pseudo-ductile unidirectional thin-ply carbon/epoxy-glass/epoxy hybrid composites10.1016/j.compstruct.2019.110996 ↗
3. Fatigue behavior and lifetime distribution of impact-damaged carbon fiber/toughened epoxy composites under compressive loading10.1080/09243046.2013.768324 ↗
4. Compression behavior of laminated composites subjected to damage induced by low velocity impact and drilling10.1016/j.compositesb.2013.09.017 ↗
5. The impact resistance of composite materials - a review10.1016/0010-4361(91)90549-V ↗
6. Compression after impact of thin composite laminates10.1016/j.compscitech.2005.04.009 ↗
7. Talreja R, Singh CV. Damage and failure of composite materials; 2012.10.1017/CBO9781139016063 ↗
8. Investigating polyethersulfone interleaved Glass/Carbon hybrid composite under impact and its comparison with GLARE10.1016/j.compstruct.2019.111268 ↗
9. Experimental–numerical study on minimizing impact induced damage in laminated composites under low-velocity impact10.1177/0731684417737166 ↗
10. A comparative study on glass and carbon fibre reinforced laminated composites in scaled quasi-static indentation tests10.1016/j.compstruct.2020.112327 ↗
11. Heslehurst RB. Defects and damage in composite materials and structures; 2014.10.1201/b16765 ↗
12. Nondestructive testing of damage in aerospace composites
13. 3D monitoring of delamination growth in a wind turbine blade composite using optical coherence tomography
14. A brief review of the application and problems in ultrasonic fatigue testing10.1016/j.aasri.2012.09.024 ↗
15. Investigation of the mixed-mode delamination in polymer-matrix composites using acoustic emission technique10.1177/0731684414544391 ↗
16. Thermographic inspection of composites10.1016/S0034-3617(14)70183-3 ↗
17. Infrared thermographic evaluation of large composite grid parts subjected to axial loading10.1016/j.polymertesting.2014.10.010 ↗
18. X-ray radiography and micro-computed tomography examination of damage characteristics in stitched composites subjected to impact loading10.1016/j.compositesb.2011.01.011 ↗
19. Acousto-ultrasonics-based fatigue damage characterization: linear versus nonlinear signal features10.1016/j.ymssp.2013.10.017 ↗
20. Bennett LGI, Lewis WJ, Hungler PC. The development of neutron radiography and tomography on a SLOWPOKE-2 reactor. 2013. doi: 10.1016/j.phpro.2013.03.003.10.1016/j.phpro.2013.03.003 ↗
21. Non-contact detection of impact damage in CFRP composites using millimeter-wave reflection and considering carbon fiber direction
22. S W. Damage/Defect Types and inspection - some regulatory concerns. MIL-17 Maint Work, no. July; 2006. p. 60–92.
23. Human factors in visual quality control
24. Visual inspection reliability for precision manufactured parts10.1177/0018720815602389 ↗
25. Autonomous inspection and repair of aircraft composite structures10.1016/j.ifacol.2018.11.267 ↗
26. Canizo M, Onieva E, Conde A, Charramendieta S, Trujillo S. Real-time predictive maintenance for wind turbines using Big Data frameworks. 2017. doi: 10.1109/ICPHM.2017.7998308.10.1109/ICPHM.2017.7998308 ↗
27. Big data driven smart energy management: From big data to big insights
28. Image acquisition techniques for automatic visual inspection of metallic surfaces10.1016/S0963-8695(03)00081-1 ↗
29. A method of predicting visual detectability of low-velocity impact damage in composite structures based on logistic regression model10.1016/j.cja.2020.10.006 ↗
30. Renewable energy: present research and future scope of Artificial Intelligence10.1016/j.rser.2017.04.018 ↗
31. Data-driven structural health monitoring and damage detection through deep learning: state-ofthe- art review10.3390/s20102778 ↗
32. A literature review of next-generation smart sensing technology in structural health monitoring10.1002/stc.2321 ↗
33. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
34. On-demand monitoring of construction projects through a game-like hybrid application of BIM and machine learning10.1016/j.autcon.2019.103012 ↗
35. Zeiler MD, Fergus R. Visualizing and understanding convolutional networks arXiv:1311.2901v3 [cs.CV] 28 Nov 2013. Comput Vision–ECCV 2014; 2014. doi: 10.1007/978-3-319-10590-1_53.10.1007/978-3-319-10590-1_53 ↗
36. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. 2016. doi: 10.1109/CVPR.2016.90.10.1109/CVPR.2016.90 ↗
37. Automatic defects detection in CFRP thermograms, using convolutional neural networks and transfer learning10.1016/j.infrared.2019.103048 ↗
38. Defect identification in composite materials via thermography and deep learning techniques10.1016/j.compstruct.2020.112405 ↗
39. A deep transfer learning model for inclusion defect detection of aeronautics composite materials10.1016/j.compstruct.2020.112681 ↗
40. Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks10.1016/j.neucom.2016.11.066 ↗
41. Structural vibration-based classification and prediction of delamination in smart composite laminates using deep learning neural network10.1016/j.compositesb.2018.12.118 ↗
42. Improved damage localization and quantification of CFRP using lamb waves and convolution neural network10.1109/JSEN.2019.2908838 ↗
43. Damage detection in composites by artificial neural networks trained by using in situ distributed strains10.1007/s10443-020-09829-z ↗
44. A convolutional neural network for impact detection and characterization of complex composite structures10.3390/s19224933 ↗
45. A comprehensive review on convolutional neural network in machine fault diagnosis10.1016/j.neucom.2020.07.088 ↗
46. A systematic review of convolutional neural network-based structural condition assessment techniques10.1016/j.engstruct.2020.111347 ↗
47. Unnikrishnan A, Sowmya V, Soman KP. Deep alexnet with reduced number of trainable parameters for satellite image classification. 2018. doi: 10.1016/j.procs.2018.10.342.10.1016/j.procs.2018.10.342 ↗
48. Mathworks help center, Transfer Learning Using AlexNet, R2021a. https://uk.mathworks.com/help/deeplearning/ug/transfer-learning-using-alexnet.html.
49. Low velocity impact performance of stitched flax/epoxy composite laminates10.1016/j.compositesb.2017.02.003 ↗
50. Quasi-static and low-velocity impact behavior of intraply hybrid flax/basalt composites10.3390/fib7030026 ↗
51. An investigation on anti-impact and penetration performance of basalt fiber composites with different weave and lay-up modes
52. Studies on the low-velocity impact response of woven hybrid composites10.1016/j.compstruct.2004.07.024 ↗
53. Impact and damage tolerance of shear thickening fluids-impregnated carbon and glass fabric composites10.1177/0731684419842648 ↗
54. Low velocity impact behavior of basalt fiber-reinforced polymer composites
55. Parameters influencing the impact response of fiber-reinforced polymer matrix composite materials: a critical review10.1016/j.compstruct.2019.111007 ↗
56. Effect of the interfacial adhesion on the tensile and impact properties of carbon fiber reinforced polypropylene matrices10.1590/S1516-14392005000100015 ↗
57. Low-velocity impacts on preloaded GFRP specimens with various impactor shapes10.1016/j.compstruct.2006.06.033 ↗
58. The response of composite structures with pre-stress subject to low velocity impact damage10.1016/j.compstruct.2004.06.015 ↗
59. Impact and post-impact damage characterisation of hybrid composite laminates based on basalt fibres in combination with flax, hemp and glass fibres manufactured by vacuum infusion10.1016/j.compositesb.2014.10.031 ↗
60. Low velocity impact behaviour and post-impact characteristics of kenaf/glass hybrid composites with various weight ratios10.1016/j.jmrt.2019.04.005 ↗
61. Drop-weight impact of plain-woven hybrid glass-graphite/toughened epoxy composites10.1016/j.compositesa.2009.04.028 ↗
62. Residual tensile strength of the multi-impacted scarf-repaired glass fiber-reinforced polymer (GFRP) composites10.3390/ma11122351 ↗
63. High velocity impact behaviour of hybrid basalt-carbon/epoxy composites10.1016/j.compstruct.2017.02.039 ↗
64. Damage mitigation techniques in wind turbine blades: a review10.1177/0309524X17706862 ↗
65. Failure analysis of wind turbine blade under critical wind loads10.1016/j.engfailanal.2012.08.002 ↗
66. Prospective challenges in the experimentation of the rain erosion on the leading edge of wind turbine blades10.1002/we.2272 ↗
67. Water droplet erosion ofwind turbine blades: mechanics, testing, modeling and future perspectives
68. On the material characterisation of wind turbine blade coatings: the effect of interphase coating-laminate adhesion on rain erosion performance10.3390/ma10101146 ↗
69. Corsini A, Castorrini A, Morei E, Rispoli F, Sciulli F, Venturini. Modeling of rain drop erosion in a multi-MW wind turbine. 2015. doi: 10.1115/GT2015-42174.10.1115/GT2015-42174 ↗
70. Interaction of delaminations and matrix cracks in a CFRP plate, Part I: a test method for model validation
71. Impact damage modeling in laminated composite aircraft structures10.1016/B978-0-08-102131-6.00007-4 ↗
72. Mechanical performance of carbon-epoxy laminates. Part II: quasi-static and fatigue tensile properties
73. Degradable phosphate glass fiber reinforced polymer matrices: mechanical properties and cell response10.1007/s10856-007-3147-x ↗
74. Experimental study on compression properties and failure mechanism of 3D MWK carbon/epoxy composites at elevated temperatures10.1002/pc.24372 ↗
75. Matrix cracking induced by cyclic ply stresses in composite laminates10.1016/S0266-3538(01)00125-7 ↗
76. Effect of water absorption on Mode I interlaminar fracture toughness of flax/basalt reinforced vinyl ester hybrid composites10.1016/j.compstruct.2017.02.081 ↗
77. Mathworks help center, ResNet-50 convolutional neural network. R2021a. https://uk.mathworks.com/help/deeplearning/ref/resnet50.html.
78. ImageNet. http://www.image-net.org.