journal article·2023-06-23Open access

Principles of Machine Learning and Its Application to Thermal Barrier Coatings

Yuan Liu, Kuiying Chen, Amarnath Kumar, Prakash Patnaik

Coatings· Volume 13· Issue 7

Abstract

Artificial intelligence (AI), machine learning (ML) and deep learning (DL) along with big data (BD) management are currently viable approaches that can significantly help gas turbine components’ design and development. Optimizing microstructures of hot section components such as thermal barrier coatings (TBCs) to improve their durability has long been a challenging task in the gas turbine industry. In this paper, a literature review on ML principles and its various associated algorithms was presented first and then followed by its application to investigate thermal conductivity of TBCs. This combined approach can help better understand the physics behind thermal conductivity, and on the other hand, can also boost the design of low thermal conductivity of the TBCs system in terms of microstructure–property relationships. Several ML models and algorithms such as support vector regression (SVR), Gaussian process regression (GPR) and convolution neural network and regression algorithms were used via Python. A large volume of thermal conductivity data was compiled and extracted from the literature for TBCs using PlotDigitizer software and then used to test and validate ML models. It was found that the test data were strongly associated with five key factors as identifiers. The prediction of thermal conductivity was performed using three approaches: polynomial regression, neural network (NN) and gradient boosting regression (GBR). The results suggest that NN using the BR model and GBR have better prediction capability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: High-Temperature Coating Behaviors · Thermography and Photoacoustic Techniques · Nuclear Materials and Properties

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

TECSIS Corporation, Ottawa, ON K2E 7L5, Canada

Structures, Materials Performance Laboratory, Aerospace Research Centre, National Research Council Canada, Ottawa, ON K1A 0R6, Canada

Funding

Air Defence System Program of National Research Council Canada

References (100+)

Show source-provided references
1. The machine learning revolution in materials?10.1557/mrs.2019.153 ↗
2. Data-Driven Materials Science: Status, Challenges, and Perspectives10.1002/advs.201900808 ↗
3. Machine learning in materials science10.1002/inf2.12028 ↗
4. Materials discovery and design using machine learning
5. Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science10.1063/1.4946894 ↗
6. Big Data Creates New Opportunities for Materials Research: A Review on Methods and Applications of Machine Learning for Materials Design10.1016/j.eng.2019.02.011 ↗
7. Pokluda, J., and Kianicová, M. (2010). Gas Turbines, SCIYO. [1st ed.]. Available online: https://www.intechopen.com/chapters/12092.
8. Overview on advanced thermal barrier coatings10.1016/j.surfcoat.2010.08.151 ↗
9. The Materials Genome Initiative and artificial intelligence10.1557/mrs.2018.122 ↗
10. From the computer to the laboratory: Materials From the computer to the laboratory: Materials discovery and design using first-principles calculations10.1007/s10853-012-6424-0 ↗
11. Materials 4.0: Materials big data enabled materials discovery10.1016/j.apmt.2017.12.015 ↗
12. National Science and Technology Council (2012). Materials Genome Initiative for Global Competitiveness, American Society for Metals. Aeromat 23 Conference and Exposition American Society for Metals.
13. Mueller, T., Kusne, G.K., and Ramprasad, R. (2016). Reviews in Computational Chemistry, John Wiley & Sons, Inc.
14. Determining neutrino oscillation parameters from atmospheric muon neutrino disappearance with three years of IceCube DeepCore data10.1103/PhysRevD.91.072004 ↗
15. Vision for Data and Informatics in the Future Materials Innovation Ecosystem10.1007/s11837-016-2036-5 ↗
16. Materials science with large-scale data and informatics: Unlocking new opportunities10.1557/mrs.2016.93 ↗
17. Ravichandran, T., Liu, Y., Kumar, A., Srivastava, A., Hanachi, H., and Heppler, G. (September, January 30). Data-Driven Performance Prediction Using Gas Turbine Sensory Signals. Proceedings of the 2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), London, ON, Canada.10.1109/CCECE47787.2020.9255821 ↗
18. Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer.
19. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.10.1007/978-0-387-84858-7 ↗
20. Melting point prediction employing k-nearest neighbor algorithms and genetic parameter optimization10.1021/ci060149f ↗
21. Comparison of classifying the material mechanical properties by using k-Nearest Neighbor and Neural Network Backpropagation
22. A Naïve-bayes classifier and f-folds feature extraction method for materials damage detection
23. An Expert Decision Support System for Engineering Materials Selections and Their Performance Classifications on Design Parameters
24. Classification using Hierarchical Naïve Bayes models10.1007/s10994-006-6136-2 ↗
25. Hemanth, K.S., Vastrad, C.M., and Nagaraju, S. (2011). Advances in Computer Science and Information Technology, Springer.
26. Induction of decision trees10.1007/BF00116251 ↗
27. Improved use of continuous attributes in C4.510.1613/jair.279 ↗
28. Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.J. (1984). Classification and Regression Trees, Wadsworth International Group.
29. Identifying the “inorganic gene” for high-temperature piezoelectric perovskites through statistical learning
30. Cristianini, N., and Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press.10.1017/CBO9780511801389 ↗
31. Schölkopf, B., Smola, A.J., and Bach, F. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.10.7551/mitpress/4175.001.0001 ↗
32. Hybrid genetic algorithms and support vector regression in forecasting atmospheric corrosion of metallic materials10.1016/j.commatsci.2008.05.010 ↗
33. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting10.1006/jcss.1997.1504 ↗
34. Bagging predictions10.1007/BF00058655 ↗
35. Stacked generalization10.1016/S0893-6080(05)80023-1 ↗
36. Heuristics of instability and stabilization in model selection10.1214/aos/1032181158 ↗
37. Universal fragment descriptors for predicting properties of inorganic crystals10.1038/ncomms15679 ↗
38. Random Forests10.1023/A:1010933404324 ↗
39. High-Throughput Compounds Synthesis of full-Heusler componds10.1021/acs.chemmater.6b02724 ↗
40. Materials Screening for the Discovery of New Half-Heuslers: Machine Learning versus ab Initio Methods10.1021/acs.jpcb.7b05296 ↗
41. Finding unprecedentedly low-thermal-conductivity half-heusler semiconductors via high-throughput materials modeling
42. Goodfellow, I., Bengio, Y., and Courville, A. (2020, March 10). Deep Learning: Machine Learning Book. Available online: http://www.deeplearningbook.org/.
43. Deep Learning: Methods and Applications10.1561/2000000039 ↗
44. Machine learning for molecular and materials science10.1038/s41586-018-0337-2 ↗
45. Crowdfunding: Geography, Social Networks, and the Timing of Investment Decisions10.1111/jems.12093 ↗
46. Thompson, D.O., and Chimenti, D.E. (1993). Review of Progress in Quantitative Nondestructive Evaluation: Volumes 12A and 12B, Springer.10.1007/978-1-4615-2848-7 ↗
47. Detection and characterization of defects using GMR probes and artificial neural networks10.1016/j.csi.2010.06.011 ↗
48. Non-destructive investigation of corrosion current density in steel reinforced concrete by artificial neural networks10.1016/j.acme.2012.10.007 ↗
49. Defect Detection in Reinforced Concrete Using Random Neural Architectures10.1111/mice.12039 ↗
50. Modelling beta transus temperature of titanium alloys using artificial neural network10.1016/j.commatsci.2004.05.004 ↗
51. Predicting the compressive strength of steel fiber added lightweight concrete using neural network10.1016/j.commatsci.2007.07.011 ↗
52. Sensitivity analysis of crack propagation in pavement bituminous layered structures using a hybrid system integrating Artificial Neural Networks and Finite Element Method10.1016/j.commatsci.2013.09.025 ↗
53. Two semi-empirical approaches for the prediction of oxide ionic conductivities in ABO3 perovskites10.1016/j.commatsci.2009.04.047 ↗
54. A review on applications of ANN and SVM for building electrical energy consumption forecasting10.1016/j.rser.2014.01.069 ↗
55. Lattice constant prediction of orthorhombic ABO3 perovskites using support vector machines10.1016/j.commatsci.2006.08.015 ↗
56. Lattice constant prediction of cubic and monoclinic perovskites using neural networks and support vector regression10.1016/j.commatsci.2010.08.028 ↗
57. Predicting lattice constant of complex cubic perovskites using computational intelligence10.1016/j.commatsci.2011.01.035 ↗
58. A general-purpose machine learning framework for predicting properties of inorganic materials10.1038/npjcompumats.2016.28 ↗
59. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection10.1177/1475921717737051 ↗
60. Deep Multitask Learning for Railway Track Inspection10.1109/TITS.2016.2568758 ↗
61. Automatic Detection of Welding Defects using Deep Neural Network10.1088/1742-6596/933/1/012006 ↗
62. Structural Damage Detection with Automatic Feature-Extraction through Deep Learning10.1111/mice.12313 ↗
63. Defect engineering in development of low thermal conductivity materials: A review10.1016/j.jeurceramsoc.2016.07.036 ↗
64. Corrosion detection using AI a comparison of standard computed vision techniques and deep learning model
65. Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network10.1111/mice.12297 ↗
66. ElemNet: Deep Learning the Chemistry of Materials from Only Elemental Composition10.1038/s41598-018-35934-y ↗
67. Goh, G.B., Siegel, C., Vishnu, A., Hodas, N.O., and Baker, N. (2023, March 10). Chemception: A Deep Neural Network with Minimal Chemistry Knowledge Matches the Performance of Expert-developed QSAR/QSPR Models. Available online: http://arxiv.org/abs/1706.06689.
68. Exploration of quantitative structure–property relationships (QSPR) for the design of new guanidinium ionic liquids10.1016/j.tet.2007.12.021 ↗
69. Thermal conductivity modeling using machine learning potentials: Application to crystalline and amorphous silicon10.1016/j.mtphys.2019.100140 ↗
70. A Machine Learning Approach to Thermal Conductivity Modeling: A Case Study on Irradiated Uranium-Molybdenum Nuclear Fuels10.1016/j.commatsci.2019.01.044 ↗
71. Predicting the effective thermal conductivities of composite materials and porous media by machine learning methods10.1016/j.ijheatmasstransfer.2018.08.082 ↗
72. Gaussian approximation potential for studying the thermal conductivity of silicene10.1063/1.5119281 ↗
73. Thermal conductivity of zirconia coatings with zig-zag pore microstructures10.1016/S1359-6454(01)00141-0 ↗
74. Effects of pores and interfaces on effective properties of plasma sprayed zirconia coatings10.1016/S1359-6454(03)00390-2 ↗
75. Low-thermal-conductivity plasma-sprayed thermal barrier coatings with engineered microstructures10.1016/j.actamat.2006.03.024 ↗
76. Effect of morphology on thermal conductivity of EB-PVD PYSZ TBCs10.1016/j.surfcoat.2006.05.003 ↗
77. Effects of defects on the effective thermal conductivity of thermal barrier coatings10.1016/j.apm.2011.08.018 ↗
78. Microstructure of ZrO2 thermal barrier coatings applied by EB-PVD10.1016/S0921-5093(99)00576-6 ↗
79. EB-PVD Thermal Barrier Coatings for Aeroengines and Gas Turbines10.1002/1527-2648(200104)3:4<193::AID-ADEM193>3.0.CO;2-U ↗
80. Microstructures of Y2O3-Stabilized ZrO2 Electron Beam-Physical Vapor Deposition Coatings on Ni-Base Superalloys10.1111/j.1151-2916.1994.tb07256.x ↗
81. Thermocyclic Behaviour of Microstructurally Modified EB-PVD Thermal Barrier Coatings10.4028/www.scientific.net/MSF.251-254.957 ↗
82. Phase Transformation in EB-PVD Yttria Partially Stabilized Zirconia Thermal Barrier Coatings during Annealing10.1111/j.1151-2916.2000.tb01292.x ↗
83. Ceramic thermal barrier coatings deposited with the electron beam-physical vapour deposition technique10.1016/S0257-8972(97)00149-7 ↗
84. The effects of heat treatment and gas atmosphere on the thermal conductivity of APS and EB-PVD PYSZ thermal barrier coatings10.1016/j.surfcoat.2007.03.028 ↗
85. Artificial neural networks in medical diagnosis10.2478/v10136-012-0031-x ↗
86. Microstructure, Texture, and Thermal Conductivity of Single-Layer and Multilayer Thermal Barrier Coatings of Y2O3-Stabilized ZrO2 and Al2O3 Made by Physical Vapor Deposition10.1111/j.1551-2916.1999.tb20076.x ↗
87. Methods to reduce the thermal conductivity of EB-PVD TBCs10.1016/S0257-8972(01)01651-6 ↗
88. Evaluation of thermal conductivity of zirconia coating layers deposited by EB-PVD10.1023/B:JMSC.0000016195.72123.77 ↗
89. Tailored microstructure of zirconia and hafnia-based thermal barrier coatings with low thermal conductivity and high hemispherical reflectance by EB-PVD10.1023/B:JMSC.0000017759.50800.d7 ↗
90. Low thermal conductivity and high temperature stability of ZrO2-Y2O3-La2O3 coatings produced by electron beam PVD10.1016/j.scriptamat.2003.12.008 ↗
91. The effect of coating thickness on the thermal conductivity of EB-PVD PYSZ thermal barrier coatings10.1016/j.surfcoat.2005.07.109 ↗
92. Thermal conductivity investigation of zirconia co-doped with yttria and niobia EB-PVD TBCs10.1016/j.msea.2006.09.072 ↗
93. Thermal conductivity issues of EB-PVD thermal barrier coatings10.1002/mawe.200700189 ↗
94. Thermal conductivity of nanoporous ZrO2-4 mol% Y2O3 multilayer coatings fabricated by EB-PVD10.1016/j.surfcoat.2007.07.017 ↗
95. Thermal conductivity and thermal cycle life of La2O3 and HfO2 doped ZrO2-Y2O3 coatings produced by EB-PVD10.1016/j.surfcoat.2009.01.033 ↗
96. Thermal conductivity of EB-PVD ZrO2-4 mol% Y2O3 films using the laser flash method10.1016/j.jallcom.2010.08.162 ↗
97. Dependence of microstructure and thermal conductivity of EB-PVD thermal barrier coatings on the substrate rotation speed10.1016/j.phpro.2011.06.082 ↗
98. Influence of temperature on phase stability and thermal conductivity of single- and double-ceramic-layer EB-PVD TBC top coats consisting of 7YSZ, Gd2Zr2O7 and La2Zr2O710.1016/j.surfcoat.2013.08.013 ↗
99. Principles and Procedures of Exploratory Data Analysis10.1037/1082-989X.2.2.131 ↗
100. Selection of relevant features and examples in machine learning10.1016/S0004-3702(97)00063-5 ↗