Bayesian optimization with active learning of design constraints using an entropy-based approach
Source abstract
Abstract
Abstract The design of alloys for use in gas turbine engine blades is a complex task that involves balancing multiple objectives and constraints. Candidate alloys must be ductile at room temperature and retain their yield strength at high temperatures, as well as possess low density, high thermal conductivity, narrow solidification range, high solidus temperature, and a small linear thermal expansion coefficient. Traditional Integrated Computational Materials Engineering (ICME) methods are not sufficient for exploring combinatorially-vast alloy design spaces, optimizing for multiple objectives, nor ensuring that multiple constraints are met. In this work, we propose an approach for solving a constrained multi-objective materials design problem over a large composition space, specifically focusing on the Mo-Nb-Ti-V-W system as a representative Multi-Principal Element Alloy (MPEA) for potential use in next-generation gas turbine blades. Our approach is able to learn and adapt to unknown constraints in the design space, making decisions about the best course of action at each stage of the process. As a result, we identify 21 Pareto-optimal alloys that satisfy all constraints. Our proposed framework is significantly more efficient and faster than a brute force approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Titanium Alloys Microstructure and Properties · Additive Manufacturing Materials and Processes
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (96)
Show source-provided references
1. Long, H., Mao, S., Liu, Y., Zhang, Z. & Han, X. Microstructural and compositional design of Ni-based single crystalline superalloys - a review. J. Alloy. Compd. 743, 203–220 (2018).10.1016/j.jallcom.2018.01.224 ↗
2. Ultrahigh Temperature Impervious Materials Advancing Turbine Efficiency (ULTIMATE). Advanced Research Projects Agency-Energy. https://arpa-e.energy.gov/technologies/programs/ultimate (2020).
3. Yeh, J.-W. & Lin, S.-J. Breakthrough applications of high-entropy materials. J. Mater. Res. 33, 3129–3137 (2018).10.1557/jmr.2018.283 ↗
4. Liu, X., Zhang, J. & Pei, Z. Machine learning for high-entropy alloys: Progress, challenges and opportunities. Prog. Mater. Sci. 131, 101018 (2023).10.1016/j.pmatsci.2022.101018 ↗
5. Jung, Y. et al. Investigation of phase-transformation path in TiZrHf(VNbTa)x refractory high-entropy alloys and its effect on mechanical property. J. Alloy. Compd. 886, 161187 (2021).10.1016/j.jallcom.2021.161187 ↗
6. Allison, J. Integrated computational materials engineering: A perspective on progress and future steps. JOM 63, 15–18 (2011).10.1007/s11837-011-0053-y ↗
7. Biswas, A., Morozovska, A. N., Ziatdinov, M., Eliseev, E. A. & Kalinin, S. V. Multi-objective bayesian optimization of ferroelectric materials with interfacial control for memory and energy storage applications. J. Appl. Phys. 130, 204102 (2021).10.1063/5.0068903 ↗
8. Solomou, A. et al. Multi-objective bayesian materials discovery: application on the discovery of precipitation strengthened NiTi shape memory alloys through micromechanical modeling. Mater. Des. 160, 810–827 (2018).10.1016/j.matdes.2018.10.014 ↗
9. Zhao, G., Arróyave, R., Qian, X. Fast exact computation of expected hypervolume improvement. https://arXiv.org/abs/1812.07692 (2018).
10. Suzuki, S., Takeno, S., Tamura, T., Shitara, K., Karasuyama, M. Multi-objective bayesian optimization using pareto-frontier entropy. In International Conference on Machine Learning, pp. 9279–9288 (2020).
11. Knowles, J. ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10, 50–66 (2006).10.1109/TEVC.2005.851274 ↗
12. Khatamsaz, D. et al. Efficiently exploiting process-structure-property relationships in material design by multi-information source fusion. Acta Mater. 206, 116619 (2021).10.1016/j.actamat.2020.116619 ↗
13. Khatamsaz, D. et al. Adaptive active subspace-based efficient multifidelity materials design. Mater. Des. 209, 110001 (2021).10.1016/j.matdes.2021.110001 ↗
14. Ghoreishi, S.F., Allaire, D.L. A fusion-based multi-information source optimization approach using knowledge gradient policies. In AIAA/ASCE/AHS/ASC Struct. Struct. Dyn. Mater. Conf., p. 1159 (2018).10.2514/6.2018-1159 ↗
15. Ghoreishi, S. F., Molkeri, A., Srivastava, A., Arroyave, R. & Allaire, D. Multi-information source fusion and optimization to realize ICME: Application to dual-phase materials. J. Mech. Des. 140, 111409 (2018).10.1115/1.4041034 ↗
16. Ghoreishi, S. F. & Allaire, D. Multi-information source constrained bayesian optimization. Struct. Multidiscip. Optim. 59, 977–991 (2019).10.1007/s00158-018-2115-z ↗
17. Khatamsaz, D., Peddareddygari, L., Friedman, S., Allaire, D. Bayesian optimization of multiobjective functions using multiple information sources. AIAA J. 1–11 https://doi.org/10.2514/1.J059803 (2021).10.2514/1.J059803 ↗
18. Hickman, R. J., Aldeghi, M., Häse, F. & Aspuru-Guzik, A. Bayesian optimization with known experimental and design constraints for chemistry applications. Digit. Discov. 1, 732–744 (2022).10.1039/D2DD00028H ↗
19. Kusne, A. G. et al. On-the-fly closed-loop materials discovery via bayesian active learning. Nat. Commun. 11, 5966 (2020).10.1038/s41467-020-19597-w ↗
20. Kusne, A. G., Keller, D., Anderson, A., Zaban, A. & Takeuchi, I. High-throughput determination of structural phase diagram and constituent phases using GRENDEL. Nanotechnology 26, 444002 (2015).10.1088/0957-4484/26/44/444002 ↗
21. Khatamsaz, D. et al. Multi-objective materials bayesian optimization with active learning of design constraints: Design of ductile refractory multi-principal-element alloys. Acta Mater. 236, 118133 (2022).10.1016/j.actamat.2022.118133 ↗
22. Maresca, F. & Curtin, W. A. Mechanistic origin of high strength in refractory bcc high entropy alloys up to 1900k. Acta Mater. 182, 235–249 (2020).10.1016/j.actamat.2019.10.015 ↗
23. Shaikh, S. M., Hariharan, V. S., Yadav, S. K. & Murty, B. S. CALPHAD and rule-of-mixtures: A comparative study for refractory high entropy alloys. Intermetallics 127, 106926 (2020).10.1016/j.intermet.2020.106926 ↗
24. Chen, L., Zhang, X., Wang, Y., Hao, X. & Liu, H. Microstructure and elastic constants of AlTiVMoNb refractory high-entropy alloy coating on Ti6Al4V by laser cladding. Mater. Res. Express 6, 116571 (2019).10.1088/2053-1591/ab49e7 ↗
25. Ye, Y. X. et al. Evaluating elastic properties of a body-centered cubic NbHfZrTi high-entropy alloy - A direct comparison between experiments and ab initio calculations. Intermetallics 109, 167–173 (2019).10.1016/j.intermet.2019.04.003 ↗
26. Pugh, S. F. Relations between the elastic moduli and the plastic properties of polycrystalline pure metals. Philos. Mag. 45, 823–843 (1954).10.1080/14786440808520496 ↗
27. Pettifor, D. G. Theoretical predictions of structure and related properties of intermetallics. Mater. Sci. Technol. 8, 345–349 (1992).10.1179/mst.1992.8.4.345 ↗
28. Kobayashi, T. Advances in turbine materials design and manufacturing. In Proc. 4th Int. Charles Parsons Turbine Conference, vol. 4, p. 766 (1997)
29. Wee, S. et al. Review on mechanical thermal properties of superalloys and thermal barrier coating used in gas turbines. Appl. Sci. 10, 5476 (2020).10.3390/app10165476 ↗
30. Sheikh, S. et al. Alloy design for intrinsically ductile refractory high-entropy alloys. J. Appl. Phys. 120, 164902 (2016).10.1063/1.4966659 ↗
31. Li, W. et al. An ambient ductile TiHfVNbTa refractory high-entropy alloy: Cold rolling, mechanical properties, lattice distortion, and first-principles prediction. Mater. Sci. Eng. A 856, 144046 (2022).10.1016/j.msea.2022.144046 ↗
32. Bai, L. et al. Titanium alloying enhancement of mechanical properties of NbTaMoW refractory high-entropy alloy: First-principles and experiments perspective. J. Alloy. Compd. 857, 157542 (2021).10.1016/j.jallcom.2020.157542 ↗
33. Jiang, H. et al. Effects of tungsten on microstructure and mechanical properties of CrFeNiV0.5Wx and CrFeNi2V0.5Wx high-entropy alloys. J. Mater. Eng. Perform. 24, 4594–4600 (2015).10.1007/s11665-015-1767-8 ↗
34. Singh, R., Sharma, A., Singh, P., Balasubramanian, G. & Johnson, D. D. Accelerating computational modeling and design of high-entropy alloys. Nat. Comput. Sci. 1, 54–61 (2021).10.1038/s43588-020-00006-7 ↗
35. Behera, M., Panigrahi, A., Bönisch, M., Shankar, G. & Mishra, P. K. Structural stability and thermal expansion of TiTaNbMoZr refractory high entropy alloy. J. Alloy. Compd. 892, 162154 (2022).10.1016/j.jallcom.2021.162154 ↗
36. Lin, D. et al. Effects of annealing on the structure and mechanical properties of fecocrni high-entropy alloy fabricated via selective laser melting. Addit. Manuf. 32, 101058 (2020).
37. Riva, S. et al. A novel high-entropy alloy-based composite material. J. Alloy. Compd. 730, 544–551 (2018).10.1016/j.jallcom.2017.09.274 ↗
38. Daoud, H., Manzoni, A., Wanderka, N. & Glatzel, U. High-temperature tensile strength of Al10Co25Cr8Fe15Ni36Ti6 compositionally complex alloy (high-entropy alloy). JOM 67, 2271–2277 (2015).10.1007/s11837-015-1484-7 ↗
39. Rasmussen, C.E., Williams, C.K.I. Gaussian processes for machine learning (Adaptive Computation and Machine Learning), pp. 8–29. (The MIT Press, Cambridge, MA, USA, 2005).10.7551/mitpress/3206.001.0001 ↗
40. Costabal, F. S., Perdikaris, P., Kuhl, E. & Hurtado, D. E. Multi-fidelity classification using gaussian processes: accelerating the prediction of large-scale computational models. Comput. Methods Appl. Mech. Eng. 357, 112602 (2019).10.1016/j.cma.2019.112602 ↗
41. Clyde, M.A. Model Averaging 2nd edn, pp. 320–335 Ch. 13 (Wiley–Interscience, Hoboken, NJ, USA, 2003). https://doi.org/10.1002/9780470317105.ch1310.1002/9780470317105.ch13 ↗
42. Clyde, M. & George, E. Model uncertainty. Stat. Sci. 19, 81–94 (2004).10.1214/088342304000000035 ↗
43. Draper, D. Assessment and propagation of model uncertainty. J. R. Stat. Soc. Ser. B 57, 45–97 (1995).10.1111/j.2517-6161.1995.tb02015.x ↗
44. Hoeting, J., Madigan, D., Raftery, A. & Volinsky, C. Bayesian model averaging: a tutorial. Stat. Sci. 14, 382–417 (1999).10.1214/ss/1009212519 ↗
45. Leamer, E. Specification Searches: Ad Hoc Inference with Nonexperimental Data. John Wiley & Sons, New York, NY. https://doi.org/10.2307/1057568 (1978).10.2307/1057568 ↗
46. Madigan, D. & Raftery, A. Model selection and accounting for model uncertainty in graphical models using Occam’s window. J. Am. Stat. Assoc. 89, 1535–1546 (1994).10.1080/01621459.1994.10476894 ↗
47. Mosleh, A. & Apostolakis, G. The assessment of probability distributions from expert opinions with an application to seismic fragility curves. Risk Anal. 6, 447–461 (1986).10.1111/j.1539-6924.1986.tb00957.x ↗
48. Reinert, J. & Apostolakis, G. Including model uncertainty in risk-informed decision making. Ann. Nucl. Energy 33, 354–369 (2006).10.1016/j.anucene.2005.11.010 ↗
49. Riley, M. & Grandhi, R. Quantification of modeling uncertainty in aeroelastic analyses. J. Aircr. 48, 866–873 (2011).10.2514/1.C031059 ↗
50. Zio, E. & Apostolakis, G. Two methods for the structured assessment of model uncertainty by experts in performance assessments of radioactive waste repositories. Reliab. Eng. Syst. Saf. 54, 225–241 (1996).10.1016/S0951-8320(96)00078-6 ↗
51. Julier, S., Uhlmann, J. A non-divergent estimation algorithm in the presence of unknown correlations. In Proc. Am. Control Conf. pp. 2369–2373. https://doi.org/10.1109/ACC.1997.609105 (1997).10.1109/ACC.1997.609105 ↗
52. Geisser, S. A bayes approach for combining correlated estimates. J. Am. Stat. Assoc. 60, 602–607 (1965).10.1080/01621459.1965.10480816 ↗
53. Morris, P. Combining expert judgments: a bayesian approach. J. Manag. Sci. 23, 679–693 (1977).
54. Winkler, R. Combining probability distributions from dependent information sources. J. Manag. Sci. 27, 479–488 (1981).
55. Talapatra, A. et al. Autonomous efficient experiment design for materials discovery with bayesian model averaging. Phys. Rev. Mater. 2, 113803 (2018).10.1103/PhysRevMaterials.2.113803 ↗
56. Allaire, D., Willcox, K. Fusing information from multifidelity computer models of physical systems. In 15th Int. Conf. Inf. Fusion pp. 2458–2465 (2012)
57. Thomison, W.D., Allaire, D.L. A model reification approach to fusing information from multifidelity information sources. In 19th AIAA Non-Deterministic Approaches Conf. p. 1949. https://doi.org/10.2514/6.2017-1949 (2017).10.2514/6.2017-1949 ↗
58. Ghoreishi, S. F., Thomison, W. D. & Allaire, D. Sequential information-theoretic and reification-based approach for querying multi-information sources. J. Aerosp. Inf. Syst. 16, 575–587 (2019).
59. Winkler, R. L. Combining probability distributions from dependent information sources. J. Manag. Sci. 27, 479–488 (1981).
60. Khatamsaz, D., Allaire, D.L. A comparison of reification and cokriging for sequential multi-information source fusion. In AIAA Scitech 2021 Forum p. 1477 (2021).10.2514/6.2021-1477 ↗
61. Ghoreishi, S. F., Molkeri, A., Arróyave, R., Allaire, D. & Srivastava, A. Efficient use of multiple information sources in material design. Acta Mater. 180, 260–271 (2019).10.1016/j.actamat.2019.09.009 ↗
62. Ghoreishi, S. F., Friedman, S. & Allaire, D. L. Adaptive dimensionality reduction for fast sequential optimization with gaussian processes. J. Mech. Des. 141, 071404 (2019).10.1115/1.4043202 ↗
63. Marler, R. T. & Arora, J. S. The weighted sum method for multi-objective optimization: New insights. Struct. Multidiscip. Optim. 41, 853–862 (2010).10.1007/s00158-009-0460-7 ↗
64. Kim, I. Y. & de Weck, O. L. Adaptive weighted-sum method for bi-objective optimization: Pareto front generation. Struct. Multidiscip. Optim. 29, 149–158 (2005).10.1007/s00158-004-0465-1 ↗
65. Das, I. & Dennis, J. E. Normal-boundary intersection: a new method for generating the pareto surface in nonlinear multicriteria optimization problems. SIAM J. Control Optim. 8, 631–657 (1998).10.1137/S1052623496307510 ↗
66. Beume, N. S-metric calculation by considering dominated hypervolume as klee’s measure problem. Evol. Comput. 17, 477–492 (2009).10.1162/evco.2009.17.4.17402 ↗
67. Bradstreet, L., While, L., Barone, L. A fast many-objective hypervolume algorithm using iterated incremental calculations. In IEEE Congr. Evol. Comput. pp. 1–8. https://doi.org/10.1109/CEC.2010.5586344 (2010).10.1109/CEC.2010.5586344 ↗
68. Emmerich, M.T., Deutz, A.H., Klinkenberg, J.W. Hypervolume-based expected improvement: Monotonicity properties and exact computation. In 2011 IEEE Congress of Evol. Comput. (CEC) pp. 2147–2154. https://doi.org/10.2514/6.2015-0143 (2011).10.2514/6.2015-0143 ↗
69. Fonseca, C.M., Paquete, L., López-Ibánez, M. An improved dimension-sweep algorithm for the hypervolume indicator. In 2006 IEEE Int. Conf. Evol. Comput. pp. 1157–1163. https://doi.org/10.1109/CEC.2006.1688440 (2006).10.1109/CEC.2006.1688440 ↗
70. Russo, L. M. & Francisco, A. P. Quick hypervolume. IEEE Trans. Evol. Comput. 18, 481–502 (2013).10.1109/TEVC.2013.2281525 ↗
71. Yang, Q., Ding, S. Novel algorithm to calculate hypervolume indicator of pareto approximation set. In Int. Conf. Intell. Comput., pp. 235–244. https://doi.org/10.1007/978-3-540-74282-1_2 (2007).10.1007/978-3-540-74282-1_2 ↗
72. Zitzler, E. & Thiele, L. Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach. IEEE Trans. Evol. Comput. 3, 257–271 (1999).10.1109/4235.797969 ↗
73. Khatamsaz, D., Peddareddygari, L., Friedman, S., Allaire, D.L. Efficient multi-information source multiobjective bayesian optimization. In AIAA Scitech 2020 Forum p. 2127. https://doi.org/10.2514/6.2020-2127 (2020).10.2514/6.2020-2127 ↗
74. Thermo-Calc Documentation Set. Thermo-Calc Software. https://thermocalc.com/support/documentation/(2022).
75. Slack, G. A. The thermal conductivity of nonmetallic crystals. J. Solid State Phys. 34, 1–71 (1979).10.1016/S0081-1947(08)60359-8 ↗
76. Morelli, D., Heremans, J. & Slack, G. Estimation of the isotope effect on the lattice thermal conductivity of group iv and group iii-v semiconductors. Phys. Rev. B 66, 195304 (2002).10.1103/PhysRevB.66.195304 ↗
77. Jones, W., March, N.H. Theoretical Solid State Physics, Volume 1: Perfect Lattices in Equilibrium. John Wiley & Sons Ltd, London, UK (1973)
78. Johnson, D. D., Nicholson, D. M., Pinski, F. J., Gyorffy, B. L. & Stocks, G. M. Density-functional theory for random alloys: Total energy within the coherent-potential approximation. Phys. Rev. Lett. 56, 2088–2091 (1986).10.1103/PhysRevLett.56.2088 ↗
79. Singh, P., Smirnov, A. V. & Johnson, D. D. Atomic short-range order and incipient long-range order in high-entropy alloys. Phys. Rev. B 91, 224204 (2015).10.1103/PhysRevB.91.224204 ↗
80. Perdew, J. P., Burke, K. & Ernzerhof, M. Generalized gradient approximation made simple. Phys. Rev. Lett. 77, 3865–3868 (1996).10.1103/PhysRevLett.77.3865 ↗
81. Kresse, G. & Hafner, J. Ab initio molecular dynamics for liquid metals. Phys. Rev. B 47, 558–561 (1993).10.1103/PhysRevB.47.558 ↗
82. Kresse, G. & Furthmüller, J. Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set. Comput. Mater. Sci. 6, 15–50 (1996).10.1016/0927-0256(96)00008-0 ↗
83. Kresse, G. & Furthmüller, J. Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. Phys. Rev. B 54, 11169–11186 (1996).10.1103/PhysRevB.54.11169 ↗
84. Kresse, G. & Joubert, D. From ultrasoft pseudopotentials to the projector augmented-wave method. Phys. Rev. B 59, 1758–1775 (1999).10.1103/PhysRevB.59.1758 ↗
85. Monkhorst, H. J. & Pack, J. D. Special points for brillouin-zone integrations. Phys. Rev. B 13, 5188–5192 (1976).10.1103/PhysRevB.13.5188 ↗
86. Blöchl, P. E. Projector augmented-wave method. Phys. Rev. B 50, 17953–17979 (1994).10.1103/PhysRevB.50.17953 ↗
87. Rao, Y., Baruffi, C., De Luca, A., Leinenbach, C. & Curtin, W. A. Theory-guided design of high-strength, high-melting point, ductile, low-density, single-phase bcc high entropy alloys. Acta Mater. 237, 118132 (2022).10.1016/j.actamat.2022.118132 ↗
88. Ferrari, A., Lysogorskiy, Y. & Drautz, R. Design of refractory compositionally complex alloys with optimal mechanical properties. Phys. Rev. Mater. 5, 063606 (2021).10.1103/PhysRevMaterials.5.063606 ↗
89. Vazquez, G. et al. Efficient machine-learning model for fast assessment of elastic properties of high-entropy alloys. Acta Mater. 232, 117924 (2022).10.1016/j.actamat.2022.117924 ↗
90. Abu-Odeh, A. et al. Efficient exploration of the high entropy alloy composition-phase space. Acta Mater. 152, 41–57 (2018).10.1016/j.actamat.2018.04.012 ↗
91. Kirk, T., Vela, B., Mehalic, S., Youssef, K. & Arróyave, R. Entropy-driven melting point depression in fcc heas. Scr. Mater. 208, 114336 (2022).10.1016/j.scriptamat.2021.114336 ↗
92. Vela, B. et al. Evaluating the intrinsic resistance to balling of alloys: A high-throughput physics-informed and data-enabled approach. Addit. Manuf. Lett. 3, 100085 (2022).10.1016/j.addlet.2022.100085 ↗
93. Rai, A. K., Trpathy, H., Hajra, R. N., Raju, S. & Saroja, S. Thermophysical properties of Ni based super alloy 617. J. Alloy. Compd. 698, 442–450 (2017).10.1016/j.jallcom.2016.12.183 ↗
94. Hellström, K., Diaconu, V.-L. & Diószegi, A. Density and thermal expansion coefficients of liquid and austenite phase in lamellar cast iron. China Foundry 17, 127–136 (2020).10.1007/s41230-020-0004-8 ↗
95. Singh, P. et al. A systematic first principles study of transport behavior of high-entropy alloys with experimental validation (in preparation).
96. Slack, G. A. Nonmetallic crystals with high thermal conductivity. J. Phys. Chem. Solids 34, 321–335 (1973).10.1016/0022-3697(73)90092-9 ↗