journal article·2025-02Open access

Inverse design of microstructures using conditional continuous normalizing flows

Hossein Mirzaee, Serveh Kamrava

Acta Materialia· Volume 285

Abstract

Inverse design is a classical mathematical challenge found in various fields, including materials science, where it is essential for property-driven microstructure design. This problem involves the inversion of structure-property linkages, a task complicated by the high dimensionality and stochastic nature of microstructures. Leveraging the advantages of a low-dimensional and meaningful design representation, we aim to develop an efficient data-driven approach for the inverse design of microstructures. Specifically, we propose PoreFlow, a modular framework utilizing continuous normalizing flows (CNFs) for property-based microstructure generation. Our approach regularizes the CNF latent space by introducing target properties as a feature vector. Demonstrating the conditional generation process in our framework, we highlight its capabilities as an end-to-end, high-throughput solution for materials inverse design applications. Through an example of generating 3D images of porous microstructures, we analyze the mechanism through which specified targets effectively guide the generative process in low-dimensional latent space. The model's performance in reconstructing and generating new samples with targeted properties was assessed using visual comparison and statistical measures such as RMSE and ² R ² scores. During reconstruction, we consistently achieved ² R ² scores above 91.5 for all five target properties, while for generation, ² R ² scores remained consistently higher than 0.92. Notably, our methodology avoids common issues such as unstable training and mode collapse, which often plague generative models such as GANs, even with extensive hyperparameter tuning. This framework offers a robust solution for advancing inverse microstructure design.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Additive Manufacturing and 3D Printing Technologies · Injection Molding Process and Properties · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (71)

Show source-provided references
1. Exploration of data science techniques to predict fatigue strength of steel from composition and processing parameters10.1186/2193-9772-3-8 ↗
2. Machine-learning microstructure for inverse material design10.1002/advs.202101207 ↗
3. Learning structure-property relationship in crystalline materials: a study of lanthanide–transition metal alloys10.1063/1.5021089 ↗
4. Inverse design of materials by machine learning
5. Deep generative modeling for mechanistic-based learning and design of metamaterial systems10.1016/j.cma.2020.113377 ↗
6. Probabilistic representation and inverse design of metamaterials based on a deep generative model with semi-supervised learning strategy10.1002/adma.201901111 ↗
7. Computational design of mechanical metamaterials10.1038/s43588-024-00672-x ↗
8. Computational design of microarchitected porous electrodes for redox flow batteries10.1016/j.jpowsour.2021.230453 ↗
9. Machine learning coupled multi-scale modeling for redox flow batteries
10. Inverse design of porous materials using artificial neural networks10.1126/sciadv.aax9324 ↗
11. Big data creates new opportunities for materials research: a review on methods and applications of machine learning for materials design10.1016/j.eng.2019.02.011 ↗
12. Designing phononic crystal with anticipated band gap through a deep learning based data-driven method10.1016/j.cma.2019.112737 ↗
13. A hybrid strategy for the discovery and design of photonic structures10.1109/JETCAS.2020.2970080 ↗
14. Deep learning-based inverse design of microstructured materials for optical optimization and thermal radiation control10.1038/s41598-023-34332-3 ↗
15. Machine learning for the discovery, design, and engineering of materials10.1146/annurev-chembioeng-092320-120230 ↗
16. Inverse stochastic microstructure design10.1016/j.actamat.2024.119877 ↗
17. A framework for data-driven analysis of materials under uncertainty: countering the curse of dimensionality10.1016/j.cma.2017.03.037 ↗
18. A descriptor-based design methodology for developing heterogeneous microstructural materials system10.1115/1.4026649 ↗
19. Delineation of the space of 2-point correlations in a composite material system10.1016/j.actamat.2008.07.005 ↗
20. Three-dimensional microstructural imaging methods for energy materials10.1039/c3cp52356j ↗
21. Machine learning-facilitated multiscale imaging for energy materials
22. Bridging nano- and microscale X-ray tomography for battery research by leveraging artificial intelligence10.1038/s41565-022-01081-9 ↗
23. Multimodal imaging and machine learning to enhance microscope images of shale10.1016/j.cageo.2020.104593 ↗
24. Three-dimensional multiscale fusion for porous media on microtomography images of different resolutions10.1103/PhysRevE.101.053308 ↗
25. Microstructural quantification and property prediction using limited X-ray tomography data10.1007/s11837-016-2024-9 ↗
26. Accelerating multi-point statistics reconstruction method for porous media via deep learning10.1016/j.actamat.2018.08.026 ↗
27. Direct extraction of spatial correlation functions from limited x-ray tomography data for microstructural quantification10.1016/j.matchar.2018.04.020 ↗
28. Three dimensional modeling of complex heterogeneous materials via statistical microstructural descriptors10.1186/2193-9772-3-3 ↗
29. Deep Generative Models in Engineering Design: a Review
30. Microstructure design using machine learning generated low dimensional and continuous design space10.1016/j.mtla.2020.100690 ↗
31. R. Cang, Y. Xu, S. Chen, Y. Liu, Y. Jiao, and M.Y. Ren, “Microstructure Representation and Reconstruction of Heterogeneous Materials via Deep Belief Network for Computational Material Design,” Apr. 28, 2017, arXiv: arXiv:1612.07401. doi:10.48550/arXiv.1612.07401.10.1115/1.4036649 ↗
32. Minireview on porous media and microstructure reconstruction using machine learning techniques: recent advances and outlook10.1021/acs.energyfuels.3c02126 ↗
33. R. Cang, H. Li, H. Yao, Y. Jiao, and Y. Ren, “Improving Direct Physical Properties Prediction of Heterogeneous Materials from Imaging Data via Convolutional Neural Network and a Morphology-Aware Generative Model,” Dec. 07, 2017, arXiv: arXiv:1712.03811. doi:10.48550/arXiv.1712.03811.10.1016/j.commatsci.2018.03.074 ↗
34. Towards inverse microstructure-centered materials design using generative phase-field modeling and deep variational autoencoders10.1016/j.actamat.2023.119204 ↗
35. Harnessing structural stochasticity in the computational discovery and design of microstructures10.1016/j.matdes.2022.111223 ↗
36. Designing complex architectured materials with generative adversarial networks10.1126/sciadv.aaz4169 ↗
37. Machine learning–assisted design of material properties10.1146/annurev-chembioeng-092220-024340 ↗
38. Solving inverse problems using data-driven models10.1017/S0962492919000059 ↗
39. Z. Yang, D. Jha, A. Paul, W. Liao, A. Choudhary, and A. Agrawal, “A General Framework Combining Generative Adversarial Networks and Mixture Density Networks for Inverse Modeling in Microstructural Materials Design,” Jan. 25, 2021, arXiv: arXiv:2101.10553. doi: 10.48550/arXiv.2101.10553.
40. Digital rock reconstruction with user-defined properties using conditional generative adversarial networks10.1007/s11242-021-01728-6 ↗
41. Synthesizing controlled microstructures of porous media using generative adversarial networks and reinforcement learning10.1038/s41598-022-12845-7 ↗
42. I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. Courville, “Improved Training of Wasserstein GANs,” Dec. 25, 2017, arXiv: arXiv:1704.00028. doi:10.48550/arXiv.1704.00028.
43. T. Karras, T. Aila, S. Laine, and J. Lehtinen, “Progressive Growing of GANs for Improved Quality, Stability, and Variation,” Feb. 26, 2018, arXiv: arXiv:1710.10196. doi: 10.48550/arXiv.1710.10196.
44. Microstructure reconstruction using diffusion-based generative models10.1080/15376494.2023.2198528 ↗
45. N.N. Vlassis, W. Sun, K.A. Alshibli, and R.A. Regueiro, “Synthesizing realistic sand assemblies with denoising diffusion in latent space,” Int. J. Numer. Anal. Methods Geomech., vol. n/a, no. n/a, doi: 10.1002/nag.3818.10.1002/nag.3818 ↗
46. Digital polycrystalline microstructure generation using diffusion probabilistic models10.1016/j.mtla.2023.101976 ↗
47. Generating 3D images of material microstructures from a single 2D image: a denoising diffusion approach10.1038/s41598-024-56910-9 ↗
48. Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties10.1016/j.cma.2023.116126 ↗
49. Conditional diffusion-based microstructure reconstruction
50. A data-driven framework for designing microstructure of multifunctional composites with deep-learned diffusion-based generative models10.1016/j.engappai.2023.107590 ↗
51. Microstructure reconstruction of 2D/3D random materials via diffusion-based deep generative models10.1038/s41598-024-54861-9 ↗
52. L. Dinh, J. Sohl-Dickstein, and S. Bengio, “Density estimation using Real NVP,” Feb. 27, 2017, arXiv: arXiv:1605.08803. doi:10.48550/arXiv.1605.08803.
53. L. Dinh, D. Krueger, and Y. Bengio, “NICE: non-linear Independent Components Estimation,” Apr. 10, 2015, arXiv: arXiv:1410.8516. doi:10.48550/arXiv.1410.8516.
54. D.P. Kingma and P. Dhariwal, “Glow: generative Flow with Invertible 1×1 Convolutions,” Jul. 10, 2018, arXiv: arXiv:1807.03039. doi:10.48550/arXiv.1807.03039.
55. C. Durkan, A. Bekasov, I. Murray, and G. Papamakarios, “Neural Spline Flows,” Dec. 02, 2019, arXiv: arXiv:1906.04032. doi:10.48550/arXiv.1906.04032.
56. R. van den Berg, L. Hasenclever, J.M. Tomczak, and M. Welling, “Sylvester Normalizing Flows for Variational Inference,” Feb. 20, 2019, arXiv: arXiv:1803.05649. doi:10.48550/arXiv.1803.05649.
57. RockFlow: fast Generation of Synthetic Source Rock Images Using Generative Flow Models10.3390/en13246571 ↗
58. Reconstructing porous media using generative flow networks10.1016/j.cageo.2021.104905 ↗
59. End-to-end three-dimensional designing of complex disordered materials from limited data using machine learning10.1103/PhysRevE.106.055301 ↗
60. Neural ordinary differential equations
61. W. Grathwohl, R.T.Q. Chen, J. Bettencourt, I. Sutskever, and D. Duvenaud, “FFJORD: free-form Continuous Dynamics for Scalable Reversible Generative Models,” Oct. 22, 2018, arXiv: arXiv:1810.01367. doi:10.48550/arXiv.1810.01367.
62. C.-W. Huang, L. Dinh, and A. Courville, “Augmented Normalizing Flows: bridging the Gap Between Generative Flows and Latent Variable Models,” Feb. 17, 2020, arXiv: arXiv:2002.07101. doi:10.48550/arXiv.2002.07101.
63. Auto-encoders in deep learning—a review with new perspectives10.3390/math11081777 ↗
64. G. Yang, X. Huang, Z. Hao, M.-Y. Liu, S. Belongie, and B. Hariharan, “PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows,” Sep. 02, 2019, arXiv: arXiv:1906.12320. Accessed: Oct. 12, 2023. [Online]. Available: http://arxiv.org/abs/1906.12320.10.1109/ICCV.2019.00464 ↗
65. StyleFlow: attribute-conditioned exploration of StyleGAN-generated images using conditional continuous normalizing flows10.1145/3447648 ↗
66. D.P. Kingma and J. Ba, “Adam: a Method for Stochastic Optimization,” Jan. 29, 2017, arXiv: arXiv:1412.6980. doi: 10.48550/arXiv.1412.6980.
67. DeePore: a deep learning workflow for rapid and comprehensive characterization of porous materials10.1016/j.advwatres.2020.103787 ↗
68. Inverting the structure–property map of truss metamaterials by deep learning10.1073/pnas.2111505119 ↗
69. Rapid inverse design of metamaterials based on prescribed mechanical behavior through machine learning10.1038/s41467-023-40854-1 ↗
70. Obtaining auxetic and isotropic metamaterials in counterintuitive design spaces: an automated optimization approach and experimental characterization10.1038/s41524-023-01186-2 ↗
71. Machine learning-enabled constrained multi-objective design of architected materials10.1038/s41467-023-42415-y ↗