Comparison and validation of stochastic microstructure characterization and reconstruction: Machine learning vs. deep learning methodologies
Source abstract
Abstract
In the world of computational materials science, the knowledge of microstructure is vital in understanding the process-microstructure–property linkage across various length-scales. To circumvent costly experimental characterizations, typically, analyses on ensembles of 3D microstructures within a numerical framework are preferred. Utilizing a moment invariants-based physical descriptor, the current work quantifies the variations in the microstructural topology of 3D synthetic data of polycrystalline materials. For the first time, the validation of synthetic microstructures based on two unique AI-based reconstruction approaches was compared, providing valuable insights into the diverse characteristics of each methodology. Virtual 3D microstructure volumes of forged Ti-7Al and additively manufactured 316L stainless steel alloys were generated from 2D experimental data using two methods — Markov Random Field (MRF) and deep learning-based volumetric texture synthesis. Quantitative evaluation and validation of the reconstructed volumes were carried out with the aid of moment invariants by comparing local features associated with grain-level properties, such as grain size and shape. The normalized central moments previously employed to compare 2D grain topology were expanded to 3D. With the advent of various reconstruction algorithms, especially AI-based, the validation methodology outlined in this work can be adopted to evaluate the robustness of various 3D reconstruction frameworks as well as ensure spatial equivalency of the target microstructures.
Source: expertdata · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Machine Learning in Materials Science · Electron and X-Ray Spectroscopy Techniques · Advanced X-ray and CT Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (96)
Show source-provided references
1. Reconstructing random media10.1103/PhysRevE.57.495 ↗
2. A reconstruction technique for three-dimensional porous media using image analysis and Fourier transforms10.1016/S0920-4105(98)00077-1 ↗
3. 3D numerical reconstruction of well-connected porous structure of rock using fractal algorithms10.1016/j.cma.2014.06.035 ↗
4. Statistical reconstruction of two-phase random media10.1016/j.compstruc.2013.03.019 ↗
5. A multiple-point statistics algorithm for 3D pore space reconstruction from 2D images10.1016/j.advwatres.2011.06.003 ↗
6. Reconstruction of 3D porous media using multiple-point statistics based on a 3D training image10.1016/j.jngse.2017.12.032 ↗
7. 3D stochastic modelling of heterogeneous porous media–applications to reservoir rocks10.1007/s11242-006-0006-z ↗
8. Machine learning in additive manufacturing: State-of-the-art and perspectives
9. Two-stage 2D-to-3D reconstruction of realistic microstructures: Implementation and numerical validation by effective properties10.1016/j.cma.2023.116098 ↗
10. Efficient reconstruction and validation of heterogeneous microstructures for energy applications10.1002/er.8578 ↗
11. A transfer learning approach for microstructure reconstruction and structure-property predictions10.1038/s41598-018-31571-7 ↗
12. Computational microstructure characterization and reconstruction for stochastic multiscale material design10.1016/j.cad.2012.03.007 ↗
13. Stochastic 3D microstructure reconstruction and mechanical modeling of anisotropic battery separators10.1016/j.jpowsour.2019.05.021 ↗
14. Markov random field based microstructure reconstruction using the principal image moments10.1016/j.matchar.2021.111281 ↗
15. A Markov random field approach for microstructure synthesis10.1088/0965-0393/24/3/035015 ↗
16. On demand solid texture synthesis using deep 3D networks10.1111/cgf.13889 ↗
17. Random heterogeneous materials via texture synthesis10.1016/j.commatsci.2014.12.017 ↗
18. Reconstruction of three-dimensional anisotropic microstructures from two-dimensional micrographs imaged on orthogonal planes10.1186/s40192-014-0019-3 ↗
19. Statistical construction of 3-D microstructures from 2-D exemplars collected on oblique sections10.1016/j.actamat.2015.09.011 ↗
20. Comparison of microstructure characterization methods by two-point correlation functions and reconstruction of 3D microstructures using 2D TEM images with high degree of phase clustering10.1016/j.matchar.2021.110876 ↗
21. Texture synthesis and nonparametric resampling of random fields10.1214/009053606000000588 ↗
22. An introduction to the Ising model10.1080/00029890.1987.12000742 ↗
23. Polycrystalline microstructure reconstruction using Markov random fields and histogram matching10.1016/j.cad.2019.102806 ↗
24. Large-scale synthesis of metal additively-manufactured microstructures using markov random fields10.1016/j.commatsci.2022.111228 ↗
25. Exploring the microstructure manifold: image texture representations applied to ultrahigh carbon steel microstructures10.1016/j.actamat.2017.05.014 ↗
26. Inferring low-dimensional microstructure representations using convolutional neural networks10.1103/PhysRevE.96.052111 ↗
27. Reconstruction of 3D microstructures from 2D images via transfer learning10.1016/j.cad.2020.102906 ↗
28. An efficient optimization based microstructure reconstruction approach with multiple loss functions10.1016/j.commatsci.2021.110709 ↗
29. H. Zhang, T. Xu, H. Li, S. Zhang, X. Wang, X. Huang, D.N. Metaxas, Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks, in: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 5907–5915.10.1109/ICCV.2017.629 ↗
30. Learning to generate chairs, tables and cars with convolutional networks
31. Zhao · 2021
32. Gramgan: Deep 3D texture synthesis from 2D exemplars
33. Stochastic reconstruction of 3D microstructures from 2D cross-sectional images using machine learning-based characterization10.1016/j.cma.2021.114532 ↗
34. Microstructure representation and reconstruction of heterogeneous materials via deep belief network for computational material design10.1115/1.4036649 ↗
35. A deep adversarial learning methodology for designing microstructural material systems
36. Simonyan · 2014
37. A large-scale hierarchical image database10.1109/CVPR.2009.5206848 ↗
38. D.R. Peachey, Solid texturing of complex surfaces, in: Proceedings of the 12th Annual Conference on Computer graphics and Interactive Techniques, 1985, pp. 279–286.10.1145/325334.325246 ↗
39. An image synthesizer10.1145/325165.325247 ↗
40. Solid texture synthesis from 2D exemplars
41. Solid-texture synthesis: A survey10.1109/MCG.2009.153 ↗
42. High quality solid texture synthesis using position and index histogram matching10.1007/s00371-009-0408-3 ↗
43. Synthesising 3d solid models of natural heterogeneous materials from single sample image, using encoding deep convolutional generative adversarial networks
44. Generating three-dimensional structures from a two-dimensional slice with generative adversarial network-based dimensionality expansion10.1038/s42256-021-00322-1 ↗
45. Slice-to-voxel stochastic reconstructions on porous media with hybrid deep generative model10.1016/j.commatsci.2020.110018 ↗
46. Reconstruction of tricalcium silicate microstructures for repeating unit cell analysis
47. Zhao · 2022
48. 3D solid digital and numerical modeling of multimineral heterogeneous rocks based on deep learning10.1007/s40948-022-00495-y ↗
49. Multiscale modeling of reconstructed tricalcium silicate using NASA multiscale analysis tool
50. Unlocking the potential: analyzing 3D microstructure of small-scale cement samples from space using deep learning10.1038/s41526-024-00349-9 ↗
51. Generative adversarial nets
52. Reconstruction, optimization, and design of heterogeneous materials and media: Basic principles, computational algorithms, and applications10.1016/j.physrep.2021.09.003 ↗
53. Reconstruction of three-dimensional porous media using generative adversarial neural networks10.1103/PhysRevE.96.043309 ↗
54. Generating three-dimensional structures from a two-dimensional slice with generative adversarial network-based dimensionality expansion10.1038/s42256-021-00322-1 ↗
55. Cascaded progressive generative adversarial networks for reconstructing three-dimensional grayscale core images from a single two-dimensional image
56. Microstructure generation via generative adversarial network for heterogeneous, topologically complex 3D materials10.1007/s11837-020-04484-y ↗
57. Microstructural materials design via deep adversarial learning methodology10.1115/1.4041371 ↗
58. Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics10.1016/j.cma.2022.115497 ↗
59. Cascaded progressive generative adversarial networks for reconstructing three-dimensional grayscale core images from a single two-dimensional image
60. Accelerating multi-point statistics reconstruction method for porous media via deep learning10.1016/j.actamat.2018.08.026 ↗
61. Generative adversarial network (GAN) enabled statistically equivalent virtual microstructures (SEVM) for modeling cold spray formed bimodal polycrystals10.1038/s41524-024-01219-4 ↗
62. 3D grain shape generation in polycrystals using generative adversarial networks10.1007/s40192-021-00244-1 ↗
63. Evaluation of mode collapse in generative adversarial networks
64. Metz · 2016
65. Arjovsky · 2017
66. DA-VEGAN: Differentiably Augmenting VAE-GAN for microstructure reconstruction from extremely small data sets10.1016/j.commatsci.2023.112661 ↗
67. Microstructure reconstruction of 2D/3D random materials via diffusion-based deep generative models10.1038/s41598-024-54861-9 ↗
68. Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models10.1109/TPAMI.2021.3116668 ↗
69. Coupled generative adversarial and auto-encoder neural networks to reconstruct three-dimensional multi-scale porous media10.1016/j.petrol.2019.106794 ↗
70. Slice-to-voxel stochastic reconstructions on porous media with hybrid deep generative model10.1016/j.commatsci.2020.110018 ↗
71. Preparation of ordered states in ultra-cold gases using bayesian optimization10.1088/1367-2630/ab8677 ↗
72. Data-science-based reconstruction of 3-D membrane pore structure using a single 2-D micrograph10.1016/j.memsci.2023.121673 ↗
73. Raßloff · 2024
74. Inverse design of dual-phase steel microstructures using generative machine learning model and Bayesian optimization10.1016/j.ijplas.2023.103776 ↗
75. A Bayesian view on cryo-EM structure determination10.1016/j.jmb.2011.11.010 ↗
76. RELION: implementation of a Bayesian approach to cryo-EM structure determination10.1016/j.jsb.2012.09.006 ↗
77. Clement · 2019
78. Bayesian reconstruction of magnetic resonance images using Gaussian processes10.1038/s41598-023-39533-4 ↗
79. Conditional diffusion-based microstructure reconstruction
80. Microstructure reconstruction using diffusion-based generative models
81. Predictive microstructure image generation using denoising diffusion probabilistic models10.1016/j.actamat.2023.119406 ↗
82. Digital polycrystalline microstructure generation using diffusion probabilistic models10.1016/j.mtla.2023.101976 ↗
83. Microstructure reconstruction of 2D/3D random materials via diffusion-based deep generative models10.1038/s41598-024-54861-9 ↗
84. Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs10.1016/j.cma.2024.116876 ↗
85. Stochastic microstructure characterization and reconstruction via supervised learning10.1016/j.actamat.2015.09.044 ↗
86. Uncertainty quantification of metallic microstructures using principal image moments10.1016/j.commatsci.2022.111775 ↗
87. Three-dimensional analysis of secondary γ′ precipitates in René-88 DT and UMF-20 superalloys10.1016/j.actamat.2009.08.053 ↗
88. Towards a quantitative comparison between experimental and synthetic grain structures10.1016/j.actamat.2016.03.078 ↗
89. High quality solid texture synthesis using position and index histogram matching10.1007/s00371-009-0408-3 ↗
90. On the use of 2D moment invariants in the classification of additive manufacturing powder feedstock10.1016/j.matchar.2019.01.019 ↗
91. On the use of 2-D moment invariants for the automated classification of particle shapes10.1016/j.actamat.2007.09.039 ↗
92. On the use of moment invariants for the automated analysis of 3D particle shapes10.1088/0965-0393/16/4/045008 ↗
93. Texture synthesis using convolutional neural networks
94. Kingma · 2015
95. Visual pattern recognition by moment invariants10.1109/TIT.1962.1057692 ↗
96. Computational characterization and model verification for 3D microstructure reconstruction of additively manufactured materials