journal article·2023-12Open access

Predictive microstructure image generation using denoising diffusion probabilistic models

Erfan Azqadan, Hamid Jahed, Arash Arami

Acta Materialia· Volume 261

Abstract

The rapid progress in artificial intelligence (AI) based image generation led to groundbreaking achievements, like OpenAI's DALL-E 2, showcasing state-of-the-art generative models in deep learning and computer vision. Recently, the Denoising Diffusion Probabilistic Model (DDPM) has emerged as a strong contender, excelling in generating high-resolution images with complex features similar to those found in real-world images. In this study, we investigate DDPM's potential as both generator and predictor of scanning electron microscope (SEM) images, encompassing both known and unseen microstructural conditions. To rigorously evaluate DDPM, we curated a comprehensive dataset comprising 27 distinct cast-forged AZ80 magnesium alloy components with varied process parameters and microstructure features. Some conditions were held back during training to test DDPM's predictive abilities for unseen scenarios. Our study demonstrates the model's remarkable capacity to capture the inherent physical relationships between process parameters and microstructure features. We scrutinize the synthesized images alongside real-world SEM counterparts, undertaking a comprehensive analysis of various morphological properties. Remarkably, the results show the model's performance, with an average error of 6.36% ± 0.42 for measured microstructural properties in seen conditions and an equally impressive 6.67% ± 0.85 for unseen conditions. This study envisions a transformative shift in materials science, as advanced AI predictive models offer new potential to streamline the laborious process of microstructure image generation.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Corrosion Behavior and Inhibition · Aluminum Alloy Microstructure Properties

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (56)

Show source-provided references
1. Deep unsupervised learning using nonequilibrium thermodynamics
2. Hierarchical text-conditional image generation with clip latents
3. Machine learning approach for identification of microstructure–process linkages10.2514/1.J058244 ↗
4. Large set microstructure reconstruction mimicking quantum computing approach via deep learning10.1016/j.actamat.2022.117860 ↗
5. Neural networks in materials science10.2355/isijinternational.39.966 ↗
6. Materials discovery and design using machine learning
7. Exploring the microstructure manifold: image texture representations applied to ultrahigh carbon steel microstructures10.1016/j.actamat.2017.05.014 ↗
8. Thermodynamic phase-field model for microstructure with multiple components and phases: the possibility of metastable phases10.1103/PhysRevE.83.061602 ↗
9. A new finite element strategy to simulate microstructural evolutions10.1016/j.commatsci.2019.109335 ↗
10. Phase-field modeling of microstructure evolution: recent applications, perspectives and challenges10.1016/j.pmatsci.2021.100810 ↗
11. A coupled kinetic Monte Carlo–finite element mesoscale model for thermoelastic martensitic phase transformations in shape memory alloys10.1016/j.actamat.2014.10.011 ↗
12. Unraveling the mesoscale evolution of microstructure during supersonic impact of aluminum powder particles10.1038/s41598-018-28437-3 ↗
13. Deep learning for synthetic microstructure generation in a materials-by-design framework for heterogeneous energetic materials10.1038/s41598-020-70149-0 ↗
14. Predicting the tensile behaviour of cast alloys by a pattern recognition analysis on experimental data10.3390/met9050557 ↗
15. Property prediction and properties-to-microstructure inverse analysis of steels by a machine-learning approach10.1016/j.msea.2018.12.049 ↗
16. Accelerating multi-point statistics reconstruction method for porous media via deep learning10.1016/j.actamat.2018.08.026 ↗
17. Learning two-phase microstructure evolution using neural operators and autoencoder architectures10.1038/s41524-022-00876-7 ↗
18. Microstructure recognition using convolutional neural networks for prediction of ionic conductivity in ceramics10.1016/j.actamat.2017.09.004 ↗
19. Advanced steel microstructural classification by deep learning methods10.1038/s41598-018-20037-5 ↗
20. Multi-column deep neural networks for image classification
21. Resolution enhancement in scanning electron microscopy using deep learning10.1038/s41598-019-48444-2 ↗
22. Deep learning microscopy10.1364/OPTICA.4.001437 ↗
23. A conditional generative model for predicting material microstructures from processing methods
24. Microstructure generation via generative adversarial network for heterogeneous, topologically complex 3D materials10.1007/s11837-020-04484-y ↗
25. Exploration of optimal microstructure and mechanical properties in continuous microstructure space using a variational autoencoder10.1016/j.matdes.2021.109544 ↗
26. Microstructure reconstruction using diffusion-based generative models
27. Conditional diffusion-based microstructure reconstruction
28. Synthesizing controlled microstructures of porous media using generative adversarial networks and reinforcement learning
29. Virtual microstructure design for steels using generative adversarial networks
30. M. Arjovsky, S. Chintala, L. Bottou, "Wasserstein GAN," arXiv preprint, p. arXiv:1701.07875; 10.48550/arXiv.1701.07875., 2017.
31. Improved training of Wasserstein Gans
32. Catastrophic forgetting and mode collapse in GANs
33. A hybrid of statistical and conditional generative adversarial neural network approaches for reconstruction of 3D porous media (ST-CGAN)10.1016/j.advwatres.2021.104064 ↗
34. Combating mode collapse in GAN training: an empirical analysis using Hessian Eigenvalues
35. AVAE: adversarial variational auto encoder
36. Towards deeper understanding of variational autoencoding models
37. Quantification of similarity and physical awareness of microstructures generated via generative models10.1016/j.commatsci.2023.112074 ↗
38. Denoising diffusion probabilistic models
39. Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
40. Mechanical MNIST: a benchmark dataset for mechanical metamodels10.1016/j.eml.2020.100659 ↗
41. PyTorch image quality: metrics for image quality assessment
42. A study of deep perceptual metrics for image quality assessment
43. GANs trained by a two time-scale update rule converge to a local Nash equilibrium
44. Rethinking the inception architecture for computer vision
45. The effect of cooling rate and degassing on microstructure and mechanical properties of cast AZ80 magnesium alloy10.1016/j.msea.2022.143176 ↗
46. Effect of temperature on the hot deformation behavior of AZ80 magnesium alloy10.1016/j.msea.2020.139923 ↗
47. Low-cycle fatigue characterization and texture induced ratcheting behaviour of forged AZ80 Mg alloys10.1016/j.ijfatigue.2018.06.028 ↗
48. A survey on generative diffusion model
49. Improved denoising diffusion probabilistic models
50. U-Net: convolutional networks for biomedical image segmentation
51. Self-attention generative adversarial networks
52. Attention is all you need
53. M. Seitzer, "pytorch-fid: FID score for PyTorch," GitHub Version 0.2: https://github.com/mseitzer/pytorch-fid, 2020.
54. UHCSDB: ultraHigh carbon steel micrograph database10.1007/s40192-017-0097-0 ↗
55. Hardness variation in cast-forging process of AZ80 magnesium alloys and its data-driven prediction
56. Texture evolution of five wrought magnesium alloys during route A equal channel angular extrusion: experiments and simulations10.1016/j.actamat.2005.02.019 ↗