journal article·2022-03Open access

3D Grain Shape Generation in Polycrystals Using Generative Adversarial Networks

Devendra K. Jangid, Neal R. Brodnik, Amil Khan, Michael G. Goebel, McLean P. Echlin, Tresa M. Pollock, Samantha H. Daly, B. S. Manjunath

Abstract

This paper presents a generative adversarial network (GAN) capable of producing realistic microstructure morphology features and demonstrates its capabilities on a dataset of crystalline titanium grain shapes. Alongside this, we present an approach to train deep learning networks to understand material-specific descriptor features, such as grain shapes, based on existing conceptual relationships with established learning spaces, such as functional object shapes. A style-based GAN with Wasserstein loss, called M-GAN, was first trained to recognize distributions of morphology features from function objects in the ShapeNet dataset and was then applied to grain morphologies from a 3D crystallographic dataset of Ti–6Al–4V. Evaluation of feature recognition on objects showed comparable or better performance than state-of-the-art voxel-based network approaches. When applied to experimental data, M-GAN generated realistic grain morphologies comparable to those seen in Ti–6Al–4V. A quantitative comparison of moment invariant distributions showed that the generated grains were similar in shape and structure to the ground truth, but scale invariance learned from object recognition led to difficulty in distinguishing between the physical features of small grains and spatial resolution artifacts. The physical implications of M-GAN’s learning capabilities are discussed, as well as the extensibility of this approach to other material characteristics related to grain morphology.
Source: expertdata · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Machine Learning in Materials Science · Additive Manufacturing Materials and Processes · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (83)

Show source-provided references
1. National Research Council (2008) Integrated computational materials engineering: a transformational discipline for improved competitiveness and national security. The National Academies Press, Washington, DC. https://www.nap.edu/catalog/12199/integrated-computational-materials-engineering-a-transformational-discipline-for-improved-competitiveness
2. National Science and Technology Council (US) (2011) Materials genome initiative for global competitiveness. Executive Office of the President, National Science and Technology Council
3. Lu XG (2015) Remarks on the recent progress of materials genome initiative. Sci Bull 60(22):1966–1968. https://doi.org/10.1007/s11434-015-0937-210.1007/s11434-015-0937-2 ↗
4. M. I. I. M2I (2016) ICMEG: integrated computational materials engineering expert group. https://www.m2i.nl/portfolio-items/icmeg-integrated-computational-materials-engineering-expert-group/
5. Jain A, Persson KA, Ceder G (2016) Research update: the materials genome initiative: data sharing and the impact of collaborative ab initio databases. APL Mater 4(5):053102. https://doi.org/10.1063/1.494468310.1063/1.4944683 ↗
6. Draxl C, Scheffler M (2018) NOMAD: the FAIR concept for big-data-driven materials science. MRS Bul 43(9):676–68210.1557/mrs.2018.208 ↗
7. Pennekamp J, Glebke R, Henze M, Meisen T, Quix C, Hai R, Gleim L, Niemietz P, Rudack M, Knape S, Epple A, Trauth D, Vroomen U, Bergs T, Brecher C, Buhrig-Polaczek A, Jarke M, Wehrle K (2019) Towards an infrastructure enabling the internet of production. In: Proceedings of the 2019 IEEE international conference on industrial cyber physical systems, ICPS 201910.1109/ICPHYS.2019.8780276 ↗
8. Jensen DJ, Lauridsen EM, Margulies L, Poulsen HF, Schmidt S, Sørensen HO, Vaughan GB (2006) X-ray microscopy in four dimensions. Mater Today 9(1–2):18–2510.1016/S1369-7021(05)71334-1 ↗
9. Ludwig W, Reischig P, King A, Herbig M, Lauridsen EM, Johnson G, Marrow TJ (2009) Three-dimensional grain mapping by x-ray diffraction contrast tomography and the use of Friedel pairs in diffraction data analysis. Rev Sci Instrum 80(3):033905. https://doi.org/10.1063/1.310020010.1063/1.3100200 ↗
10. Poulsen H (2012) An introduction to three-dimensional X-ray diffraction microscopy. J Appl Crystal 45(6):1084–109710.1107/S0021889812039143 ↗
11. Echlin MP, Mottura A, Torbet CJ, Pollock TM (2012) A new TriBeam system for three-dimensional multimodal materials analysis. Rev Sci Instrum 83(2):023701. https://doi.org/10.1063/1.368011110.1063/1.3680111 ↗
12. Miller MP, Pagan DC, Beaudoin AJ, Nygren KE, Shadle DJ (2020) Understanding micromechanical material behavior using synchrotron X-rays and in situ loading. Metall Mater Trans A 51(9):4360–4376. https://doi.org/10.1007/s11661-020-05888-w10.1007/s11661-020-05888-w ↗
13. Hata S, Honda T, Saito H, Mitsuhara M, Petersen TC, Murayama M (2020) Electron tomography: an imaging method for materials deformation dynamics. Curr Opin Solid State Mater Sci 24(4):10085010.1016/j.cossms.2020.100850 ↗
14. Rowenhorst DJ, Nguyen L, Murphy-Leonard AD, Fonda RW (2020) Characterization of microstructure in additively manufactured 316L using automated serial sectioning. Curr Opin Solid State Mater Sci 24(3):10081910.1016/j.cossms.2020.100819 ↗
15. Chapman MG, Shah MN, Donegan SP, Scott JM, Shade PA, Menasche D, Uchic MD (2021) AFRL additive manufacturing modeling series: challenge 4, 3D reconstruction of an IN625 high-energy diffraction microscopy sample using multi-modal serial sectioning. Integr Mater Manuf Innov 10(2):129–141. https://doi.org/10.1007/s40192-021-00212-910.1007/s40192-021-00212-9 ↗
16. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ (eds) Advances in neural information processing systems, vol 27. Curran Associates Inc, New York, pp 2672–2680
17. Chaudhuri S, Kalogerakis E, Guibas L, Koltun V (2011) Probabilistic reasoning for assembly-based 3D modeling. ACM Trans Graph 30(4):110.1145/2010324.1964930 ↗
18. Funkhouser T, Kazhdan M, Shilane P, Min P, Kiefer W, Tal A, Rusinkiewicz S, Dobkin D (2004) Modeling by example. ACM Trans Graph 23(3):652–663. https://doi.org/10.1145/1015706.101577510.1145/1015706.1015775 ↗
19. Kalogerakis E, Chaudhuri S, Koller D, Koltun V (2012) A probabilistic model for component-based shape synthesis. ACM Trans Graph (TOG) 31(4):1–1110.1145/2185520.2185551 ↗
20. Wu Z, Song S, Khosla A, Fisher Y, Zhang L, Tang X, Xiao J (2015) 3D ShapeNets: a deep representation for volumetric shapes. Technical Report. http://3dshapenets.cs.princeton.edu
21. Choy CB, Xu D, Gwak J, Chen K, Savarese S (2016) 3d-r2n2: a unified approach for single and multi-view 3d object reconstruction. In: European conference on computer vision. Springer, pp 628–64410.1007/978-3-319-46484-8_38 ↗
22. Zhang X, Zhang Z, Zhang C, Tenenbaum JB, Freeman WT, Wu J (2018) Learning to reconstruct shapes from unseen classes. In: Proceedings of the 32nd international conference on neural information processing systems, series NIPS’18. Curran Associates Inc., Red Hook, pp 2263–2274
23. Wu J, Wang Y, Xue T, Sun X, Freeman B, Tenenbaum J (2017) Marrnet: 3d shape reconstruction via 2.5d sketches. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems, vol 30. Curran Associates Inc., New York, pp 540–550
24. Noguchi A, Harada T (2019) Rgbd-gan: unsupervised 3d representation learning from natural image datasets via rgbd image synthesis. arXiv:1909.12573
25. Nguyen-Phuoc T, Li C, Theis L, Richardt C, Yang YL (2019) Hologan: unsupervised learning of 3d representations from natural images. In: Proceedings of the IEEE international conference on computer vision, pp 7588–759710.1109/ICCV.2019.00768 ↗
26. Sharma A, Grau O, Fritz M (2016) Vconv-dae: deep volumetric shape learning without object labels. In: European conference on computer vision. Springer, pp 236–25010.1007/978-3-319-49409-8_20 ↗
27. Wu J, Zhang C, Xue T, Freeman B, Tenenbaum J (2016) Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In: Lee DD, Sugiyama M, Luxburg UV, Guyon I, Garnett R (eds) Advances in neural information processing systems, vol 29. Curran Associates Inc., New York, pp 82–90
28. Zhu J, Xie J, Fang Y (2018) Learning adversarial 3d model generation with 2d image enhancer. https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/1606410.1609/aaai.v32i1.12223 ↗
29. Coster M, Arnould X, Chermant J-L, Moataz AE, Chartier T (2005) A microstructural model by space tessellation for a sintered ceramic: cerine. Image Anal Stereol 24(2):10510.5566/ias.v24.p105-116 ↗
30. Johnson W, Mehl R (1939) Reaction kinetics in processes of nucleation and growth. Trans Metall Soc AIME 135:416–442
31. Avrami M (1939) Kinetics of phase change. I general theory. J Chem Phys 7(12):1103–111210.1063/1.1750380 ↗
32. Kolmogorov AN (1937) A statistical theory for the recrystallization of metals. Izvestiya Rossiiskoi Akademii Nauk, Seriya Matematicheskaya
33. Nosonovsky M, Zhang X, Esche SK (2009) Related content Scaling of Monte Carlo simulations of grain growth in metals. Modell Simul Mater Sci Eng 17:1–1310.1088/0965-0393/17/2/025004 ↗
34. Quey R, Dawson P, Barbe F (2011) Large-scale 3d random polycrystals for the finite element method: generation, meshing and remeshing. Comput Methods Appl Mech Eng 200(17–20):1729–174510.1016/j.cma.2011.01.002 ↗
35. Groeber MA, Jackson MA (2014) DREAM.3D: a digital representation environment for the analysis of microstructure in 3D. Integr Mater Manuf Innov 3(1):56–7210.1186/2193-9772-3-5 ↗
36. Callahan PG, Groeber M, De Graef M (2016) Towards a quantitative comparison between experimental and synthetic grain structures. Acta Mater 111:242–25210.1016/j.actamat.2016.03.078 ↗
37. Bapst V, Keck T, Grabska-Barwińska A, Donner C, Cubuk E, Schoenholz S, Obika A, Nelson A, Back T, Hassabis D, Kohli P (2020) Unveiling the predictive power of static structure in glassy systems. Nat Phys 16:448–45410.1038/s41567-020-0842-8 ↗
38. Cecen A, Dai H, Yabansu YC, Kalidindi SR, Song L (2018) Material structure-property linkages using three-dimensional convolutional neural networks. Acta Mater 146:76–8410.1016/j.actamat.2017.11.053 ↗
39. Bostanabad R, Bui AT, Xie W, Apley DW, Chen W (2016) Stochastic microstructure characterization and reconstruction via supervised learning. Acta Mater 103:89–10210.1016/j.actamat.2015.09.044 ↗
40. Li X, Yang Z, Brinson LC, Choudhary A, Agrawal A, Chen W (2018) A deep adversarial learning methodology for designing microstructural material systems. In: ASME 2018 international design engineering technical conferences and computers and information in engineering10.1115/DETC2018-85633 ↗
41. DeCost BL, Hecht MD, Francis T, Webler BA, Picard YN, Holm EA (2017) UHCSDB: ultrahigh carbon steel micrograph database. Integr Mater Manuf Innov 6(2):197–20510.1007/s40192-017-0097-0 ↗
42. DeCost BL, Francis T, Holm EA (2017) Exploring the microstructure manifold: image texture representations applied to ultrahigh carbon steel microstructures. Acta Mater 133:30–4010.1016/j.actamat.2017.05.014 ↗
43. Iyer A, Dey B, Dasgupta A, Chen W, Chakraborty A (2019) A conditional generative model for predicting material microstructures from processing methods. Technical Report
44. Fokina D, Muravleva E, Ovchinnikov G, Oseledets I (2020) Microstructure synthesis using style-based generative adversarial networks. Phys Rev E 101(4):04330810.1103/PhysRevE.101.043308 ↗
45. Cang R, Xu Y, Chen S, Liu Y, Jiao Y, Yi Ren M (2017) Microstructure representation and reconstruction of heterogeneous materials via deep belief network for computational material design. ASME J Mech Des 139(7):071404. https://doi.org/10.1115/1.403664910.1115/1.4036649 ↗
46. Torquato S (2002) Random heterogeneous materials, vol 16. Series interdisciplinary applied mathematics. Springer, New York. https://doi.org/10.1007/978-1-4757-6355-310.1007/978-1-4757-6355-3 ↗
47. Liu R, Kumar A, Chen Z, Agrawal A, Sundararaghavan V, Choudhary A (2015) A predictive machine learning approach for microstructure optimization and materials design. Nat Sci Rep 5(1):1–12
48. Hsu T, Epting WK, Kim H, Abernathy HW, Hackett GA, Rollett AD, Salvador PA, Holm EA (2021) Microstructure generation via generative adversarial network for heterogeneous, topologically complex 3D materials. JOM 73(1):90–102. https://doi.org/10.1007/s11837-020-04484-y10.1007/s11837-020-04484-y ↗
49. Bragg WH, Bragg WL (1913) The reflection of X-rays by crystals. Proc R Soc Lond Ser A Contain Pap Math Phys Charac 88(605):428–438
50. Humphreys FJ (1999) Quantitative metallography by electron backscattered diffraction. J Microsc 195(3):170–18510.1046/j.1365-2818.1999.00578.x ↗
51. Wilkinson AJ, Britton TB (2012) Strains, planes, and EBSD in materials science. Mater Today 15(9):366–37610.1016/S1369-7021(12)70163-3 ↗
52. Chen YH, Park SU, Wei D, Newstadt G, Jackson MA, Simmons JP, De Graef M, Hero AO (2015) A dictionary approach to electron backscatter diffraction indexing. Microsc Microanal 21(3):739–752. https://doi.org/10.1017/S143192761500075610.1017/S1431927615000756 ↗
53. Lenthe WC, Singh S, Graef MD (2019) A spherical harmonic transform approach to the indexing of electron back-scattered diffraction patterns. Ultramicroscopy 207:11284110.1016/j.ultramic.2019.112841 ↗
54. Ding Z, Pascal E, De Graef M (2020) Indexing of electron back-scatter diffraction patterns using a convolutional neural network. Acta Mater 199:370–38210.1016/j.actamat.2020.08.046 ↗
55. Kaufmann K, Lane H, Liu X, Vecchio KS (2021) Efficient few-shot machine learning for classification of EBSD patterns. Sci Rep 11(1):8172. https://doi.org/10.1038/s41598-021-87557-510.1038/s41598-021-87557-5 ↗
56. Karras T, Laine S, Aila T (2019) A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4401–441010.1109/CVPR.2019.00453 ↗
57. Lin Z, Khetan A, Fanti G, Oh S (2018) Pacgan: the power of two samples in generative adversarial networks. In: Advances in neural information processing systems, pp 1498–1507
58. Chang AX, Funkhouser T, Guibas L, Hanrahan P, Huang Q, Li Z, Savarese S, Savva M, Song S, Su H, et al (2015) Shapenet: an information-rich 3d model repository. arXiv:1512.03012
59. Hémery S, Naït-Ali A, Guéguen M, Wendorf J, Polonsky AT, Echlin MP, Stinville JC, Pollock TM, Villechaise P (2019) A 3D analysis of the onset of slip activity in relation to the degree of micro-texture in Ti-6Al-4V. Acta Mater 181:36–4810.1016/j.actamat.2019.09.028 ↗
60. Echlin MP, Straw M, Randolph S, Filevich J, Pollock TM (2015) The TriBeam system: femtosecond laser ablation in situ SEM. Mater Charact 100:1–12. https://doi.org/10.1016/j.matchar.2014.10.02310.1016/j.matchar.2014.10.023 ↗
61. Echlin MP, Stinville JC, Miller VM, Lenthe WC, Pollock TM (2016) Incipient slip and long range plastic strain localization in microtextured Ti-6Al-4V titanium. Acta Mater 114:164–17510.1016/j.actamat.2016.04.057 ↗
62. Chatterjee K, Echlin MP, Kasemer M, Callahan PG, Pollock TM, Dawson P (2018) Prediction of tensile stiffness and strength of Ti-6Al-4V using instantiated volume elements and crystal plasticity. Acta Mater 157:21–3210.1016/j.actamat.2018.07.011 ↗
63. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980
64. Arjovsky M, Chintala S, Bottou L (2017) Wasserstein gan. arXiv:1701.07875
65. Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of wasserstein gans. arXiv:1704.00028
66. MacSleyne JP, Simmons JP, Graef MD (2008) On the use of moment invariants for the automated analysis of 3D particle shapes. Modell Simul Mater Sci Eng 16(4):04500810.1088/0965-0393/16/4/045008 ↗
67. Kazhdan M, Funkhouser T, Rusinkiewicz S (2003) Rotation invariant spherical Harmonic representation of 3D shape descriptors. Technical Report
68. Trenkle A, Syha M, Rheinheimer W, Callahan PG, Nguyen L, Ludwig W, Lenthe W, Echlin MP, Pollock TM, Weygand D, Graef M, Hoffmann MJ, Gumbsch P (2020) Nondestructive evaluation of 3D microstructure evolution in strontium titanate. J Appl Crystallogr 53(2):349–35910.1107/S160057672000093X ↗
69. Maturana D, Scherer S (2015) Voxnet: a 3d convolutional neural network for real-time object recognition. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 922–92810.1109/IROS.2015.7353481 ↗
70. Sinha A, Bai J, Ramani K (2016) Deep learning 3d shape surfaces using geometry images. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision – ECCV 2016. Springer, Cham. https://doi.org/10.1007/978-3-319-46466-4_1410.1007/978-3-319-46466-4_14 ↗
71. Qi CR, Su H, Mo K, Guibas LJ (2017) Pointnet: deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 652–660
72. Bai S, Bai X, Zhou Z, Zhang Z, Jan Latecki L (2016) Gift: a real-time and scalable 3d shape search engine. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5023–503210.1109/CVPR.2016.543 ↗
73. Hegde V, Zadeh R (2016) Fusionnet: 3d object classification using multiple data representations. arXiv:1607.05695
74. Kobbelt L, Schrder P, Kazhdan M, Funkhouser T, Rusinkiewicz S (2003) Rotation invariant spherical harmonic representation of 3d shape descriptors. In: Proceedings of the 2003 Eurographics, vol. 43
75. Chen DY, Tian XP, Shen YT, Ouhyoung M (2003) On visual similarity based 3d model retrieval. In: Computer graphics forum, vol 22, no. 3. Wiley, pp. 223–23210.1111/1467-8659.00669 ↗
76. Wang Z, Chen J, Hoi SCH (2020) Deep learning for image super-resolution: a survey. Technical Report
77. Lin CH, Lee HY, Cheng YC, Tulyakov S, Yang MH (2021) InfinityGAN: towards infinite-resolution image synthesis. arXiv:2104.03963
78. Gey N, Bocher P, Uta E, Germain L, Humbert M (2012) Texture and microtexture variations in a near-$$\alpha $$ titanium forged disk of bimodal microstructure. Acta Mater 60(6–7):2647–265510.1016/j.actamat.2012.01.031 ↗
79. Pilchak AL, Szczepanski CJ, Shaffer JA, Salem AA, Semiatin SL (2013) Characterization of microstructure, texture, and microtexture in near-alpha titanium mill products. Metall Mater Trans A 44(11):4881–4890. https://doi.org/10.1007/s11661-013-1804-x10.1007/s11661-013-1804-x ↗
80. Semiatin SL (2020) An overview of the thermomechanical processing of $$\alpha $$/$$\beta $$ titanium alloys: current status and future research opportunities. Metall Mater Trans A 51(6):2593–2625. https://doi.org/10.1007/s11661-020-05625-310.1007/s11661-020-05625-3 ↗
81. Dehoff RR, Kirka MM, List FA, Unocic KA, Sames WJ (2014) Crystallographic texture engineering through novel melt strategies via electron beam melting: Inconel 718. Mater Sci Technol 31(8):939–944. https://doi.org/10.1179/1743284714Y.000000069710.1179/1743284714Y.0000000697 ↗
82. Polonsky AT, Raghavan N, Echlin MP, Kirka MM, Dehoff RR, Pollock TM (2020) 3D characterization of the columnar-to-equiaxed transition in additively manufactured inconel 718. Miner Met Mater Ser. https://doi.org/10.1007/978-3-030-51834-9_9710.1007/978-3-030-51834-9_97 ↗
83. Murray SP, Pusch KM, Polonsky AT, Torbet CJ, Seward GGE, Zhou N, Forsik SAJ, Nandwana P, Kirka MM, Dehoff RR, Slye WE, Pollock TM (2020) A defect-resistant Co-Ni superalloy for 3D printing. Nat Commun 11(1):1–1110.1038/s41467-019-13993-7 ↗