journal article·2018-09Open access

Perspectives on the Impact of Machine Learning, Deep Learning, and Artificial Intelligence on Materials, Processes, and Structures Engineering

Dennis M. Dimiduk, Elizabeth A. Holm, Stephen R. Niezgoda

Abstract

The fields of machining learning and artificial intelligence are rapidly expanding, impacting nearly every technological aspect of society. Many thousands of published manuscripts report advances over the last 5 years or less. Yet materials and structures engineering practitioners are slow to engage with these advancements. Perhaps the recent advances that are driving other technical fields are not sufficiently distinguished from long-known informatics methods for materials, thereby masking their likely impact to the materials, processes, and structures engineering (MPSE). Alternatively, the diverse nature and limited availability of relevant materials data pose obstacles to machine-learning implementation. The glimpse captured in this overview is intended to draw focus to selected distinguishing advances, and to show that there are opportunities for these new technologies to have transformational impacts on MPSE. Further, there are opportunities for the MPSE fields to contribute understanding to the emerging machine-learning tools from a physics basis. We suggest that there is an immediate need to expand the use of these new tools throughout MPSE, and to begin the transformation of engineering education that is necessary for ongoing adoption of the methods.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Mineral Processing and Grinding · Electron and X-Ray Spectroscopy Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (100+)

Show source-provided references
1. Jardine P (2018) A reinforcement learning approach to predictive control design: autonomous vehicle applications. PhD thesis, Queens University, Kingston
2. Li L, Ota K, Dong M (2018) Human-like driving: empirical decision-making system for autonomous vehicles. IEEE Transactions on Vehicular Technology10.1109/TVT.2018.2822762 ↗
3. Redding JD, Johnson LB, Levihn M, Meuleau NF, Brechtel S (2018) Decision making for autonomous vehicle motion control. US Patent App 15:713,326
4. National Research Council Defense Materials Manufacturing and Infrastructure Standing Committee (2014) Big data in materials research and development: summary of a workshop. National Academies Press, Washington
5. Warren J, Boisvert RF (2012) Building the materials innovation infrastructure: data and standards. US Department of Commerce, Washington. https://doi.org/10.6028/NIST.IR.789810.6028/NIST.IR.7898 ↗
6. National Research Council Committee on Integrated Computational Materials Engineering (2008) Integrated computational materials engineering: a transformational discipline for improved competitiveness and national security. National Academies Press, Washington
7. The Minerals, Metals & Materials Society (2013) Integrated computational materials engineering (ICME): implementing ICME in the aerospace, automotive, and maritime industries TMS, Warrendale, PA
8. National Science and Technology Council Committee on Technology Subcommittee on the Materials Genome Initiative (2011) Materials Genome Initiative for global competitiveness. National Science and Technology Council, Washington, DC. https://www.mgi.gov/sites/default/files/documents/materials_genome_initiative-final.pdf
9. National Science and Technology Council Committee on Technology Subcommittee on the Materials Genome Initiative (2014) Materials Genome Initiative strategic plan. National Science and Technology Council, Washington, DC. http://www.whitehouse.gov/sites/default/files/microsites/ostp/NSTC/mgi_strategic_plan_-_dec_2014.pdf
10. Jordan MI, Mitchell TM (2015) Machine learning: trends, perspectives, and prospects. Science 349 (6245):255–26010.1126/science.aaa8415 ↗
11. Jones N (2014) The learning machines. Nature 505(7482):14610.1038/505146a ↗
12. Metz R (2015) Deep learning squeezed onto a phone. https://www.technologyreview.com/s/534736/deep-learning-squeezed-onto-a-phone/ . Accessed 28 June 2018
13. Silva DF, De Souza VM, Batista GE, Keogh E, Ellis DP (2013) Applying machine learning and audio analysis techniques to insect recognition in intelligent traps. In: 2013 12th international conference on machine learning and applications (ICMLA), vol 1. IEEE, pp 99–10410.1109/ICMLA.2013.24 ↗
14. Li K, JC Príncipe (2017) Automatic insect recognition using optical flight dynamics modeled by kernel adaptive arma network. In: 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2726–273010.1109/ICASSP.2017.7952652 ↗
15. Vincent J (2017) Google uses deepmind AI to cut data center energy bills. https://www.theverge.com/2016/7/21/12246258/google-deepmind-ai-data-center-cooling . Accessed 28 June 2018
16. Johnson BD (2017) Brave new road. Mech Eng 139(3):3010.1115/1.2017-Mar-1 ↗
17. Sowmya G, Srikanth J (2017) Automatic weed detection and smart herbicide spray robot for corn fields. Int J Sci Eng Technol Res 6(1):131–137
18. Wu Y, Schuster M, Chen Z, Le QV, Norouzi M, Macherey W, Krikun M, Cao Y, Gao Q, Macherey K et al (2016) Google’s neural machine translation system: bridging the gap between human and machine translation. arXiv: 160908144
19. Lewis-Kraus G (2016) The great AI awakening. The New York Times Magazine, pp 1–37
20. Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484–48910.1038/nature16961 ↗
21. Moravčík M, Schmid M, Burch N, Lisỳ V, Morrill D, Bard N, Davis T, Waugh K, Johanson M, Bowling M (2017) Deepstack: expert-level artificial intelligence in heads-up no-limit poker. Science 356(6337):508–51310.1126/science.aam6960 ↗
22. Brown N, Sandholm T (2017) Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science. http://science.sciencemag.org/content/early/2017/12/15/science.aao1733 . https://doi.org/10.1126/science.aao173310.1126/science.aao1733 ↗
23. Gibbs S (2017) Alphazero AI beats champion chess program after teaching itself in four hours. https://www.theguardian.com/technology/2017/dec/07/alphazero-google-deepmind-ai-beats-champion-program-teaching-itself-to-play-four-hours . Accessed 28 June 2018
24. Le QV, Ranzato M, Monga R, Devin M, Chen K, Corrado GS, Dean J, Ng AY (2012) Building high-level features using large scale unsupervised learning. arXiv: 11126209v510.1109/ICASSP.2013.6639343 ↗
25. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):43610.1038/nature14539 ↗
26. Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A et al (2017) Mastering the game of go without human knowledge. Nature 550(7676):35410.1038/nature24270 ↗
27. Hutson M (2017) AI glossary: artificial intelligence, in so many words. Science 357(6346):19. https://doi.org/10.1126/science.357.6346.1910.1126/science.357.6346.19 ↗
28. MacKay DJ (2003) Information theory, inference and learning algorithms. Cambridge University Press, Cambridge
29. Schmidt M, Lipson H (2009) Distilling free-form natural laws from experimental data. Science 324 (5923):81–8510.1126/science.1165893 ↗
30. Dhar V (2013) Data science and prediction. Commun ACM 56(12):64–7310.1145/2500499 ↗
31. Rudy SH, Brunton SL, Proctor JL, Kutz JN (2017) Data-driven discovery of partial differential equations. Science Advances 3(4):e1602,61410.1126/sciadv.1602614 ↗
32. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–50710.1126/science.1127647 ↗
33. Kiser M (2017) Why deep learning matters and whats next for artificial intelligence. https://www.linkedin.com/pulse/why-deep-learning-matters-whats-next-artificial-matt-kiser . Accessed 28 June 2018
34. Real E, Moore S, Selle A, Saxena S, Suematsu YL, Le Q, Kurakin A (2017) Large-scale evolution of image classifiers. arXiv: 170301041
35. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):11510.1038/nature21056 ↗
36. Johnson R (2015) Microsoft, Google beat humans at image recognition. EE Times
37. Smith G (2017) Google brain chief: AI tops humans in computer vision, and healthcare will never be the same. Silicon Angle
38. Artetxe M, Labaka G, Agirre E, Cho K (2017) Unsupervised neural machine translation. arXiv: 171011041
39. He K, Gkioxari G, Dollár P, Girshick RB (2017) Mask R-CNN. arXiv: 1703.0687010.1109/ICCV.2017.322 ↗
40. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
41. Li Y (2017) Deep reinforcement learning: an overview. arXiv: 170107274
42. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–11710.1016/j.neunet.2014.09.003 ↗
43. Baltrusaitis T, Ahuja C, Morency L (2017) Multimodal machine learning: a survey and taxonomy. arXiv: 1705.09406
44. Lample G, Denoyer L, Ranzato M (2017) Unsupervised machine translation using monolingual corpora only. arXiv: 171100043
45. Shrivastava A, Pfister T, Tuzel O, Susskind J, Wang W, Webb R (2016) Learning from simulated and unsupervised images through adversarial training. arXiv: 161207828
46. Masi I, Tran AT, Hassner T, Leksut JT, Medioni G (2016) Do we really need to collect millions of faces for effective face recognition?. In: European conference on computer vision. Springer, pp 579–59610.1007/978-3-319-46454-1_35 ↗
47. King RD, Rowland J, Oliver SG, Young M, Aubrey W, Byrne E, Liakata M, Markham M, Pir P, Soldatova LN et al (2009) The automation of science. Science 324(5923):85–8910.1126/science.1165620 ↗
48. Sparkes A, Aubrey W, Byrne E, Clare A, Khan MN, Liakata M, Markham M, Rowland J, Soldatova LN, Whelan KE et al (2010) Towards robot scientists for autonomous scientific discovery. Automated Experimentation 2(1):110.1186/1759-4499-2-1 ↗
49. Raccuglia P, Elbert KC, Adler PD, Falk C, Wenny MB, Mollo A, Zeller M, Friedler SA, Schrier J, Norquist AJ (2016) Machine-learning-assisted materials discovery using failed experiments. Nature 533(7601):7310.1038/nature17439 ↗
50. Nosengo N, et al. (2016) The material code. Nature 533(7601):22–2510.1038/533022a ↗
51. Nikolaev P, Hooper D, Perea-Lopez N, Terrones M, Maruyama B (2014) Discovery of wall-selective carbon nanotube growth conditions via automated experimentation. ACS Nano 8(10):10,214–10,22210.1021/nn503347a ↗
52. Nikolaev P, Hooper D, Webber F, Rao R, Decker K, Krein M, Poleski J, Barto R, Maruyama B (2016) Autonomy in materials research: a case study in carbon nanotube growth. npj Comput Mater 2:16,03110.1038/npjcompumats.2016.31 ↗
53. Oses C, Toher C, Curtarolo S (2018) Autonomous data-driven design of inorganic materials with AFLOW. arXiv: 1803.05035
54. Zhang Y, Godaliyadda G, Ferrier N, Gulsoy EB, Bouman CA, Phatak C (2018) Slads-net: supervised learning approach for dynamic sampling using deep neural networks. arXiv: 18030297210.2352/ISSN.2470-1173.2018.15.COIMG-131 ↗
55. Kraus OZ, Grys BT, Ba J, Chong Y, Frey BJ, Boone C, Andrews BJ (2017) Automated analysis of high-content microscopy data with deep learning. Mol Syst Biol 13(4):924. https://doi.org/10.15252/msb.20177551 . http://msb.embopress.org/content/13/4/924.full.pdf10.15252/msb.20177551 ↗
56. Jiang YG, Wu Z, Wang J, Xue X, Chang SF (2018) Exploiting feature and class relationships in video categorization with regularized deep neural networks. IEEE Trans Pattern Anal Mach Intell 40(2):352–364. https://doi.org/10.1109/TPAMI.2017.267056010.1109/TPAMI.2017.2670560 ↗
57. Dhanaraj K, Kannan R (2018) Capitalizing the collective knowledge for video annotation refinement using dynamic weighted voting. International Journal for Research in Science Engineering & Technology, p 4
58. Kaspar A, Patterson G, Kim C, Aksoy Y, Matusik W, Elgharib MA (2018) Crowd-guided ensembles: how can we choreograph crowd workers for video segmentation?. In: CHI’18 Proceedings of the 2018 CHI conference on human factors in computing systems, Paper No. 111. Montreal QC, Canada. April 21–26, 2018 ACM New York, NY, USA Ⓒ2018 table of contents ISBN: 978-1-4503-5620-6. https://doi.org/10.1145/3173574.317368510.1145/3173574.3173685 ↗
59. Wang K, Guo Z, Sha W, Glicksman M, Rajan K (2005) Property predictions using microstructural modeling. Acta Materialia 53(12):3395–340210.1016/j.actamat.2005.03.041 ↗
60. Fullwood DT, Niezgoda SR, Adams BL, Kalidindi SR (2010) Microstructure sensitive design for performance optimization. Prog Mater Sci 55(6):477–56210.1016/j.pmatsci.2009.08.002 ↗
61. Niezgoda SR, Kanjarla AK, Kalidindi SR (2013) Novel microstructure quantification framework for databasing, visualization, and analysis of microstructure data. Integ Mater Manuf Innov 2(1):310.1186/2193-9772-2-3 ↗
62. Liu R, Kumar A, Chen Z, Agrawal A, Sundararaghavan V, Choudhary A (2015) A predictive machine learning approach for microstructure optimization and materials design. Scientific Reports 5:11,55110.1038/srep11551 ↗
63. Xu H, Liu R, Choudhary A, Chen W (2015) A machine learning-based design representation method for designing heterogeneous microstructures. J Mech Des 137(5):051,40310.1115/1.4029768 ↗
64. Kalidindi SR, Brough DB, Li S, Cecen A, Blekh AL, Congo FYP, Campbell C (2016) Role of materials data science and informatics in accelerated materials innovation. MRS Bull 41(8):596–60210.1557/mrs.2016.164 ↗
65. Rajan K (2015) Materials informatics: the materials gene and big data. Annu Rev Mater Res 45:153–16910.1146/annurev-matsci-070214-021132 ↗
66. Reddy N, Krishnaiah J, Young HB, Lee JS (2015) Design of medium carbon steels by computational intelligence techniques. Comput Mater Sci 101:120–12610.1016/j.commatsci.2015.01.031 ↗
67. Oliynyk AO, Adutwum LA, Harynuk JJ, Mar A (2016) Classifying crystal structures of binary compounds AB through cluster resolution feature selection and support vector machine analysis. Chem Mater 28 (18):6672–668110.1021/acs.chemmater.6b02905 ↗
68. Seshadri R, Sparks TD (2016) Perspective: interactive material property databases through aggregation of literature data. APL Mater 4(5):053,20610.1063/1.4944682 ↗
69. Sparks TD, Gaultois MW, Oliynyk A, Brgoch J, Meredig B (2016) Data mining our way to the next generation of thermoelectrics. Scr Mater 111:10–1510.1016/j.scriptamat.2015.04.026 ↗
70. Oliynyk AO, Antono E, Sparks TD, Ghadbeigi L, Gaultois MW, Meredig B, Mar A (2016) High-throughput machine-learning-driven synthesis of full-Heusler compounds. Chem Mater 28(20):7324–733110.1021/acs.chemmater.6b02724 ↗
71. Citrine Informatics Inc (2017) Citrine Informatics inc. https://citrine.io/ . Accessed 28 June 2018
72. Brough DB, Wheeler D, Kalidindi SR (2017) Materials knowledge systems in python a data science framework for accelerated development of hierarchical materials. Integ Mater Manuf Innov 6(1):36–5310.1007/s40192-017-0089-0 ↗
73. Materials Resources LLC (2017) Materials resources LLC. http://www.icmrl.net/ . Accessed 28 June 2018
74. BlueQuartz Software LLC (2017) Bluequartz Software, LLC. http://www.bluequartz.net/ . Accessed 28 June 2018
75. Liu X, Furrer D, Kosters J, Holmes J (2018) Vision 2040: a roadmap for integrated, multiscale modeling and simulation of materials and systems. Tech rep NASA. https://ntrs.nasa.gov/search.jsp?R=20180002010 . Accessed 28 June 2018
76. Ghaboussi J, Garrett J Jr, Wu X (1991) Knowledge-based modeling of material behavior with neural networks. J Eng Mech 117(1):132–15310.1061/(ASCE)0733-9399(1991)117:1(132) ↗
77. Haj-Ali R, Pecknold DA, Ghaboussi J, Voyiadjis GZ (2001) Simulated micromechanical models using artificial neural networks. J Eng Mech 127(7):730–73810.1061/(ASCE)0733-9399(2001)127:7(730) ↗
78. Lefik M, Boso D, Schrefler B (2009) Artificial neural networks in numerical modelling of composites. Comput Methods Appl Mech Eng 198(21-26):1785–180410.1016/j.cma.2008.12.036 ↗
79. Schooling J, Brown M, Reed P (1999) An example of the use of neural computing techniques in materials science the modelling of fatigue thresholds in Ni-base superalloys. Mat Sci Eng: A 260(1-2):222–23910.1016/S0921-5093(98)00957-5 ↗
80. Yun GJ, Ghaboussi J, Elnashai AS (2008a) A new neural network-based model for hysteretic behavior of materials. Int J Numer Methods Eng 73(4):447–46910.1002/nme.2082 ↗
81. Yun GJ, Ghaboussi J, Elnashai AS (2008b) Self-learning simulation method for inverse nonlinear modeling of cyclic behavior of connections. Comput Methods Appl Mech Eng 197(33-40):2836–285710.1016/j.cma.2008.01.021 ↗
82. Oishi A, Yamada K, Yoshimura S, Yagawa G (1995) Quantitative nondestructive evaluation with ultrasonic method using neural networks and computational mechanics. Comput Mech 15(6):521–53310.1007/BF00350265 ↗
83. Ghaboussi J, Joghataie A (1995) Active control of structures using neural networks. J Eng Mech 121 (4):555–56710.1061/(ASCE)0733-9399(1995)121:4(555) ↗
84. Bani-Hani K, Ghaboussi J (1998) Nonlinear structural control using neural networks. J Eng Mech 124 (3):319–32710.1061/(ASCE)0733-9399(1998)124:3(319) ↗
85. Pei JS, Smyth AW (2006) New approach to designing multilayer feedforward neural network architecture for modeling nonlinear restoring forces. II: applications. J Eng Mech 132(12):1301–131210.1061/(ASCE)0733-9399(2006)132:12(1301) ↗
86. Singh V, Willcox KE (2017) Methodology for path planning with dynamic data-driven flight capability estimation. AIAA J, pp 1–1210.2514/1.J055551 ↗
87. Yun GJ, Saleeb A, Shang S, Binienda W, Menzemer C (2011) Improved selfsim for inverse extraction of nonuniform, nonlinear, and inelastic material behavior under cyclic loadings. J Aerosp Eng 25(2):256–27210.1061/(ASCE)AS.1943-5525.0000114 ↗
88. Yun GJ (2017) Integration of experiments and simulations to build material big-data. In: Proceedings of the 4th world congress on integrated computational materials engineering (ICME 2017). Springer, pp 123–13010.1007/978-3-319-57864-4_12 ↗
89. Farrokh M, Dizaji MS, Joghataie A (2015) Modeling hysteretic deteriorating behavior using generalized Prandtl neural network. J Eng Mech 141(8):04015,02410.1061/(ASCE)EM.1943-7889.0000925 ↗
90. Wang B, Zhao W, Du Y, Zhang G, Yang Y (2016) Prediction of fatigue stress concentration factor using extreme learning machine. Comput Mater Sci 125:136–14510.1016/j.commatsci.2016.08.035 ↗
91. Versino D, Tonda A, Bronkhorst CA (2017) Data driven modeling of plastic deformation. Comput Methods Appl Mech Eng 318:981–100410.1016/j.cma.2017.02.016 ↗
92. Nutonian (2017) Nutonian. https://www.nutonian.com/products/eureqa// . Accessed 28 June 2018
93. Bessa M, Bostanabad R, Liu Z, Hu A, Apley DW, Brinson C, Chen W, Liu WK (2017) A framework for data-driven analysis of materials under uncertainty: countering the curse of dimensionality. Comput Methods Appl Mech Eng 320:633–66710.1016/j.cma.2017.03.037 ↗
94. DeCost BL, Francis T, Holm EA (2017) Exploring the microstructure manifold: image texture representations applied to ultrahigh carbon steel microstructures. Acta Mater 133:30–4010.1016/j.actamat.2017.05.014 ↗
95. DeCost BL, Holm EA (2015) A computer vision approach for automated analysis and classification of microstructural image data. Comput Mater Sci 110:126–13310.1016/j.commatsci.2015.08.011 ↗
96. Adachi Y, Taguchi M, Hirokawa S (2016) Microstructure recognition by deep learning. Tetsu To Hangne-Journal of the Iron and Steel Institute of Japan 102(12):722–729. https://doi.org/10.2355/tetsutohagane.TETSU-2016-03510.2355/tetsutohagane.TETSU-2016-035 ↗
97. Adachi Y, Taguchi S, Kohkawa S (2016) Microstructure recognition by deep learning. Tetsu-to-Hagane 102(12):722–72910.2355/tetsutohagane.TETSU-2016-035 ↗
98. Chowdhury A, Kautz E, Yener B, Lewis D (2016) Image driven machine learning methods for microstructure recognition. Comput Mater Sci 123:176–18710.1016/j.commatsci.2016.05.034 ↗
99. DeCost BL, Hecht MD, Francis T, Picard YN, Webler BA, Holm EA (2017) UHCSDB: UltraHigh carbon steel micrograph database. Integ Mater Manuf Innov 6:97–205
100. DeCost BL, Holm EA (2017) Characterizing powder materials using keypoint-based computer vision methods. Comput Mater Sci 126:438–44510.1016/j.commatsci.2016.08.038 ↗