journal article·2022-03Open access

Deep Learning Unlocks X‐ray Microtomography Segmentation of Multiclass Microdamage in Heterogeneous Materials

Reed Kopp, Joshua Joseph, Xinchen Ni, Nicholas Roy, Brian L. Wardle

Advanced Materials· Volume 34· Issue 11

Abstract

Abstract Four‐dimensional quantitative characterization of heterogeneous materials using in situ synchrotron radiation computed tomography can reveal 3D sub‐micrometer features, particularly damage, evolving under load, leading to improved materials. However, dataset size and complexity increasingly require time‐intensive and subjective semi‐automatic segmentations. Here, the first deep learning (DL) convolutional neural network (CNN) segmentation of multiclass microscale damage in heterogeneous bulk materials is presented, teaching on advanced aerospace‐grade composite damage using ≈65 000 (trained) human‐segmented tomograms. The trained CNN machine segments complex and sparse (<<1% of volume) composite damage classes to ≈99.99% agreement, unlocking both objectivity and efficiency, with nearly 100% of the human time eliminated, which traditional rule‐based algorithms do not approach. The trained machine is found to perform as well or better than the human due to “machine‐discovered” human segmentation error, with machine improvements manifesting primarily as new damage discovery and segmentation augmentation/extension in artifact‐rich tomograms. Interrogating a high‐level network hyperparametric space on two material configurations, DL is found to be a disruptive approach to quantitative structure–property characterization, enabling high‐throughput knowledge creation (accelerated by two orders of magnitude) via generalizable, ultrahigh‐resolution feature segmentation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Advanced X-ray and CT Imaging · Rock Mechanics and Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Aeronautics and Astronautics Massachusetts Institute of Technology 77 Massachusetts Avenue Cambridge MA 02139 USA

MIT Quest for Intelligence Massachusetts Institute of Technology 77 Massachusetts Avenue Cambridge MA 02139 USA

Department of Mechanical Engineering Massachusetts Institute of Technology 77 Massachusetts Avenue Cambridge MA 02139 USA

Funding

Army Research Laboratory

References (88)

Show source-provided references
1. 10.1002/adma.20180220110.1002/adma.201802201 ↗
2. 10.1038/s41563-018-0184-410.1038/s41563-018-0184-4 ↗
3. 10.1146/annurev-matsci-070218-01013410.1146/annurev-matsci-070218-010134 ↗
4. 10.1038/nnano.2016.26210.1038/nnano.2016.262 ↗
5. 10.1038/nmat468710.1038/nmat4687 ↗
6. 10.1080/21663831.2017.134320810.1080/21663831.2017.1343208 ↗
7. 2003
8. Ashby M. · 2007
9. 10.1016/j.pmatsci.2018.05.00510.1016/j.pmatsci.2018.05.005 ↗
10. 10.1016/j.compositesb.2014.12.01110.1016/j.compositesb.2014.12.011 ↗
11. 10.1126/science.115391110.1126/science.1153911 ↗
12. 10.1038/s41565-018-0141-z10.1038/s41565-018-0141-z ↗
13. 10.1126/science.aay903310.1126/science.aay9033 ↗
14. 10.1126/science.aat743910.1126/science.aat7439 ↗
15. 10.1146/annurev-matsci-070909-10451710.1146/annurev-matsci-070909-104517 ↗
16. 10.1038/natrevmats.2017.8210.1038/natrevmats.2017.82 ↗
17. 10.1038/natrevmats.2016.710.1038/natrevmats.2016.7 ↗
18. 10.1016/j.pmatsci.2015.02.00310.1016/j.pmatsci.2015.02.003 ↗
19. 10.1038/nmat311510.1038/nmat3115 ↗
20. 10.1016/j.pmatsci.2020.10067210.1016/j.pmatsci.2020.100672 ↗
21. 10.1038/srep3552310.1038/srep35523 ↗
22. 10.1002/advs.20190350110.1002/advs.201903501 ↗
23. 10.1016/j.pmatsci.2017.04.00510.1016/j.pmatsci.2017.04.005 ↗
24. 10.1038/s41586-019-1736-810.1038/s41586-019-1736-8 ↗
25. 10.1016/j.pmatsci.2017.08.00310.1016/j.pmatsci.2017.08.003 ↗
26. 10.1016/j.addma.2017.01.00310.1016/j.addma.2017.01.003 ↗
27. 10.1038/nmat133910.1038/nmat1339 ↗
28. 10.1002/adma.20170653910.1002/adma.201706539 ↗
29. 10.1038/nmat408910.1038/nmat4089 ↗
30. 10.1038/s41563-019-0565-310.1038/s41563-019-0565-3 ↗
31. 10.1038/nmat165010.1038/nmat1650 ↗
32. 10.1016/j.mser.2017.01.00210.1016/j.mser.2017.01.002 ↗
33. 10.1038/s41563-019-0402-810.1038/s41563-019-0402-8 ↗
34. 10.1038/nmat462510.1038/nmat4625 ↗
35. 10.1126/science.113162410.1126/science.1131624 ↗
36. 10.1002/adma.20110168310.1002/adma.201101683 ↗
37. Cunningham J. · Eng. Mater. · 2015 · 32
38. 10.1557/mrs.2015.27810.1557/mrs.2015.278 ↗
39. 2004
40. 10.1038/nmat470610.1038/nmat4706 ↗
41. 10.1016/j.compstruct.2019.03.02110.1016/j.compstruct.2019.03.021 ↗
42. 10.1016/j.compositesa.2014.04.01010.1016/j.compositesa.2014.04.010 ↗
43. 10.1016/j.engfracmech.2017.07.02710.1016/j.engfracmech.2017.07.027 ↗
44. 10.1016/j.compscitech.2017.10.02310.1016/j.compscitech.2017.10.023 ↗
45. 10.1179/1743280413Y.000000002310.1179/1743280413Y.0000000023 ↗
46. 10.1038/s41467-019-11521-110.1038/s41467-019-11521-1 ↗
47. 10.1007/978-3-319-99465-9_610.1007/978-3-319-99465-9_6 ↗
48. 10.1016/j.cossms.2020.10083410.1016/j.cossms.2020.100834 ↗
49. 10.1179/174328406X11411710.1179/174328406X114117 ↗
50. 10.1029/2009WR00808710.1029/2009WR008087 ↗
51. 10.1016/j.procs.2016.09.36610.1016/j.procs.2016.09.366 ↗
52. 10.1016/j.compositesa.2019.10554310.1016/j.compositesa.2019.105543 ↗
53. 10.1016/j.compscitech.2013.10.02210.1016/j.compscitech.2013.10.022 ↗
54. Goodfellow I. · 2016
55. Sejnowski T. J. · Proc. Natl. Acad. Sci. USA · 2020
56. 10.1109/TKDE.2017.272016810.1109/TKDE.2017.2720168 ↗
57. 10.1038/s41529-018-0058-x10.1038/s41529-018-0058-x ↗
58. 10.1146/annurev-matsci-082019-10510010.1146/annurev-matsci-082019-105100 ↗
59. 10.1038/s41586-018-0337-210.1038/s41586-018-0337-2 ↗
60. 10.1146/annurev-matsci-110519-09470010.1146/annurev-matsci-110519-094700 ↗
61. 10.1038/s41524-019-0172-510.1038/s41524-019-0172-5 ↗
62. 10.1039/D0MH01451F10.1039/D0MH01451F ↗
63. Long J. · 2015 · 3431
64. Ronneberger O. · 2015 · 234
65. Jegou S. · 2017 · 1175
66. 10.1017/S143192761900274510.1017/S1431927619002745 ↗
67. 10.1038/s41592-018-0261-210.1038/s41592-018-0261-2 ↗
68. 10.1038/s41592-018-0106-z10.1038/s41592-018-0106-z ↗
69. 10.1093/bioinformatics/btx18010.1093/bioinformatics/btx180 ↗
70. 10.1038/s42256-019-0099-z10.1038/s42256-019-0099-z ↗
71. 10.1371/journal.pone.018105910.1371/journal.pone.0181059 ↗
72. 10.1016/j.conbuildmat.2020.11918510.1016/j.conbuildmat.2020.119185 ↗
73. 10.1063/1.494058510.1063/1.4940585 ↗
74. 10.1007/s10853-020-05148-710.1007/s10853-020-05148-7 ↗
75. 10.1007/s10462-020-09854-110.1007/s10462-020-09854-1 ↗
76. Kopp R. · 2019
77. 10.1016/j.compositesb.2021.10862310.1016/j.compositesb.2021.108623 ↗
78. 10.1007/s11831-018-9291-210.1007/s11831-018-9291-2 ↗
79. Simonyan K. · arXiv: 1409.1556 · 2014
80. 10.1016/j.compscitech.2010.04.01210.1016/j.compscitech.2010.04.012 ↗
81. 10.1016/j.scriptamat.2008.07.03410.1016/j.scriptamat.2008.07.034 ↗
82. 10.1016/j.nimb.2013.09.03010.1016/j.nimb.2013.09.030 ↗
83. 10.1107/S160057751601019510.1107/S1600577516010195 ↗
84. Kopp R. · 2021
85. 10.1016/j.compscitech.2020.10813210.1016/j.compscitech.2020.108132 ↗
86. P.Yakubovskiy GitHub repository 2019 https://github.com/qubvel/segmentation_models.2019.
87. 10.1093/bioinformatics/btt27610.1093/bioinformatics/btt276 ↗
88. R.Kopp J.Joseph X.Ni N.Roy B. L.Wardle Data from “Deep Learning Unlocks X‐ray Microtomography Segmentation of Multiclass Microdamage in Heterogeneous Materials” in Dryad2021 https://doi.org/10.5061/dryad.ffbg79cwb.10.1002/adma.202107817 ↗