journal article·2023-11-06Open access

SEMPro: A Data-Driven Pipeline To Learn Structure–Property Insights from Scanning Electron Microscopy Images

Brandon Ho, Jiayu Zhao, Joseph Liu, Lisa Tang, Zhecun Guan, Xiao Li, Minghao Li, Elizabeth Howard, Rebecca Wheeler, Jinhye Bae

ACS Materials Letters· Volume 5· Issue 11

Abstract

Analyzing hydrogel microstructure through scanning electron microscopy (SEM) images is crucial in understanding hydrogel properties. However, the analysis of SEM images in hydrogel research heavily relies on the intuition of individual researchers and is constrained by the limited size of the dataset. To address this, we propose SEMPro, a data-driven solution using web-scraping and deep learning (DL) to compile and analyze the structure-property relationships of hydrogels through SEM images. It accurately predicts the elastic modulus from SEM images within the same order of magnitude and displays a learned extraction of modulus-relevant features in SEM images as seen through the nontrivial activation mapping and transfer learning. By employing Explainable AI through activation map exposure, SEMPro validates the model predictions. SEMPro represents a closed-loop data collection and analysis pipeline, providing critical insights into hydrogels and soft materials. This innovative approach has the potential to revolutionize hydrogel research, offering high-dimensional insights for further advancements.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Hydrogels: synthesis, properties, applications · Optical Imaging and Spectroscopy Techniques · Advanced Sensor and Energy Harvesting Materials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, California 92093, United States

Department of NanoEngineering, University of California San Diego, La Jolla, California 92093, United States

Chemical Engineering Program, University of California San Diego, La Jolla, California 92093, United States

Material Science and Engineering Program, University of California San Diego, La Jolla, California 92093, United States

Funding

National Science Foundation

References (48)

Show source-provided references
1. 10.1016/j.mattod.2019.12.02610.1016/j.mattod.2019.12.026 ↗
2. 10.1016/j.snb.2010.03.08310.1016/j.snb.2010.03.083 ↗
3. 10.1038/natrevmats.2016.7110.1038/natrevmats.2016.71 ↗
4. 10.1007/s10439-022-02955-810.1007/s10439-022-02955-8 ↗
5. 10.3390/ma1220332310.3390/ma12203323 ↗
6. 10.1016/j.jare.2017.01.00510.1016/j.jare.2017.01.005 ↗
7. 10.1179/1743280413Y.000000002210.1179/1743280413Y.0000000022 ↗
8. 10.1038/s41578-018-0018-710.1038/s41578-018-0018-7 ↗
9. 10.1016/j.trac.2020.11613010.1016/j.trac.2020.116130 ↗
10. 10.1016/j.isci.2021.10317410.1016/j.isci.2021.103174 ↗
11. 10.1088/2053-1591/acb98e10.1088/2053-1591/acb98e ↗
12. 10.1002/term.2410.1002/term.24 ↗
13. 10.1002/adhm.20170092710.1002/adhm.201700927 ↗
14. 10.1016/j.actbio.2010.07.02810.1016/j.actbio.2010.07.028 ↗
15. 10.1002/adma.20030490710.1002/adma.200304907 ↗
16. 10.1038/nature1140910.1038/nature11409 ↗
17. 10.1126/science.abg632010.1126/science.abg6320 ↗
18. 10.1002/1521-4095(20020816)14:16<1120::AID-ADMA1120>3.0.CO;2-910.1002/1521-4095(20020816)14:16<1120::AID-ADMA1120>3.0.CO;2-9 ↗
19. 10.1002/polb.2391210.1002/polb.23912 ↗
20. 10.1002/adfm.20220015710.1002/adfm.202200157 ↗
21. 10.1039/D2NR05408F10.1039/D2NR05408F ↗
22. 10.1038/nmat371310.1038/nmat3713 ↗
23. 10.1017/S143192760003024510.1017/S1431927600030245 ↗
24. 10.1021/acsami.7b1353410.1021/acsami.7b13534 ↗
25. 10.1038/s41524-022-00734-610.1038/s41524-022-00734-6 ↗
26. 10.1016/j.commatsci.2021.11036010.1016/j.commatsci.2021.110360 ↗
27. 10.3390/a1402005110.3390/a14020051 ↗
28. O’Shea K. · arXiv · 2015
29. 10.1016/j.actbio.2017.09.02510.1016/j.actbio.2017.09.025 ↗
30. 10.1016/j.jfoodeng.2022.11101410.1016/j.jfoodeng.2022.111014 ↗
31. 10.1002/advs.20190080810.1002/advs.201900808 ↗
32. 10.1007/s40192-017-0097-010.1007/s40192-017-0097-0 ↗
33. 10.1038/sdata.2018.17210.1038/sdata.2018.172 ↗
34. 10.1045/september2016-meschenmoser10.1045/september2016-meschenmoser ↗
35. 10.1021/acs.jcim.9b0073410.1021/acs.jcim.9b00734 ↗
36. 10.1021/acs.chemmater.7b0350010.1021/acs.chemmater.7b03500 ↗
37. 10.1016/j.matdes.2022.11070010.1016/j.matdes.2022.110700 ↗
38. 10.1021/acscentsci.9b0080410.1021/acscentsci.9b00804 ↗
39. 10.1038/s41467-021-26921-510.1038/s41467-021-26921-5 ↗
40. VCU Natural Language Processing Lab. PaperScraper, 2020.
41. Richardson, L. Beautiful soup documentation; available via the Internet at: https://beautiful-soup-4.readthedocs.io/en/latest/.
42. 10.48550/arXiv.1506.0264010.48550/arXiv.1506.02640 ↗
43. Bradski G. · Dr. Dobb’s J. Softw. Tools · 2000 · 25 · 120
44. Xie, S.; Girschick, R.; Dollár, P.; Tu, Z.; He, K. Aggregated Residual Transformations for Deep Neural Networks. In The IEEE Conference on Computer Vision and Pattern Recognition, 2017; pp 1492–1500.10.1109/CVPR.2017.634 ↗
45. Yang Y. · 2021 · 11842
46. 10.1039/C9PY01934K10.1039/C9PY01934K ↗
47. Gildenblat, J. PyTorch Library for CAM Methods, 2021. Available online: https://github.com/jacobgil/pytorchgrad-cam.
48. 10.1002/adma.20160348310.1002/adma.201603483 ↗