SEMPro: A Data-Driven Pipeline To Learn Structure–Property Insights from Scanning Electron Microscopy Images
Source abstract
Abstract
Analyzing hydrogel microstructure through scanning electron microscopy (SEM) images is crucial in understanding hydrogel properties. However, the analysis of SEM images in hydrogel research heavily relies on the intuition of individual researchers and is constrained by the limited size of the dataset. To address this, we propose SEMPro, a data-driven solution using web-scraping and deep learning (DL) to compile and analyze the structure-property relationships of hydrogels through SEM images. It accurately predicts the elastic modulus from SEM images within the same order of magnitude and displays a learned extraction of modulus-relevant features in SEM images as seen through the nontrivial activation mapping and transfer learning. By employing Explainable AI through activation map exposure, SEMPro validates the model predictions. SEMPro represents a closed-loop data collection and analysis pipeline, providing critical insights into hydrogels and soft materials. This innovative approach has the potential to revolutionize hydrogel research, offering high-dimensional insights for further advancements.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Hydrogels: synthesis, properties, applications · Optical Imaging and Spectroscopy Techniques · Advanced Sensor and Energy Harvesting Materials
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, California 92093, United States
Department of NanoEngineering, University of California San Diego, La Jolla, California 92093, United States
Chemical Engineering Program, University of California San Diego, La Jolla, California 92093, United States
Material Science and Engineering Program, University of California San Diego, La Jolla, California 92093, United States
Funding
National Science Foundation
References (48)
Show source-provided references
1. 10.1016/j.mattod.2019.12.02610.1016/j.mattod.2019.12.026 ↗
2. 10.1016/j.snb.2010.03.08310.1016/j.snb.2010.03.083 ↗
3. 10.1038/natrevmats.2016.7110.1038/natrevmats.2016.71 ↗
4. 10.1007/s10439-022-02955-810.1007/s10439-022-02955-8 ↗
5. 10.3390/ma1220332310.3390/ma12203323 ↗
6. 10.1016/j.jare.2017.01.00510.1016/j.jare.2017.01.005 ↗
7. 10.1179/1743280413Y.000000002210.1179/1743280413Y.0000000022 ↗
8. 10.1038/s41578-018-0018-710.1038/s41578-018-0018-7 ↗
9. 10.1016/j.trac.2020.11613010.1016/j.trac.2020.116130 ↗
10. 10.1016/j.isci.2021.10317410.1016/j.isci.2021.103174 ↗
11. 10.1088/2053-1591/acb98e10.1088/2053-1591/acb98e ↗
12. 10.1002/term.2410.1002/term.24 ↗
13. 10.1002/adhm.20170092710.1002/adhm.201700927 ↗
14. 10.1016/j.actbio.2010.07.02810.1016/j.actbio.2010.07.028 ↗
15. 10.1002/adma.20030490710.1002/adma.200304907 ↗
16. 10.1038/nature1140910.1038/nature11409 ↗
17. 10.1126/science.abg632010.1126/science.abg6320 ↗
18. 10.1002/1521-4095(20020816)14:16<1120::AID-ADMA1120>3.0.CO;2-910.1002/1521-4095(20020816)14:16<1120::AID-ADMA1120>3.0.CO;2-9 ↗
19. 10.1002/polb.2391210.1002/polb.23912 ↗
20. 10.1002/adfm.20220015710.1002/adfm.202200157 ↗
21. 10.1039/D2NR05408F10.1039/D2NR05408F ↗
22. 10.1038/nmat371310.1038/nmat3713 ↗
23. 10.1017/S143192760003024510.1017/S1431927600030245 ↗
24. 10.1021/acsami.7b1353410.1021/acsami.7b13534 ↗
25. 10.1038/s41524-022-00734-610.1038/s41524-022-00734-6 ↗
26. 10.1016/j.commatsci.2021.11036010.1016/j.commatsci.2021.110360 ↗
27. 10.3390/a1402005110.3390/a14020051 ↗
28. O’Shea K. · arXiv · 2015
29. 10.1016/j.actbio.2017.09.02510.1016/j.actbio.2017.09.025 ↗
30. 10.1016/j.jfoodeng.2022.11101410.1016/j.jfoodeng.2022.111014 ↗
31. 10.1002/advs.20190080810.1002/advs.201900808 ↗
32. 10.1007/s40192-017-0097-010.1007/s40192-017-0097-0 ↗
33. 10.1038/sdata.2018.17210.1038/sdata.2018.172 ↗
34. 10.1045/september2016-meschenmoser10.1045/september2016-meschenmoser ↗
35. 10.1021/acs.jcim.9b0073410.1021/acs.jcim.9b00734 ↗
36. 10.1021/acs.chemmater.7b0350010.1021/acs.chemmater.7b03500 ↗
37. 10.1016/j.matdes.2022.11070010.1016/j.matdes.2022.110700 ↗
38. 10.1021/acscentsci.9b0080410.1021/acscentsci.9b00804 ↗
39. 10.1038/s41467-021-26921-510.1038/s41467-021-26921-5 ↗
40. VCU Natural Language Processing Lab. PaperScraper, 2020.
41. Richardson, L. Beautiful soup documentation; available via the Internet at: https://beautiful-soup-4.readthedocs.io/en/latest/.
42. 10.48550/arXiv.1506.0264010.48550/arXiv.1506.02640 ↗
43. Bradski G. · Dr. Dobb’s J. Softw. Tools · 2000 · 25 · 120
44. Xie, S.; Girschick, R.; Dollár, P.; Tu, Z.; He, K. Aggregated Residual Transformations for Deep Neural Networks. In The IEEE Conference on Computer Vision and Pattern Recognition, 2017; pp 1492–1500.10.1109/CVPR.2017.634 ↗
45. Yang Y. · 2021 · 11842
46. 10.1039/C9PY01934K10.1039/C9PY01934K ↗
47. Gildenblat, J. PyTorch Library for CAM Methods, 2021. Available online: https://github.com/jacobgil/pytorchgrad-cam.
48. 10.1002/adma.20160348310.1002/adma.201603483 ↗