Deep Learning-Based Layer Identification of 2D Nanomaterials
Source abstract
Abstract
Two-dimensional (2D) nanomaterials exhibit unique properties due to their low dimensionality, which has led to great potential for applications in biopharmaceuticals, aerospace, energy storage, mobile communications and other fields. Today, 2D nanomaterials are often prepared and exfoliated by a combination of mechanical and manual methods, which makes the production of 2D nanomaterials inefficient and prevents standardized and industrialized manufacturing. Recent breakthroughs in semantic segmentation techniques based on deep learning have enabled the accurate identification and segmentation of atomic layers of 2D nanomaterials using optical microscopy. In this study, we analyzed in detail sixteen semantic segmentation models that perform well on public datasets and apply them to the layer identification and segmentation of graphene and molybdenum disulfide. Furthermore, we improved the U2-Net† model to obtain the best overall performance, namely 2DU2-Net†. The accuracy of the 2DU2-Net† model was 99.03%, the kappa coefficient was 95.72%, the dice coefficient was 96.97%, and the average cross–merge ratio was 94.18%. Meanwhile, it also had good performance in terms of computation, number of parameters, inference speed and generalization ability. The results show that deep learning-based semantic segmentation methods can greatly improve efficiency and replace most manual operations, and different types of semantic segmentation methods can be adapted to different properties of 2D nanomaterials, thus promoting the research and application of 2D nanomaterials.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Graphene and Nanomaterials Applications · Ferroelectric and Negative Capacitance Devices
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Changchun Normal University, Changchun 130032, China
Funding
National Natural Science Foundation of China · Joint fund of Science & Technology Department of Liaoning Province and State Key Laboratory of Robotics, China · Changchun Normal University Graduate Research Innovation Project
References (78)
Show source-provided references
1. Electric Field Effect in Atomically Thin Carbon Films10.1126/science.1102896 ↗
2. Layer-Number Dependent Optical Properties of 2D Materials and Their Application for Thickness Determination10.1002/adfm.201604468 ↗
3. Vacancy Engineering for Tuning Electron and Phonon Structures of Two-Dimensional Materials10.1002/aenm.201600436 ↗
4. Two-Dimensional Materials for Thermal Management Applications10.1016/j.joule.2018.01.006 ↗
5. Probing magnetism in 2D materials at the nanoscale with single-spin microscopy10.1126/science.aav6926 ↗
6. Bending Stiffness of Circular Multilayer van der Waals Material Sheets10.1115/1.4053494 ↗
7. Preparation of 2D material dispersions and their applications10.1039/C8CS00254A ↗
8. Synthesis and chemistry of elemental 2 D materials10.1038/s41570-016-0014 ↗
9. Chemistry, Functionalization, and Applications of Recent Monoelemental Two-Dimensional Materials and Their Heterostructures10.1021/acs.chemrev.1c00165 ↗
10. Electronics and optoelectronics of two-dimensional transition metal dichalcogenides10.1038/nnano.2012.193 ↗
11. Ferroelectric chalcogenides—Materials at the edge10.1126/science.aaf9081 ↗
12. The world of two-dimensional carbides and nitrides (MXenes)10.1126/science.abf1581 ↗
13. Functionalized hexagonal boron nitride nanomaterials: Emerging properties and applications10.1039/C5CS00869G ↗
14. High electron mobility and quantum oscillations in non-encapsulated ultrathin semiconducting Bi2O2Se10.1038/nnano.2017.43 ↗
15. Two-dimensional biomaterials: Material science, biological effect and biomedical engineering applications10.1039/D0CS01138J ↗
16. Radiation tolerance of two-dimensional material-based devices for space applications10.1038/s41467-019-09219-5 ↗
17. Hierarchical Ni–Co Hydroxide Petals on Mechanically Robust Graphene Petal Foam for High-Energy Asymmetric Supercapacitors10.1002/adfm.201600879 ↗
18. Transistors based on two-dimensional materials for future integrated circuits10.1038/s41928-021-00670-1 ↗
19. 2D Materials Enabled Next-Generation Integrated Optoelectronics: From Fabrication to Applications10.1002/advs.202003834 ↗
20. Rapid and reliable thickness identification of two-dimensional nanosheets using optical microscopy10.1021/nn4047474 ↗
21. Atomic Structures of Silicene Layers Grown on Ag(111): Scanning Tunneling Microscopy and Noncontact Atomic Force Microscopy Observations10.1038/srep02399 ↗
22. Applications of Raman spectroscopy in two-dimensional materials10.1142/S1793545820300104 ↗
23. High-temperature superconductivity in monolayer Bi2Sr2CaCu2O8+δ10.1038/s41586-019-1718-x ↗
24. Image Segmentation Using Deep Learning: A Survey
25. Takos, G. (2020). A Survey on Deep Learning Methods for Semantic Image Segmentation in Real-Time. arXiv.
26. Recent advances and applications of deep learning methods in materials science10.1038/s41524-022-00734-6 ↗
27. Qin, X., Zhang, Z.V., Huang, C., Dehghan, M., Zaiane, O.R., and Jägersand, M. (2020). U2-Net: Going Deeper with Nested U-Structure for Salient Object Detection. arXiv.10.1016/j.patcog.2020.107404 ↗
28. Accelerated search for materials with targeted properties by adaptive design10.1038/ncomms11241 ↗
29. Ab Initio-Based Bond Order Potential to Investigate Low Thermal Conductivity of Stanene Nanostructures10.1021/acs.jpclett.6b01562 ↗
30. Rapid identification of two-dimensional materials via machine learning assisted optic microscopy
31. Mao, Y., Dong, N., Wang, L., Chen, X., Wang, H., Wang, Z., Kislyakov, I.M., and Wang, J. (2020). Machine Learning Analysis of Raman Spectra of MoS2. Nanomaterials, 10.10.3390/nano10112223 ↗
32. Machine learning–assisted molecular design and efficiency prediction for high-performance organic photovoltaic materials10.1126/sciadv.aay4275 ↗
33. Identifying an efficient, thermally robust inorganic phosphor host via machine learning10.1038/s41467-018-06625-z ↗
34. Machine learning in materials science10.1002/inf2.12028 ↗
35. Deep-Learning-Enabled Fast Optical Identification and Characterization of 2D Materials10.1002/adma.202000953 ↗
36. Wu, B., Wang, L., and Gao, Z. (2019, January 20–22). A two-dimensional material recognition image algorithm based on deep learning. Proceedings of the 2019 International Conference on Information Technology and Computer Application (ITCA), Guangzhou, China.10.1109/ITCA49981.2019.00061 ↗
37. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
38. Deep-learning-based image segmentation integrated with optical microscopy for automatically searching for two-dimensional materials10.1038/s41699-020-0137-z ↗
39. Mask R-CNN
40. Artificial Neuron Networks Enabled Identification and Characterizations of 2D Materials and van der Waals Heterostructures10.1021/acsnano.1c09644 ↗
41. Zhu, Z., Xu, M., Bai, S., Huang, T., and Bai, X. (November, January 27). Asymmetric Non-Local Neural Networks for Semantic Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00068 ↗
42. Super-resolving material microstructure image via deep learning for microstructure characterization and mechanical behavior analysis10.1038/s41524-021-00568-8 ↗
43. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
44. Deep learning approach based on dimensionality reduction for designing electromagnetic nanostructures10.1038/s41524-020-0276-y ↗
45. Wu, S., Wang, Z., Zhang, H., Cai, J., and Li, J. (2021). Deep Learning Accelerates the Discovery of Two-Dimensional Catalysts for Hydrogen Evolution Reaction. Energy Environ. Mater.10.1002/eem2.12259 ↗
46. Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties
47. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.10.1007/978-3-319-24574-4_28 ↗
48. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
49. Kim, S.-W., Kook, H.-K., Sun, J.-Y., Kang, M.-C., and Ko, S. (2018, January 8–14). Parallel Feature Pyramid Network for Object Detection. Proceedings of the ECCV, Munich, Germany.10.1007/978-3-030-01228-1_15 ↗
50. Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv.
51. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the ECCV, Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
52. Yin, M., Yao, Z., Cao, Y., Li, X., Zhang, Z., Lin, S., and Hu, H. (2020). Disentangled Non-Local Neural Networks. arXiv.10.1007/978-3-030-58555-6_12 ↗
53. Fu, J., Liu, J., Tian, H., Fang, Z., and Lu, H. (2019, January 15–20). Dual Attention Network for Scene Segmentation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
54. Huang, L., Yuan, Y., Guo, J., Zhang, C., Chen, X., and Wang, J. (2019). Interlaced Sparse Self-Attention for Semantic Segmentation. arXiv.
55. Yuan, Y., Chen, X., and Wang, J. (2020). Object-Contextual Representations for Semantic Segmentation. arXiv.10.1007/978-3-030-58539-6_11 ↗
56. Fan, M., Lai, S., Huang, J., Wei, X., Chai, Z., Luo, J., and Wei, X. (2021, January 20–25). Rethinking BiSeNet For Real-time Semantic Segmentation. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00959 ↗
57. BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation10.1007/s11263-021-01515-2 ↗
58. Fully Convolutional Networks for Semantic Segmentation
59. Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, January 15–20). Deep High-Resolution Representation Learning for Human Pose Estimation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗
60. Lee, J., Kim, D., Ponce, J., and Ham, B. (2019, January 15–20). SFNet: Learning Object-Aware Semantic Correspondence. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00238 ↗
61. Liu, Y., Chu, L., Chen, G., Wu, Z., Chen, Z., Lai, B., and Hao, Y. (2021). PaddleSeg: A High-Efficient Development Toolkit for Image Segmentation. arXiv.
62. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27–30). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.350 ↗
63. Deep semantic segmentation of natural and medical images: A review10.1007/s10462-020-09854-1 ↗
64. Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.-W., and Wu, J. (2020, January 4–8). UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation. Proceedings of the ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053405 ↗
65. Ma, J. (2020). Segmentation Loss Odyssey. arXiv.
66. Deep-learning-based quality filtering of mechanically exfoliated 2D crystals10.1038/s41524-019-0262-4 ↗
67. Gui, J., Sun, Z., Wen, Y., Tao, D., and Ye, J. (2021). A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications. arXiv.
68. A survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
69. Automatic labeling of large amounts of handwritten characters with gate-guided dynamic deep learning10.1016/j.patrec.2017.09.042 ↗
70. A brief introduction to weakly supervised learning10.1093/nsr/nwx106 ↗
71. Guo, M.-H., Xu, T., Liu, J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R.R., Cheng, M.-M., and Hu, S. (2022). Attention Mechanisms in Computer Vision: A Survey. arXiv.10.1007/s41095-022-0271-y ↗
72. Cheng, Y., Wang, D., Zhou, P., and Zhang, T. (2017). A Survey of Model Compression and Acceleration for Deep Neural Networks. arXiv.
73. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018). A Survey on Deep Transfer Learning. arXiv.10.1007/978-3-030-01424-7_27 ↗
74. A Survey of Modern Deep Learning based Object Detection Models10.1016/j.dsp.2022.103514 ↗
75. Survey on semantic segmentation using deep learning techniques10.1016/j.neucom.2019.02.003 ↗
76. Scaling description of generalization with number of parameters in deep learning10.1088/1742-5468/ab633c ↗
77. Interrater reliability: The kappa statistic10.11613/BM.2012.031 ↗
78. Medical Image Segmentation Using Deep Learning: A Survey10.1049/ipr2.12419 ↗