journal article·2021-08-13Open access

The role of convolutional neural networks in scanning probe microscopy: a review

Ido Azuri, Irit Rosenhek-Goldian, Neta Regev-Rudzki, Georg Fantner, Sidney R Cohen

Abstract

Progress in computing capabilities has enhanced science in many ways. In recent years, various branches of machine learning have been the key facilitators in forging new paths, ranging from categorizing big data to instrumental control, from materials design through image analysis. Deep learning has the ability to identify abstract characteristics embedded within a data set, subsequently using that association to categorize, identify, and isolate subsets of the data. Scanning probe microscopy measures multimodal surface properties, combining morphology with electronic, mechanical, and other characteristics. In this review, we focus on a subset of deep learning algorithms, that is, convolutional neural networks, and how it is transforming the acquisition and analysis of scanning probe data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Force Microscopy Techniques and Applications · Non-Destructive Testing Techniques · Integrated Circuits and Semiconductor Failure Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (100+)

Show source-provided references
1. 10.1147/rd.33.021010.1147/rd.33.0210 ↗
2. 10.1007/bf0099401810.1007/bf00994018 ↗
3. Breiman · 1984
4. Quinlan · 1993
5. 10.1007/978-0-387-30164-8_57610.1007/978-0-387-30164-8_576 ↗
6. 10.1007/978-1-4612-0711-5_510.1007/978-1-4612-0711-5_5 ↗
7. 10.1038/s41592-019-0403-110.1038/s41592-019-0403-1 ↗
8. 10.1373/clinchem.2017.27634510.1373/clinchem.2017.276345 ↗
9. 10.1002/cyto.a.2370110.1002/cyto.a.23701 ↗
10. 10.1016/0031-3203(93)90135-j10.1016/0031-3203(93)90135-j ↗
11. 10.1016/j.media.2017.07.00510.1016/j.media.2017.07.005 ↗
12. 10.1038/s41592-019-0612-710.1038/s41592-019-0612-7 ↗
13. 10.1016/j.cviu.2007.09.01410.1016/j.cviu.2007.09.014 ↗
14. 10.1109/iccv.1999.79041010.1109/iccv.1999.790410 ↗
15. 10.1109/cvpr.2005.17710.1109/cvpr.2005.177 ↗
16. 10.1109/cvpr.2005.1610.1109/cvpr.2005.16 ↗
17. 10.1109/icip.2011.611613210.1109/icip.2011.6116132 ↗
18. 10.1007/s10994-005-1505-910.1007/s10994-005-1505-9 ↗
19. Rish · 2001
20. 10.1007/s11042-020-08852-310.1007/s11042-020-08852-3 ↗
21. 10.1109/time-e.2013.661196810.1109/time-e.2013.6611968 ↗
22. 10.1371/journal.pone.009681410.1371/journal.pone.0096814 ↗
23. 10.1109/infrkm.2018.846468810.1109/infrkm.2018.8464688 ↗
24. 10.1109/icpr.2016.790000910.1109/icpr.2016.7900009 ↗
25. 10.1007/bf0247825910.1007/bf02478259 ↗
26. 10.1038/nature1453910.1038/nature14539 ↗
27. 10.1113/jphysiol.1962.sp00683710.1113/jphysiol.1962.sp006837 ↗
28. Goodfellow · 2016
29. 10.1561/200000003910.1561/2000000039 ↗
30. LeCun · 1998 · 255
31. Krizhevsky · 2012 · 1097
32. Zeiler · arXiv · 2014 · 1311.2901
33. 10.15252/msb.2015665110.15252/msb.20156651 ↗
35. 10.1109/cvpr.2016.9010.1109/cvpr.2016.90 ↗
36. 10.1007/s00330-021-08050-110.1007/s00330-021-08050-1 ↗
37. 10.1109/icassp39728.2021.941368710.1109/icassp39728.2021.9413687 ↗
38. 10.1186/s41232-019-0103-310.1186/s41232-019-0103-3 ↗
39. 10.1093/bioinformatics/btw25510.1093/bioinformatics/btw255 ↗
40. 10.1016/j.compbiomed.2017.09.01710.1016/j.compbiomed.2017.09.017 ↗
41. 10.1109/icarcv.2014.706441410.1109/icarcv.2014.7064414 ↗
42. 10.1109/3dv.2016.7910.1109/3dv.2016.79 ↗
43. 10.1007/s13244-018-0639-910.1007/s13244-018-0639-9 ↗
44. 10.1007/978-3-319-42999-110.1007/978-3-319-42999-1 ↗
45. 10.1016/j.compbiomed.2018.10.01210.1016/j.compbiomed.2018.10.012 ↗
46. 10.1109/access.2016.259483910.1109/access.2016.2594839 ↗
47. 10.1007/s10586-018-2026-110.1007/s10586-018-2026-1 ↗
48. 10.1007/s10916-018-1088-110.1007/s10916-018-1088-1 ↗
49. 10.1016/j.eswa.2018.11.00810.1016/j.eswa.2018.11.008 ↗
50. 10.1186/s40537-019-0276-210.1186/s40537-019-0276-2 ↗
51. 10.1109/tmi.2016.253586510.1109/tmi.2016.2535865 ↗
52. 10.1371/journal.pcbi.100662810.1371/journal.pcbi.1006628 ↗
53. 10.1016/j.compchemeng.2018.04.00910.1016/j.compchemeng.2018.04.009 ↗
54. 10.1021/acs.jcim.9b0083510.1021/acs.jcim.9b00835 ↗
55. 10.1016/j.scib.2018.08.00610.1016/j.scib.2018.08.006 ↗
56. 10.1109/mass.2017.8110.1109/mass.2017.81 ↗
57. 10.1016/j.trc.2017.11.02110.1016/j.trc.2017.11.021 ↗
58. 10.1016/j.knosys.2017.02.01610.1016/j.knosys.2017.02.016 ↗
59. 10.23919/apsipa.2018.865954210.23919/apsipa.2018.8659542 ↗
60. 10.1109/icoin.2017.789958810.1109/icoin.2017.7899588 ↗
61. Khan · 2019 · 7410.1109/CCC.2019.000-6 ↗
62. 10.1109/access.2019.293316510.1109/access.2019.2933165 ↗
63. Kagaya · 2015 · 350
64. 10.1007/s11042-018-6695-910.1007/s11042-018-6695-9 ↗
65. Özsert Yi̇ği̇t · 2017 · 34910.1109/INISTA.2017.8001184 ↗
66. Christodoulidis · 2015 · 458
67. 10.1038/s41467-021-21344-810.1038/s41467-021-21344-8 ↗
68. Alpaydin · 2014
69. Mitchell · 1997
70. Russell · 2002
71. 10.3390/electronics803029210.3390/electronics8030292 ↗
72. 10.1021/acs.nanolett.9b0409010.1021/acs.nanolett.9b04090 ↗
73. Kalinin · arXiv · 2021 · 2103.12165
74. 10.1021/acsnano.6b0421210.1021/acsnano.6b04212 ↗
75. 10.1109/tnnls.2013.229363710.1109/tnnls.2013.2293637 ↗
76. 10.1016/j.compmedimag.2010.07.00310.1016/j.compmedimag.2010.07.003 ↗
77. 10.1016/s0262-8856(00)00067-610.1016/s0262-8856(00)00067-6 ↗
78. 10.1016/s0893-6080(01)00111-310.1016/s0893-6080(01)00111-3 ↗
79. Gamito · Techniques in Urology · 2000 · 6 · 60
80. 10.3109/0785389950900246210.3109/07853899509002462 ↗
81. 10.1016/j.sab.2012.05.01010.1016/j.sab.2012.05.010 ↗
82. 10.1080/01919512.2018.151076310.1080/01919512.2018.1510763 ↗
83. 10.1038/s41562-020-00955-z10.1038/s41562-020-00955-z ↗
84. 10.1016/0968-090x(95)00009-810.1016/0968-090x(95)00009-8 ↗
85. 10.1016/j.advengsoft.2006.08.00310.1016/j.advengsoft.2006.08.003 ↗
86. 10.1016/j.aca.2011.06.03310.1016/j.aca.2011.06.033 ↗
87. 10.1109/tpwrs.2013.226755710.1109/tpwrs.2013.2267557 ↗
88. 10.7551/mitpress/4937.001.000110.7551/mitpress/4937.001.0001 ↗
89. Srivastava · Journal of Machine Learning Research · 2014 · 15 · 1929
90. 10.1109/tkde.2009.19110.1109/tkde.2009.191 ↗
91. 10.1038/s41592-019-0670-x10.1038/s41592-019-0670-x ↗
92. Al-Saffar · 2017 · 2610.1109/ICRAMET.2017.8253139 ↗
93. 10.1016/j.cels.2018.06.00110.1016/j.cels.2018.06.001 ↗
94. 10.1109/tnnls.2017.276616810.1109/tnnls.2017.2766168 ↗
95. 10.1016/j.mtnano.2020.10008710.1016/j.mtnano.2020.100087 ↗
96. 10.1038/s41598-019-48444-210.1038/s41598-019-48444-2 ↗
97. 10.1038/s41592-018-0216-710.1038/s41592-018-0216-7 ↗
98. 10.3389/fpls.2016.0141910.3389/fpls.2016.01419 ↗
99. 10.1155/2017/585972710.1155/2017/5859727 ↗
100. 10.1073/pnas.180442011510.1073/pnas.1804420115 ↗