journal article·2022-02

Bio‐Inspired Artificial Vision and Neuromorphic Image Processing Devices

Min Sung Kim, Min Seok Kim, Gil Ju Lee, Sung‐Hyuk Sunwoo, Sehui Chang, Young Min Song, Dae‐Hyeong Kim

Advanced Materials Technologies· Volume 7· Issue 2
Publisher page

Abstract

Abstract Remarkable technological developments for efficient image recognition (i.e., image acquisition and image data processing) have been reported in the past decade. Such advances in imaging and image processing technologies have driven significant progress in mobile electronics and machine vision applications. In particular, for image acquisition devices, two types of natural eyes (i.e., chambered and compound eyes) have inspired the development of novel multifunctional imaging devices with unique optical geometries. For image data processing devices, novel computing devices based on memristor crossbar arrays, such as electronic synapses, have been developed. More recently, the integration of imaging and image processing devices in a single unit further enhances the system‐level efficiency. Herein, such recent advances in the bio‐inspired artificial vision and neuromorphic image processing devices, aimed at providing efficient image recognition, are reviewed. First, various imaging devices inspired by the structural and functional features of natural eyes are introduced. Second, artificial synapses and their operation principles are thoroughly discussed. Third, the neuromorphic vision sensor that integrates the imaging and image processing devices is reviewed. Finally, a brief summary and future outlook are presented.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Photoreceptor and optogenetics research · CCD and CMOS Imaging Sensors

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Center for Nanoparticle Research Institute for Basic Science (IBS) Seoul 08826 Republic of Korea

School of Chemical and Biological Engineering Institute of Chemical Processes Seoul National University Seoul 08826 Republic of Korea

School of Electrical Engineering and Computer Science Gwangju Institute of Science and Technology Gwangju 61005 Republic of Korea

Department of Materials Science and Engineering Seoul National University Seoul 08826 Republic of Korea

Funding

Korea Basic Science Institute · National Research Foundation of Korea

References (100+)

Show source-provided references
1. 10.1364/OE.26.01245510.1364/OE.26.012455 ↗
2. 10.1126/sciadv.aao684110.1126/sciadv.aao6841 ↗
3. 10.1002/adma.20170472910.1002/adma.201704729 ↗
4. 10.1038/nmat305410.1038/nmat3054 ↗
5. Zhou F. · Research · 2019 · 2019
6. 10.1002/adfm.20170520210.1002/adfm.201705202 ↗
7. Guo Q. · 2017 · 966
8. 10.1364/OE.18.02437910.1364/OE.18.024379 ↗
9. 10.3390/s1708177410.3390/s17081774 ↗
10. 10.1016/j.optlastec.2017.04.02610.1016/j.optlastec.2017.04.026 ↗
11. 10.1038/s41563-019-0357-910.1038/s41563-019-0357-9 ↗
12. 10.1038/s41928-018-0103-310.1038/s41928-018-0103-3 ↗
13. 10.1021/acsnano.9b0768710.1021/acsnano.9b07687 ↗
14. 10.1046/j.1475-1313.2001.00577.x10.1046/j.1475-1313.2001.00577.x ↗
15. 10.1109/JPROC.2014.234615310.1109/JPROC.2014.2346153 ↗
16. 10.1080/0010751880822260110.1080/00107518808222601 ↗
17. 10.1080/09500340.2016.122493910.1080/09500340.2016.1224939 ↗
18. 10.1364/OE.15.01192210.1364/OE.15.011922 ↗
19. 10.1364/AO.44.00294910.1364/AO.44.002949 ↗
20. 10.1038/s41928-020-0397-910.1038/s41928-020-0397-9 ↗
21. 10.1038/ncomms1544810.1038/ncomms15448 ↗
22. 10.1021/acsaelm.9b0069410.1021/acsaelm.9b00694 ↗
23. 10.1002/adfm.20180085410.1002/adfm.201800854 ↗
24. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
25. 10.1038/nnano.2017.8310.1038/nnano.2017.83 ↗
26. 10.1002/adma.20190643310.1002/adma.201906433 ↗
27. 10.1021/nl904092h10.1021/nl904092h ↗
28. 10.1038/s41467-020-19806-610.1038/s41467-020-19806-6 ↗
29. 10.1002/adma.20170095110.1002/adma.201700951 ↗
30. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
31. 10.1002/adma.20200243110.1002/adma.202002431 ↗
32. 10.1109/TAES.2018.284517810.1109/TAES.2018.2845178 ↗
33. 10.1073/pnas.191215411610.1073/pnas.1912154116 ↗
34. 10.1364/OPTICA.5.00041310.1364/OPTICA.5.000413 ↗
35. 10.1364/BOE.6.00317910.1364/BOE.6.003179 ↗
36. 10.1364/OE.8.00055510.1364/OE.8.000555 ↗
37. 10.1126/science.121166710.1126/science.1211667 ↗
38. 10.1364/OE.16.00496510.1364/OE.16.004965 ↗
39. 10.1038/nature0711310.1038/nature07113 ↗
40. 10.1038/s41467-017-01824-610.1038/s41467-017-01824-6 ↗
41. 10.1038/nature1208310.1038/nature12083 ↗
42. 10.1073/pnas.121906811010.1073/pnas.1219068110 ↗
43. 10.1038/s41467-020-15460-010.1038/s41467-020-15460-0 ↗
44. 10.1073/pnas.151795311310.1073/pnas.1517953113 ↗
45. 10.1038/s41928-020-0429-510.1038/s41928-020-0429-5 ↗
46. 10.1126/sciadv.160265510.1126/sciadv.1602655 ↗
47. 10.1038/s41598-020-63039-y10.1038/s41598-020-63039-y ↗
48. 10.1038/s41377-018-0081-210.1038/s41377-018-0081-2 ↗
49. 10.1364/OPTICA.5.00124010.1364/OPTICA.5.001240 ↗
50. 10.1002/1521-4095(20020916)14:18<1261::AID-ADMA1261>3.0.CO;2-N10.1002/1521-4095(20020916)14:18<1261::AID-ADMA1261>3.0.CO;2-N ↗
51. 10.1002/adma.20170181410.1002/adma.201701814 ↗
52. 10.1038/nature0502410.1038/nature05024 ↗
53. 10.1364/OE.20.02674610.1364/OE.20.026746 ↗
54. 10.1364/OE.16.01154010.1364/OE.16.011540 ↗
55. 10.1117/1.OE.52.11.11210510.1117/1.OE.52.11.112105 ↗
56. Kim H. M. · J. Visualized Exp. · 2018 · 136 · e57502
57. 10.1002/adma.20200445610.1002/adma.202004456 ↗
58. 10.1073/pnas.101544010810.1073/pnas.1015440108 ↗
59. 10.1364/OE.25.01301010.1364/OE.25.013010 ↗
60. Iwert O. · 2012 · 84531W10.1117/12.926059 ↗
61. 10.1038/s41467-017-01926-110.1038/s41467-017-01926-1 ↗
62. 10.1038/micronano.2016.1910.1038/micronano.2016.19 ↗
63. 10.1021/acsnano.7b0480410.1021/acsnano.7b04804 ↗
64. 10.1038/s41467-018-03870-010.1038/s41467-018-03870-0 ↗
65. 10.1002/smll.20090135010.1002/smll.200901350 ↗
66. 10.1038/s41928-019-0304-410.1038/s41928-019-0304-4 ↗
67. 10.1002/admt.20180048910.1002/admt.201800489 ↗
68. 10.1038/nnano.2014.3810.1038/nnano.2014.38 ↗
69. 10.1002/adfm.20160528610.1002/adfm.201605286 ↗
70. 10.1038/s41565-018-0226-810.1038/s41565-018-0226-8 ↗
71. 10.1002/admt.20190076810.1002/admt.201900768 ↗
72. 10.1038/s41467-019-13198-y10.1038/s41467-019-13198-y ↗
73. 10.1038/s41467-019-12777-310.1038/s41467-019-12777-3 ↗
74. 10.1038/ncomms674710.1038/ncomms6747 ↗
75. 10.1002/adma.20150415010.1002/adma.201504150 ↗
76. 10.1126/scitranslmed.aad856810.1126/scitranslmed.aad8568 ↗
77. 10.1038/nnano.2016.3810.1038/nnano.2016.38 ↗
78. 10.1126/sciadv.150110110.1126/sciadv.1501101 ↗
79. 10.1002/adfm.20150457810.1002/adfm.201504578 ↗
80. 10.1038/s41586-020-2285-x10.1038/s41586-020-2285-x ↗
81. 10.1021/acs.accounts.8b0049110.1021/acs.accounts.8b00491 ↗
82. 10.1002/adma.20190274310.1002/adma.201902743 ↗
83. 10.1002/smll.20190627010.1002/smll.201906270 ↗
84. 10.1002/admi.20190217010.1002/admi.201902170 ↗
85. 10.1039/D0NR01456G10.1039/D0NR01456G ↗
86. 10.1088/0960-1317/19/5/05501710.1088/0960-1317/19/5/055017 ↗
87. 10.1063/1.497133410.1063/1.4971334 ↗
88. 10.1002/adma.20180398010.1002/adma.201803980 ↗
89. 10.1016/j.talanta.2020.12126910.1016/j.talanta.2020.121269 ↗
90. 10.1002/admt.20200040710.1002/admt.202000407 ↗
91. 10.1016/j.jconrel.2020.09.00210.1016/j.jconrel.2020.09.002 ↗
92. 10.1016/j.matt.2020.10.02010.1016/j.matt.2020.10.020 ↗
93. 10.1126/sciadv.abd463910.1126/sciadv.abd4639 ↗
94. 10.1002/cnma.20160019110.1002/cnma.201600191 ↗
95. 10.1002/adma.20160239110.1002/adma.201602391 ↗
96. 10.1038/nature1231410.1038/nature12314 ↗
97. 10.1038/ncomms667810.1038/ncomms6678 ↗
98. 10.1038/ncomms814910.1038/ncomms8149 ↗
99. 10.1002/adfm.20150295610.1002/adfm.201502956 ↗
100. 10.1002/adfm.20140298710.1002/adfm.201402987 ↗