journal article·2024-10

Integrated Bionic Human Retina Process and In‐Sensor RC System Based on 2D Retinomorphic Memristor Array

Yue Gong, Xuechao Xing, Xingli Wang, Ruihuan Duan, Su‐Ting Han, Beng Kang Tay

Advanced Functional Materials· Volume 34· Issue 42
Publisher page

Abstract

Abstract The rapid development of machine vision has put forward higher requirements for image perception and visual learning systems. However, limited by the von Neumann bottleneck, traditional artificial vision systems rely on complex optical and circuit designs, and the separate distribution of sensors, memory, and computing modules results in high energy consumption and high latency. Memristor‐based reservoir computing (RC) system with integrated sensing and memory functions provides a solution to effectively improve the computational efficiency of artificial vision networks. Here, a complete artificial visual recognition system based on in‐sensor RC is developed by combining the excellent optoelectronic synaptic properties of 2D WS 2 memristor array. Through effectively regulating the conductance of memristors by light or electrical stimulation, image information is converted into high‐dimensional information in the reservoir layer, and the classification can be completed by simple training, significantly reducing the training complexity and cost consumption. With this system, an effective recognition of hand‐written numbers with an accuracy of 88.3% is demonstrated, and a 100% recognition of traffic signals of different colors is achieved. The proposed in‐sensor RC system advances the development and application of artificial vision recognition, paving the way for efficient machine learning and neuromorphic vision systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · Photoreceptor and optogenetics research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical and Electronic Engineering Nanyang Technological University Singapore 639798 Singapore

Interdisciplinary Graduate School Nanyang Technological University Singapore 639798 Singapore

School of Materials Science and Engineering Nanyang Technological University Singapore 639798 Singapore

IRL3288CINTRA (CNRS International‐NTU‐THALES Research Alliances) Nanyang Technological University Singapore 637553 Singapore

Department of Applied Biology & Chemical Technology The Hong Kong Polytechnic University Hong Kong 999077 P. R. China

References (38)

Show source-provided references
1. 10.1038/s41467-018-07565-410.1038/s41467-018-07565-4 ↗
2. 10.1039/D2NH00536K10.1039/D2NH00536K ↗
3. 10.1038/s41467-021-26314-810.1038/s41467-021-26314-8 ↗
4. 10.1002/adma.20220189510.1002/adma.202201895 ↗
5. 10.1038/s41928-022-00795-x10.1038/s41928-022-00795-x ↗
6. 10.1002/adma.20200785110.1002/adma.202007851 ↗
7. 10.1109/LED.2022.319523710.1109/LED.2022.3195237 ↗
8. 10.1039/D3MH01035J10.1039/D3MH01035J ↗
9. 10.1038/s41928-020-00501-910.1038/s41928-020-00501-9 ↗
10. 10.1002/adfm.20210801410.1002/adfm.202108014 ↗
11. 10.1038/s41467-023-42488-910.1038/s41467-023-42488-9 ↗
12. 10.1038/s41467-023-37973-010.1038/s41467-023-37973-0 ↗
13. 10.1002/adma.20190243410.1002/adma.201902434 ↗
14. 10.1002/adfm.20210014410.1002/adfm.202100144 ↗
15. 10.1038/nnano.2012.24010.1038/nnano.2012.240 ↗
16. 10.1038/s41467-022-34230-810.1038/s41467-022-34230-8 ↗
17. 10.1021/acs.nanolett.3c0226610.1021/acs.nanolett.3c02266 ↗
18. 10.1038/s41467-023-39371-y10.1038/s41467-023-39371-y ↗
19. 10.1038/s41467-017-02337-y10.1038/s41467-017-02337-y ↗
20. 10.1002/adma.20220538110.1002/adma.202205381 ↗
21. 10.1002/adma.20210781110.1002/adma.202107811 ↗
22. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
23. 10.1021/acsnano.9b0345410.1021/acsnano.9b03454 ↗
24. 10.1038/s41928-020-00473-w10.1038/s41928-020-00473-w ↗
25. 10.1002/adfm.20200835110.1002/adfm.202008351 ↗
26. 10.1126/science.abg316110.1126/science.abg3161 ↗
27. 10.1002/aelm.20190110710.1002/aelm.201901107 ↗
28. 10.1038/s41565-021-01003-110.1038/s41565-021-01003-1 ↗
29. 10.1038/s41586-018-0008-310.1038/s41586-018-0008-3 ↗
30. 10.1126/science.aao009810.1126/science.aao0098 ↗
31. 10.1038/s41467-018-07572-510.1038/s41467-018-07572-5 ↗
32. 10.1002/adma.20220681610.1002/adma.202206816 ↗
33. 10.1146/annurev.physiol.64.092501.11454710.1146/annurev.physiol.64.092501.114547 ↗
34. 10.1021/nn305275h10.1021/nn305275h ↗
35. 10.1002/adom.20170076710.1002/adom.201700767 ↗
36. 10.1002/adfm.20130076010.1002/adfm.201300760 ↗
37. 10.1021/nl403270k10.1021/nl403270k ↗
38. 10.1126/sciadv.abg145510.1126/sciadv.abg1455 ↗