journal article·2023-12-20

Energy-Efficient ReS2-Based Optoelectronic Synapse for 3D Object Reconstruction and Recognition

Yabo Chen, Yujie Huang, Junwei Zeng, Yan Kang, Yinlong Tan, Xiangnan Xie, Bo Wei, Cheng Li, Liang Fang, Tian Jiang

ACS Applied Materials & Interfaces· Volume 15· Issue 50
Publisher page

Abstract

The neuromorphic vision system (NVS) equipped with optoelectronic synapses integrates perception, storage, and processing and is expected to address the issues of traditional machine vision. However, owing to their lack of stereo vision, existing NVSs focus on 2D image processing, which makes it difficult to solve problems such as spatial cognition errors and low-precision interpretation. Consequently, inspired by the human visual system, an NVS with stereo vision is developed to achieve 3D object recognition, depending on the prepared ReS 2 optoelectronic synapse with 12.12 fJ ultralow power consumption. This device exhibits excellent optical synaptic plasticity derived from the persistent photoconductivity effect. As the cornerstone for 3D vision, color planar information is successfully discriminated and stored in situ at the sensor end, benefiting from its wavelength-dependent plasticity in the visible region. Importantly, the dependence of the channel conductance on the target distance is experimentally revealed, implying that the structure information on the object can be directly captured and stored by the synapse. The 3D image of the object is successfully reconstructed via fusion of its planar and depth images. Therefore, the proposed 3D-NVS based on ReS 2 synapses for 3D objects achieves a recognition accuracy of 97.0%, which is much higher than that for 2D objects (32.6%), demonstrating its strong ability to prevent 2D-photo spoofing in applications such as face payment, entrance guard systems, and others.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · CCD and CMOS Imaging Sensors · Photoreceptor and optogenetics research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute for Quantum Information & State Key Laboratory of High Performance Computing, College of Computer, National University of Defense Technology, Changsha 410073, P. R. China

College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, P. R. China

Institute of Quantum Information Science and Technology, College of Science, National University of Defense Technology, Changsha 410073, P. R. China

Funding

National University of Defense Technology · National Key Research and Development Program of China · National Natural Science Foundation of China

References (54)

Show source-provided references
1. 10.1038/d41586-020-00592-610.1038/d41586-020-00592-6 ↗
2. 10.1002/adfm.20210801410.1002/adfm.202108014 ↗
3. 10.1016/j.nanoen.2021.10643910.1016/j.nanoen.2021.106439 ↗
4. 10.1002/adfm.20220978110.1002/adfm.202209781 ↗
5. 10.1021/acsnano.1c0675810.1021/acsnano.1c06758 ↗
6. 10.1038/s41467-022-29456-510.1038/s41467-022-29456-5 ↗
7. 10.1021/acs.nanolett.1c0324010.1021/acs.nanolett.1c03240 ↗
8. 10.1002/adma.20220849710.1002/adma.202208497 ↗
9. 10.1016/j.nanoen.2020.10479010.1016/j.nanoen.2020.104790 ↗
10. 10.1002/adfm.20210600010.1002/adfm.202106000 ↗
11. 10.1021/acsnano.2c0103510.1021/acsnano.2c01035 ↗
12. 10.1002/adma.20210298010.1002/adma.202102980 ↗
13. 10.1021/acsnano.1c0467610.1021/acsnano.1c04676 ↗
14. 10.1038/s41565-021-01003-110.1038/s41565-021-01003-1 ↗
15. 10.1038/s41565-023-01379-210.1038/s41565-023-01379-2 ↗
16. 10.1038/s41467-020-16985-010.1038/s41467-020-16985-0 ↗
17. 10.1063/5.004740310.1063/5.0047403 ↗
18. 10.1038/s41467-021-22047-w10.1038/s41467-021-22047-w ↗
19. 10.1002/adma.20170540010.1002/adma.201705400 ↗
20. 10.1002/adma.20200243110.1002/adma.202002431 ↗
21. 10.1002/adma.20210548510.1002/adma.202105485 ↗
22. 10.1002/adma.20221211810.1002/adma.202212118 ↗
23. 10.1021/acsnano.0c0687410.1021/acsnano.0c06874 ↗
24. 10.1038/s41928-022-00713-110.1038/s41928-022-00713-1 ↗
25. 10.1002/advs.20210609210.1002/advs.202106092 ↗
26. 10.1038/s41467-022-34230-810.1038/s41467-022-34230-8 ↗
27. 10.1038/s41928-022-00847-210.1038/s41928-022-00847-2 ↗
28. 10.1038/s41586-020-2038-x10.1038/s41586-020-2038-x ↗
29. 10.1126/sciadv.aba617310.1126/sciadv.aba6173 ↗
30. 10.1038/s41928-022-00747-510.1038/s41928-022-00747-5 ↗
31. 10.1007/s11263-023-01790-110.1007/s11263-023-01790-1 ↗
32. 10.1109/tpami.2019.295488510.1109/tpami.2019.2954885 ↗
33. 10.1016/j.media.2022.10256210.1016/j.media.2022.102562 ↗
34. 10.1109/TIFS.2016.257828810.1109/TIFS.2016.2578288 ↗
35. 10.1109/TPAMI.2017.270668510.1109/TPAMI.2017.2706685 ↗
36. 10.1111/j.0963-7214.2006.00422.x10.1111/j.0963-7214.2006.00422.x ↗
37. 10.1038/ncomms425210.1038/ncomms4252 ↗
38. 10.1002/adfm.20150440810.1002/adfm.201504408 ↗
39. 10.1002/pssr.20180065810.1002/pssr.201800658 ↗
40. 10.1002/adma.20180433210.1002/adma.201804332 ↗
41. 10.1063/5.004850510.1063/5.0048505 ↗
42. 10.1021/acs.nanolett.7b0437410.1021/acs.nanolett.7b04374 ↗
43. 10.1038/nrn147510.1038/nrn1475 ↗
44. 10.1038/nn.450510.1038/nn.4505 ↗
45. 10.1002/adfm.20230288510.1002/adfm.202302885 ↗
46. 10.1002/adfm.20211305310.1002/adfm.202113053 ↗
47. Lear J. L. · J. Nucl. Med. · 1987 · 28 · 218
48. 10.1038/nature0502410.1038/nature05024 ↗
49. 10.3390/s2223922210.3390/s22239222 ↗
50. Ren S. · 2015 · 28
51. 10.1002/(SICI)1097-461X(2000)77:5<895::AID-QUA10>3.0.CO;2-C10.1002/(SICI)1097-461X(2000)77:5<895::AID-QUA10>3.0.CO;2-C ↗
52. 10.1103/PhysRevLett.100.13640610.1103/PhysRevLett.100.136406 ↗
53. 10.1103/PhysRevLett.77.386510.1103/PhysRevLett.77.3865 ↗
54. Handa, A.; Whelan, T.; McDonald, J.; Davison, A. J. A Benchmark for RGB-D Visual Odometry, 3D Reconstruction and SLAM. 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014; pp 1524–1531.10.1109/ICRA.2014.6907054 ↗