journal article·2023-11

All‐Optically Controlled Retinomorphic Memristor for Image Processing and Stabilization

Bingqi Cai, Yang Huang, Lingzhi Tang, Tianyu Wang, Chen Wang, Qingqing Sun, David Wei Zhang, Lin Chen

Advanced Functional Materials· Volume 33· Issue 46
Publisher page

Abstract

Abstract Image stabilization is a crucial field in machine vision, aiming to eliminate image blurring or distortion caused by the camera or object jitter. However, traditional image stabilization techniques often suffer from the drawbacks of requiring complex equipment or extensive computing resources, resulting in inefficiencies. In contrast, the human retina performs a highly efficient all‐in‐one system, encompassing the detection and processing of light stimuli. In this study, an all‐optically controlled retinomorphic memristor based on the CsxFAyMA1‐x‐yPb(IzBr1‐z)3 is proposed, which integrates perception, storage, and processing functions. This memristor exhibits significant advantages in image stabilization. It is capable of positively and negatively modulating its conductance using specific intensities (11.8 and 0.9 mW cm−2, respectively) of red light (630 nm). To demonstrate the effectiveness of the proposed approach, handwritten digit recognition simulations are conducted. The application of specific light stimuli effectively highlights the characteristics of blurred images. The processed images are then fed into a conductance‐mapped neural network for rapid recognition. Remarkably, the recognition rates of the processed images reach 83.5% after 19 000 iterations, surpassing the performance of blurred images (only 56.2% after 19 000 iterations). These results highlight the immense potential of retinomorphic memristors as the hardware foundation for next‐generation image stabilization systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · CCD and CMOS Imaging Sensors

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Microelectronics Fudan University Shanghai 200433 China

School of Microelectronics Dalian University of Technology Dalian Liaoning 116024 China

Zhangjiang Fudan International Innovation Center Shanghai 201203 China

Funding

Science and Technology Commission of Shanghai Municipality · China Postdoctoral Science Foundation · National Key Research and Development Program of China · National Natural Science Foundation of China

References (60)

Show source-provided references
1. 10.1007/s12274-021-3729-910.1007/s12274-021-3729-9 ↗
2. 10.1038/s41928-022-00789-910.1038/s41928-022-00789-9 ↗
3. 10.1038/s41377-023-01166-710.1038/s41377-023-01166-7 ↗
4. 10.1038/s41467-023-37581-y10.1038/s41467-023-37581-y ↗
5. S.Nah T. H.Kim K. M.Lee presented atIEEE Conf. on Computer Vision and Pattern Recognition (CVPR) Honolulu HI USA July2017.
6. 10.1109/TPAMI.2018.283212510.1109/TPAMI.2018.2832125 ↗
7. 10.1016/j.knosys.2022.10886710.1016/j.knosys.2022.108867 ↗
8. 10.3390/info1311053110.3390/info13110531 ↗
9. 10.1145/349452510.1145/3494525 ↗
10. 10.5594/J0233910.5594/J02339 ↗
11. C.Morimoto R.Chellappa presented atProc. of 13th Int. Conf. on Pattern Recognition Vienna August1996.
12. 10.1038/s41377-023-01079-510.1038/s41377-023-01079-5 ↗
13. 10.1002/adfm.20221389410.1002/adfm.202213894 ↗
14. 10.1002/advs.20220768810.1002/advs.202207688 ↗
15. 10.1016/j.nanoen.2023.10839810.1016/j.nanoen.2023.108398 ↗
16. 10.1038/s41598-023-28505-310.1038/s41598-023-28505-3 ↗
17. 10.1002/adma.20210548510.1002/adma.202105485 ↗
18. 10.1002/aisy.20220029810.1002/aisy.202200298 ↗
19. 10.1186/s43074-023-00082-810.1186/s43074-023-00082-8 ↗
20. 10.1109/TED.2023.323488110.1109/TED.2023.3234881 ↗
21. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
22. 10.1021/acsnano.0c0892110.1021/acsnano.0c08921 ↗
23. 10.1002/adma.20180356310.1002/adma.201803563 ↗
24. 10.1039/D0NR02184A10.1039/D0NR02184A ↗
25. 10.1002/adfm.20220345410.1002/adfm.202203454 ↗
26. H.Huang J.Tang B.Gao Y.Wang X.Li Z.Wang H.Qian H.Wu presented at6th IEEE Electron Devices Technology & Manufacturing Conf. (EDTM) Oita Japan March2022.
27. 10.3390/electronics1104061910.3390/electronics11040619 ↗
28. 10.1038/s41467-023-37623-510.1038/s41467-023-37623-5 ↗
29. 10.1002/adfm.20210801410.1002/adfm.202108014 ↗
30. 10.1002/adma.20230063210.1002/adma.202300632 ↗
31. 10.1002/aelm.20220065710.1002/aelm.202200657 ↗
32. 10.1016/j.optcom.2023.12932310.1016/j.optcom.2023.129323 ↗
33. 10.1021/acsami.2c2016610.1021/acsami.2c20166 ↗
34. 10.1002/adfm.20200558210.1002/adfm.202005582 ↗
35. 10.1002/aelm.20220109310.1002/aelm.202201093 ↗
36. 10.1016/j.nanoen.2019.10400010.1016/j.nanoen.2019.104000 ↗
37. 10.1007/s12274-023-5566-510.1007/s12274-023-5566-5 ↗
38. 10.1088/1361-6528/acb44110.1088/1361-6528/acb441 ↗
39. 10.1039/D2NR05109E10.1039/D2NR05109E ↗
40. 10.1016/j.jallcom.2021.16357510.1016/j.jallcom.2021.163575 ↗
41. 10.1021/acsnano.9b0034010.1021/acsnano.9b00340 ↗
42. 10.1002/advs.20210463210.1002/advs.202104632 ↗
43. 10.1088/1361-6528/acba1c10.1088/1361-6528/acba1c ↗
44. 10.1007/s40820-022-00983-610.1007/s40820-022-00983-6 ↗
45. 10.1002/advs.20210349410.1002/advs.202103494 ↗
46. 10.1002/adma.20190689910.1002/adma.201906899 ↗
47. 10.1016/j.nanoen.2020.10524610.1016/j.nanoen.2020.105246 ↗
48. 10.1002/aisy.20200012210.1002/aisy.202000122 ↗
49. 10.1017/S095252381000031310.1017/S0952523810000313 ↗
50. 10.3389/fopht.2022.98900210.3389/fopht.2022.989002 ↗
51. 10.1002/aelm.20220065710.1002/aelm.202200657 ↗
52. 10.1021/acsnano.7b0731710.1021/acsnano.7b07317 ↗
53. 10.1039/C6EE01504B10.1039/C6EE01504B ↗
54. 10.1109/LED.2022.321152010.1109/LED.2022.3211520 ↗
55. 10.1021/acsami.8b1684110.1021/acsami.8b16841 ↗
56. 10.3390/mi905023910.3390/mi9050239 ↗
57. 10.1021/acs.nanolett.2c0176810.1021/acs.nanolett.2c01768 ↗
58. 10.1002/adfm.20211305310.1002/adfm.202113053 ↗
59. 10.1002/adfm.20221291710.1002/adfm.202212917 ↗
60. 10.1002/adfm.20190964510.1002/adfm.201909645 ↗