Multispectral In-Sensor Computing for Image Recognition Based on the Opposite Photogating Photosynapse
Source abstract
Abstract
Through the integration of sensing and computing functions into a single photosynapse, the neuromorphic visual system mitigates the substantial data redundancy caused by frequent data conversion and transmission in Von Neumann architectures. However, most reported photosynapses can produce unidirectional light responses only without electric modulation and are limited to narrow spectral ranges, which limits their effectiveness in target recognition in complex real-world optical scenes. Here, we present a four-color reservoir computing (RC) system based on an opposite photogating (OPG)-engineered multispectral photosynapse. The OPG effect, characterized by light-modulated oppositely shifted threshold voltage ( V th ), originates from different carrier dynamics in a Ga 2 O 3 /WSe 2 heterojunction field-effect transistor. Specifically, hole trapping in Ga 2 O 3 under deep ultraviolet (DUV) light induces negative V th shifts (excitatory responses), while electron trapping in WSe 2 under visible light causes positive V th shifts (inhibitory responses). The nonlinear photoresponse and tunable short-term memory under external light stimuli make the photosynapse suitable for photoelectric reservoirs. The DUV-specific corona discharge, a critical challenge in high-voltage transmission systems, causes exacerbated equipment aging and significant energy losses. By integration of DUV-specific discharge signals and visible environmental information, the system achieves 88.3% accuracy in localizing the corona discharge among six high-risk components in high-voltage systems. Our multispectral RC system demonstrates a pathway toward precise intelligent image recognition in real-world multispectral scenarios.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Advanced Memory and Neural Computing · Transition Metal Oxide Nanomaterials
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Microelectronics
University of Science and Technology of China
Anhui Province Key Laboratory of Integrated Circuit Science and Technology
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition
Funding
University of Science and Technology of China · National Key Research and Development Program of China · China Postdoctoral Science Foundation · National Natural Science Foundation of China
References (58)
Show source-provided references
1. 10.1038/s41928-022-00747-510.1038/s41928-022-00747-5 ↗
2. 10.1038/s41928-023-01055-210.1038/s41928-023-01055-2 ↗
3. Xu L. · 2023 · 1
4. 10.1038/s41563-023-01676-010.1038/s41563-023-01676-0 ↗
5. 10.1002/adfm.20230228810.1002/adfm.202302288 ↗
6. 10.1021/acsnano.8b0799710.1021/acsnano.8b07997 ↗
7. 10.1002/adma.20210692310.1002/adma.202106923 ↗
8. 10.1038/s41467-023-42240-310.1038/s41467-023-42240-3 ↗
9. 10.1038/s41467-024-55670-410.1038/s41467-024-55670-4 ↗
10. 10.1038/s41467-023-36935-w10.1038/s41467-023-36935-w ↗
11. 10.1002/adfm.20230558910.1002/adfm.202305589 ↗
12. 10.1038/s41563-021-01099-910.1038/s41563-021-01099-9 ↗
13. 10.1002/adma.20200420710.1002/adma.202004207 ↗
14. 10.1021/acsnano.3c0216710.1021/acsnano.3c02167 ↗
15. 10.1002/adma.20230146810.1002/adma.202301468 ↗
16. 10.1002/advs.20210609210.1002/advs.202106092 ↗
17. 10.1038/s41928-022-00847-210.1038/s41928-022-00847-2 ↗
18. 10.1038/s41467-024-46393-710.1038/s41467-024-46393-7 ↗
19. 10.1002/smll.20180007910.1002/smll.201800079 ↗
20. 10.1146/annurev.neuro.23.1.31510.1146/annurev.neuro.23.1.315 ↗
21. 10.1038/nn87610.1038/nn876 ↗
22. 10.1038/s41928-022-00713-110.1038/s41928-022-00713-1 ↗
23. 10.1002/adma.20230809010.1002/adma.202308090 ↗
24. 10.1038/s41467-022-34230-810.1038/s41467-022-34230-8 ↗
25. 10.1021/acsami.4c0125510.1021/acsami.4c01255 ↗
26. 10.1109/TIE.2011.211945510.1109/TIE.2011.2119455 ↗
27. 10.1111/1556-4029.1210110.1111/1556-4029.12101 ↗
28. 10.1109/TITS.2002.80292710.1109/TITS.2002.802927 ↗
29. 10.1038/s41467-024-55412-610.1038/s41467-024-55412-6 ↗
30. Zou Y. · 2022 · 19.5.110.1109/IEDM45625.2022.10019389 ↗
31. 10.1016/j.joule.2017.11.01510.1016/j.joule.2017.11.015 ↗
32. 10.1038/srep4016010.1038/srep40160 ↗
33. 10.1002/smll.20210317510.1002/smll.202103175 ↗
34. 10.1039/C5CP07194A10.1039/C5CP07194A ↗
35. 10.1063/1.511662710.1063/1.5116627 ↗
36. 10.1038/s41467-024-45187-110.1038/s41467-024-45187-1 ↗
37. 10.1038/s41928-024-01133-z10.1038/s41928-024-01133-z ↗
38. 10.1002/adma.20220681610.1002/adma.202206816 ↗
39. 10.1002/smll.20190096610.1002/smll.201900966 ↗
40. 10.1021/acsnano.9b0034010.1021/acsnano.9b00340 ↗
41. 10.1002/aelm.20230009810.1002/aelm.202300098 ↗
42. 10.1002/adma.20240106010.1002/adma.202401060 ↗
43. 10.1038/s41467-024-52563-410.1038/s41467-024-52563-4 ↗
44. 10.1002/aisy.20200019610.1002/aisy.202000196 ↗
45. 10.1038/s41467-017-02337-y10.1038/s41467-017-02337-y ↗
46. 10.1038/s41928-019-0313-310.1038/s41928-019-0313-3 ↗
47. 10.1038/s41928-022-00838-310.1038/s41928-022-00838-3 ↗
48. 10.1038/s41467-020-15105-210.1038/s41467-020-15105-2 ↗
49. 10.1364/AO.15.00007610.1364/AO.15.000076 ↗
50. 10.3390/aerospace909052410.3390/aerospace9090524 ↗
51. 10.1038/srep0262810.1038/srep02628 ↗
52. 10.1002/adfm.20180600610.1002/adfm.201806006 ↗
53. 10.1038/s41467-023-36117-810.1038/s41467-023-36117-8 ↗
54. 10.1016/j.mtphys.2022.10088310.1016/j.mtphys.2022.100883 ↗
55. 10.1038/s41377-021-00527-410.1038/s41377-021-00527-4 ↗
56. 10.1038/s41563-020-0795-410.1038/s41563-020-0795-4 ↗
57. 10.1038/s41565-023-01340-310.1038/s41565-023-01340-3 ↗
58. 10.1021/acsnano.2c1210310.1021/acsnano.2c12103 ↗