Nano device fabrication for in-memory and in-sensor reservoir computing
Source abstract
Abstract
Abstract Recurrent neural networks (RNNs) have proven to be indispensable for processing sequential and temporal data, with extensive applications in language modeling, text generation, machine translation, and time-series forecasting. Despite their versatility, RNNs are frequently beset by significant training expenses and slow convergence times, which impinge upon their deployment in edge AI applications. Reservoir computing (RC), a specialized RNN variant, is attracting increased attention as a cost-effective alternative for processing temporal and sequential data at the edge. RC’s distinctive advantage stems from its compatibility with emerging memristive hardware, which leverages the energy efficiency and reduced footprint of analog in-memory and in-sensor computing, offering a streamlined and energy-efficient solution. This review offers a comprehensive explanation of RC’s underlying principles, fabrication processes, and surveys recent progress in nano-memristive device based RC systems from the viewpoints of in-memory and in-sensor RC function. It covers a spectrum of memristive device, from established oxide-based memristive device to cutting-edge material science developments, providing readers with a lucid understanding of RC’s hardware implementation and fostering innovative designs for in-sensor RC systems. Lastly, we identify prevailing challenges and suggest viable solutions, paving the way for future advancements in in-sensor RC technology.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Machine Learning and ELM
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Memory in linear recurrent neural networks in continuous time10.1016/j.neunet.2009.08.008 ↗
2. Memory capacity of recurrent neural networks with matrix representation10.1016/j.neucom.2023.126824 ↗
3. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks
4. Bidirectional recurrent neural networks10.1109/78.650093 ↗
5. Classification of temporal sequences via prediction using the simple recurrent neural network10.1016/S0031-3203(99)00149-1 ↗
6. A comparative study of recurrent neural network architectures on learning temporal sequences
7. Bayesian recurrent neural network for language modeling10.1109/TNNLS.2015.2499302 ↗
8. Joint online spoken language understanding and language modeling with recurrent neural networks10.18653/v1/W16-3603 ↗
9. Recurrent neural network with attention mechanism for language model10.1007/s00521-019-04301-x ↗
10. Controlling global statistics in recurrent neural network text generation
11. Sequence-to-sequence bangla sentence generation with LSTM recurrent neural networks10.1016/j.procs.2019.05.026 ↗
12. Convolutional recurrent neural networks for text classification
13. MTIL2017: machine translation using recurrent neural network on statistical machine translation10.1515/jisys-2018-0016 ↗
14. Lattice-based recurrent neural network encoders for neural machine translation
15. Time series forecasting of petroleum production using deep LSTM recurrent networks10.1016/j.neucom.2018.09.082 ↗
16. A dual-stage attention-based recurrent neural network for time series prediction10.24963/ijcai.2017/366 ↗
17. Recurrent neural networks hardware implementation on FPGA
18. A low power and real-time hardware recurrent neural network for time series analysis on wearable devices10.1016/j.micpro.2021.104374 ↗
19. An FPGA-based residual recurrent neural network for real-time video super-resolution10.1109/TCSVT.2021.3080241 ↗
20. Large scale recurrent neural network on GPU
21. Accelerating recurrent neural network training using sequence bucketing and multi-GPU data parallelization
22. MobiRNN: efficient recurrent neural network execution on mobile GPU
23. FARNN: FPGA-GPU hybrid acceleration platform for recurrent neural networks10.1109/TPDS.2021.3124125 ↗
24. Single stream parallelization of generalized LSTM-like RNNs on a GPU
25. Recurrent neural networks as versatile tools of neuroscience research10.1016/j.conb.2017.06.003 ↗
26. The economic limit to Moore’s law10.1109/TSM.2010.2089811 ↗
27. Miniaturization of CMOS10.3390/mi10050293 ↗
28. The future of the transistor10.1038/scientificamerican0693-70 ↗
29. Problems with ultraminiaturized transistors: making extremely small structures is only part of the challenge; new physical phenomena plague microcircuits as components shrink10.1126/science.208.4449.1246 ↗
30. Fundamental limits of silicon technology10.1109/5.915372 ↗
31. Neuro-inspired computing chips10.1038/s41928-020-0435-7 ↗
32. Neuromorphic computing using non-volatile memory10.1080/23746149.2016.1259585 ↗
33. Learning long-term dependencies with gradient descent is difficult10.1109/72.279181 ↗
34. Fast transient simulation of high-speed channels using recurrent neural network
35. Recent advances in recurrent neural networks
36. Memory-efficient backpropagation through time
37. Backpropagation algorithms and reservoir computing in recurrent neural networks for the forecasting of complex spatiotemporal dynamics10.1016/j.neunet.2020.02.016 ↗
38. Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition
39. Piezotronic neuromorphic devices: principle, manufacture, and applications10.1088/2631-7990/ad339b ↗
40. Design and micromanufacturing technologies of focused piezoelectric ultrasound transducers for biomedical applications10.1088/2631-7990/ad62c6 ↗
41. Boolean logic computing based on neuromorphic transistor10.1002/adfm.202305791 ↗
42. Mechano-driven logic-in-memory with neuromorphic triboelectric charge-trapping transistor10.1016/j.nanoen.2024.109622 ↗
43. Pulse electrochemical synaptic transistor for supersensitive and ultrafast biosensors10.1002/inf2.12478 ↗
44. Implementation of reservoir computing using volatile WOx-based memristor10.1016/j.apsusc.2022.153876 ↗
45. Tunable synaptic characteristics of a Ti/TiO2/Si memory device for reservoir computing10.1021/acsami.1c06618 ↗
46. Memristor-based reservoir computing
47. Deep reservoir computing: a critical experimental analysis10.1016/j.neucom.2016.12.089 ↗
48. Reservoir computing approaches for representation and classification of multivariate time series10.1109/TNNLS.2020.3001377 ↗
49. An experimental unification of reservoir computing methods10.1016/j.neunet.2007.04.003 ↗
50. Reservoir computing using dynamic memristors for temporal information processing10.1038/s41467-017-02337-y ↗
51. Prediction of chaotic time series using recurrent neural networks and reservoir computing techniques: a comparative study10.1016/j.mlwa.2022.100300 ↗
52. Optimizing a quantum reservoir computer for time series prediction10.1038/s41598-020-71673-9 ↗
53. Online time-series forecasting using spiking reservoir10.1016/j.neucom.2022.10.067 ↗
54. In-memory computing: the emerging computing topic in the post-von neumann era10.1109/MC.2023.3295610 ↗
55. A performance case-study on memristive computing-in-memory versus von neumann architecture
56. Smart logic-in-memory architecture for low-power non-von neumann computing10.1109/JEDS.2020.2987402 ↗
57. Novel in-memory computing circuit using muller C-element10.14791/btrt.2021.9.e13 ↗
58. Three-dimensional nanoscale flexible memristor networks with ultralow power for information transmission and processing application10.1021/acs.nanolett.9b05271 ↗
59. Resistive switching materials for information processing10.1038/s41578-019-0159-3 ↗
60. A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications10.1021/nl203687n ↗
61. Memristor devices for neural networks10.1088/1361-6463/aae223 ↗
62. Low-power, self-rectifying, and forming-free memristor with an asymmetric programing voltage for a high-density crossbar application10.1021/acs.nanolett.6b01781 ↗
63. Short-term memory to long-term memory transition in a nanoscale memristor10.1021/nn202983n ↗
64. Forgetting memristors and memristor bridge synapses with long- and short-term memories10.1016/j.neucom.2021.05.062 ↗
65. Emulating short-term synaptic dynamics with memristive devices10.1038/srep18639 ↗
66. Bioinspired in‐sensor reservoir computing for self‐adaptive visual recognition with two‐dimensional dual‐mode phototransistors10.1002/adom.202300271 ↗
67. Echo state graph neural networks with analogue random resistive memory arrays10.1038/s42256-023-00609-5 ↗
68. An optoelectronic synapse based on α-In2Se3 with controllable temporal dynamics for multimode and multiscale reservoir computing10.1038/s41928-022-00847-2 ↗
69. In-sensor reservoir computing for language learning via two-dimensional memristors10.1126/sciadv.abg1455 ↗
70. Recent advances in physical reservoir computing: a review10.1016/j.neunet.2019.03.005 ↗
71. An overview of reservoir computing: theory, applications and implementations
72. Novel fabrication techniques for ultra-thin silicon based flexible electronics10.1088/2631-7990/ad492e ↗
73. Optical wafer defect inspection at the 10 nm technology node and beyond10.1088/2631-7990/ac64d7 ↗
74. Recent advances in nanofiber-based flexible transparent electrodes10.1088/2631-7990/acdc66 ↗
75. An integrated fuzzy logic and machine learning platform for porosity detection using optical tomography imaging during laser powder bed fusion10.1088/2631-7990/ad65cd ↗
76. Preparation of MXene-based hybrids and their application in neuromorphic devices10.1088/2631-7990/ad1573 ↗
77. Plasma etching selectivity of ZrO2 to Si in BCl3/Cl2 plasmas10.1116/1.1615975 ↗
78. Role of N2 addition on CF4/O2 remote plasma chemical dry etching of polycrystalline silicon10.1116/1.580795 ↗
79. Role of steady state fluorocarbon films in the etching of silicon dioxide using CHF3 in an inductively coupled plasma reactor10.1116/1.580655 ↗
80. Thermal crosstalk in 3-dimensional RRAM crossbar array10.1038/srep13504 ↗
81. A memristor-based in-memory computing network for hamming code error correction10.1109/LED.2019.2917944 ↗
82. 33.2 A fully integrated analog ReRAM based 78.4TOPS/W compute-in-memory chip with fully parallel MAC computing10.1038/s41598-019-57300-2 ↗
83. 33.1 A 74 TMACS/W CMOS-RRAM neurosynaptic core with dynamically reconfigurable dataflow and in-situ transposable weights for probabilistic graphical models
84. VSDCA: a voltage sensing differential column architecture based on 1T2R RRAM array for computing-in-memory accelerators10.1109/TCSI.2022.3186024 ↗
85. A library of atomically thin metal chalcogenides10.1038/s41586-018-0008-3 ↗
86. A universal approach for the synthesis of two-dimensional binary compounds10.1038/s41467-019-11075-2 ↗
87. CVD polymers for devices and device fabrication10.1002/adma.201604606 ↗
88. A systematic exfoliation technique for isolating large and pristine samples of 2D materials10.1088/2053-1583/2/3/034017 ↗
89. High-throughput mechanical exfoliation for low-cost production of van der waals nanosheets10.1002/smtd.202300326 ↗
90. Stacking of exfoliated two‐dimensional materials: a review10.1002/cjoc.202000092 ↗
91. Exfoliation of crystals10.1070/RCR4806 ↗
92. Recent progress on the mechanical exfoliation of 2D transition metal dichalcogenides10.1088/2053-1591/aca6c6 ↗
93. Toward understanding the efficient exfoliation of layered materials by water-assisted cosolvent liquid-phase exfoliation10.1021/acs.chemmater.6b01203 ↗
94. Graphene via sonication assisted liquid-phase exfoliation10.1039/C3CS60217F ↗
95. In-materio reservoir computing based on nanowire networks: fundamental, progress, and perspective10.1088/2752-5724/accd87 ↗
96. Reservoir computing using diffusive memristors10.1002/aisy.201900084 ↗
97. Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing10.1038/nmat4756 ↗
98. Temporal data classification and forecasting using a memristor-based reservoir computing system10.1038/s41928-019-0313-3 ↗
99. Oscillation and chaos in physiological control systems10.1126/science.267326 ↗
100. Mackey-glass chaotic time series prediction using modified RBF neural networks