3D Stackable Synaptic Transistor for 3D Integrated Artificial Neural Networks
Source abstract
Abstract
Although they have attracted enormous attention in recent years, software-based and two-dimensional hardware-based artificial neural networks (ANNs) may consume a great deal of power. Because there will be numerous data transmissions through a long interconnection for learning, power consumption in the interconnect will be an inevitable problem for low-power computing. Therefore, we suggest and report 3D stackable synaptic transistors for 3D ANNs, which would be the strongest candidate in future computing systems by minimizing power consumption in the interconnection. To overcome the problems of enormous power consumption, it might be necessary to introduce a 3D stackable ANN platform. With this structure, short vertical interconnection can be realized between the top and bottom devices, and the integration density can be significantly increased for integrating numerous neuromorphic devices. In this paper, we suggest and show the feasibility of monolithic 3D integration of synaptic devices using the channel layer transfer method through a wafer bonding technique. Using a low-temperature processible III–V and composite oxide (Al2O3/HfO2/Al2O3)-based weight storage layer, we successfully demonstrated synaptic transistors showing good linearity (αp/αd = 1.8/0.5), a high transconductance ratio (6300), and very good stability. High learning accuracy of 97% was obtained in the training of 1 million MNIST images based on the device characteristics.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Memory and Neural Computing · Neuroscience and Neural Engineering · CCD and CMOS Imaging Sensors
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
Korea Institute of Science and Technology (KIST), Seoul 02792, Republic of Korea
Division of Materials Science and Engineering, Hanyang University, Seoul 04763, Republic of Korea
Funding
Ministry of Education · National Research Foundation of Korea · Ministry of Trade, Industry and Energy · KAIST
References (64)
Show source-provided references
1. Bohr, M. T. Interconnect Scaling-the Real Limiter to High Performance ULSI. Technical Digest—International Electron Devices Meeting; IEEE, 2002; pp 241–244.
2. 10.1109/16.24943310.1109/16.249433 ↗
3. Li, L.; Wong, H. P. Integrating Graphene into Future Generations of Interconnect Wires. Technical Digest—International Electron Devices Meeting; IEEE, 2018; pp 118–121.10.1109/IEDM.2018.8614651 ↗
4. Fischer, K.; Agostinelli, M.; Allen, C.; Bahr, D.; Bost, M.; Charvat, P.; Chikarmane, V.; Fu, Q.; Ganpule, C.; Haran, M.; Heckscher, M.; Hiramatsu, H.; Hwang, E.; Jain, P.; Jin, I.; Kasim, R.; Kosaraju, S.; Lee, K. S.; Liu, H.; McFadden, R.; Nigam, S.; Patel, R.; Pelto, C.; Plekhanov, P.; Prince, M.; Puls, C.; Rajamani, S.; Rao, D.; Reese, P.; Rosenbaum, A.; Sivakumar, S.; Song, B.; Uncuer, M.; Williams, S.; Yang, M.; Yashar, P.; Natarajan, S. Low-k Interconnect Stack with Multi-Layer Air Gap and Tri-Metal-Insulator-Metal Capacitors for 14 nm High Volume Manufacturing. 2015 IEEE International Interconnect Technology Conference and IEEE Materials for Advanced Metallization Conference (IITC/MAM), 2015; pp 5–7.10.1109/IITC-MAM.2015.7325600 ↗
5. Cheng, K.; Park, C.; Yeung, C.; Nguyen, S.; Zhang, J.; Miao, X.; Wang, M.; Mehta, S.; Li, J.; Surisetty, C.; Muthinti, R.; Liu, Z.; Tang, H.; Tsai, S.; Yamashita, T.; Bu, H.; Divakaruni, R. Air Spacer for 10 nm FinFET CMOS and Beyond. Technical Digest—International Electron Devices Meeting, 2016; pp 444–447.10.1109/IEDM.2016.7838436 ↗
6. 10.1016/j.mee.2014.10.01910.1016/j.mee.2014.10.019 ↗
7. Woo, D. H.; Seong, N. H.; Lewis, D. L.; Lee, H.H. S. An Optimized 3D-Stacked Memory Architecture by Exploiting Excessive, High-Density TSV Bandwidth. HPCA—16 2010 The Sixteenth International Symposium on High-Performance Computer Architecture; IEEE, 2010; pp 1–12.10.1109/HPCA.2010.5416628 ↗
8. 10.1108/1356536111112730410.1108/13565361111127304 ↗
9. Farooq, M. G.; Graves-Abe, T. L.; Landers, W. F.; Kothandaraman, C.; Himmel, B. A.; Andry, P. S.; Tsang, C. K.; Sprogis, E.; Volant, R. P.; Petrarca, K. S.; Winstel, K. R.; Safran, J. M.; Sumllivan, T. D.; Chen, F.; Shapiro, M. J.; Hannon, R.; Liptak, R.; Berger, D.; Iyer, S. S. 3D Copper TSV Integration, Testing and Reliability. Technical Digest—International Electron Devices Meeting; IEEE, 2011; pp 143–146.10.1109/IEDM.2011.6131504 ↗
10. Sukegawa, S.; Umebayashi, T.; Nakajima, T.; Kawanobe, H.; Koseki, K.; Hirota, I.; Haruta, T.; Kasai, M.; Fukumoto, K.; Wakano, T.; Inoue, K.; Takahashi, H.; Nagano, T.; Nitta, Y.; Hirayama, T.; Fukushima, N. A 1/4-Inch 8Mpixel Back-Illuminated Stacked CMOS Image Sensor. Digest of Technical Papers—IEEE International Solid-State Circuits Conference, 2013; Vol. 56, pp 484–485.10.1109/ISSCC.2013.6487825 ↗
11. Rachmady, W.; Agrawal, A.; Sung, S. H.; Dewey, G.; Chouksey, S.; Elbaz, G.; Fischer, P.; Huang, C. Y.; Jun, K.; Krist, B.; Jun, K.; Lin, K.; Nidhi, N.; Michaelos, T.; Mueller, B.; Paul, R.; Peck, J.; Rachmady, W.; Staines, D.; Talukdar, T.; Tronic, T.; Fischer, P.; Hafez, W. 300 mm Heterogeneous 3D Integration of Record Performance Layer Transfer Germanium PMOS with Silicon NMOS for Low Power High Performance Logic Applications. International Electron Devices Meeting, 2019; pp 697–700.10.1109/IEDM19573.2019.8993626 ↗
12. Then, H. W.; Dasgupta, S.; Radosavljevic, M.; Agababov, P.; Ban, I.; Bristol, R.; Chandhok, M.; Chouksey, S.; Holybee, B.; Huang, C. Y.; Krist, B.; Jun, K.; Lin, K.; Nidhi, N.; Michaelos, T.; Mueller, B.; Paul, R.; Peck, J.; Rachmady, W.; Staines, D.; Talukdar, T.; Thomas, T.; Fischer, P.; Hafez, W. 3D Heterogeneous Integration of High Performance High-K Metal Gate GaN NMOS and Si PMOS Transistors on 300mm High-Resistivity Si Substrate for Energy-Efficient and Compact Power Delivery, RF ( 5G and beyond ) and SoC Applications. International Electron Devices Meeting, 2019; pp 402–405.10.1109/IEDM19573.2019.8993583 ↗
13. Liu, C.; Lim, S. K. A Design Tradeoff Study with Monolithic 3D Integration. International Symposium on Quality Electronic Design (ISQED), 2012, No. 404; pp 529–536.10.1109/ISQED.2012.6187545 ↗
14. Panth, S.; Samal, S.; Yu, Y. S.; Lim, S. K. Design Challenges and Solutions for Ultra-High-Density Monolithic 3D ICs. 2014 SOI-3D-Subthreshold Microelectron. 2014 SOI-3D-Subthreshold Microelectronics Technology Unified Conference (S3S), 2014; pp 1–2.10.1109/S3S.2014.7028195 ↗
15. Moon, I.; Lee, M.; Ryu, J.; Mun, M. Intelligent Robotic Wheelchair with EMG- Gesture- and Voice-Based Interfaces. Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004; pp 3453–3458.
16. 10.1162/tacl_a_0006510.1162/tacl_a_00065 ↗
17. 10.1109/tbme.2012.222885810.1109/tbme.2012.2228858 ↗
18. 10.1109/tase.2014.237649210.1109/tase.2014.2376492 ↗
19. Wei, J.; Snider, J. M.; Kim, J.; Dolan, J. M.; Rajkumar, R.; Litkouhi, B. Towards a Viable Autonomous Driving Research Platform. IEEE Intelligent Vehicles Symposium (IV), 2013; pp 763–770.10.1109/IVS.2013.6629559 ↗
20. Billoint, O.; Sarhan, H.; Rayane, I.; Vinet, M.; Batude, P.; Fenouillet-Beranger, C.; Rozeau, O.; Cibrario, G.; Deprat, F.; Fustier, A.; Michallet, J.E.; Faynot, O.; Turkyilmaz, O.; Christmann, J.F.; Thuries, S.; Clermidy, F. A Comprehensive Study of Monolithic 3D Cell on Cell Design Using Commercial 2D Tool. 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2015; pp 1192–1196.10.7873/DATE.2015.1110 ↗
21. Chang, K.; Acharya, K.; Sinha, S.; Cline, B.; Yeric, G.; Lim, S. K. Power Benefit Study of Monolithic 3D IC at the 7nm Technology Node. 2015 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED), September, 2015; pp 201–206.10.1109/ISLPED.2015.7273514 ↗
22. Lee, Y.J.; Limbrick, D.; Lim, S. K. Power Benefit Study for Ultra-High Density Transistor-Level Monolithic 3D ICs. Proceedings of the 50th Annual Design Automation Conference on—DAC ’13, 2013; p 1.10.1145/2463209.2488863 ↗
23. 10.1038/s41563-018-0248-510.1038/s41563-018-0248-5 ↗
24. 10.1039/c8nr07133k10.1039/c8nr07133k ↗
25. 10.1039/c8nr04136a10.1039/c8nr04136a ↗
26. 10.1016/j.orgel.2018.09.00710.1016/j.orgel.2018.09.007 ↗
27. 10.1002/adma.20170095110.1002/adma.201700951 ↗
28. 10.1002/adma.20160082010.1002/adma.201600820 ↗
29. 10.1002/adma.20180576910.1002/adma.201805769 ↗
30. 10.1002/smll.20170093310.1002/smll.201700933 ↗
31. 10.1002/admt.20190003710.1002/admt.201900037 ↗
32. 10.1002/adma.20120368010.1002/adma.201203680 ↗
33. 10.1002/admt.20180058910.1002/admt.201800589 ↗
34. 10.1109/led.2018.278942510.1109/led.2018.2789425 ↗
35. Werner, T.; Vianello; Bichler, O.; Grossi, A.; Nowak, E.; Nodin, J. F.; Yvert, B.; Desalvo, B.; Perniola, L. Experimental Demonstration of Short and Long Term Synaptic Plasticity Using OxRAM Multi k-Bit Arrays for Reliable Detection in Highly Noisy Input Data. Technical Digest—International Electron Devices Meeting, 2016; pp 432–435.10.1109/IEDM.2016.7838433 ↗
36. 10.1002/adfm.20180484410.1002/adfm.201804844 ↗
37. Wu, H.; Yao, P.; Gao, B.; Wu, W.; Zhang, Q.; Zhang, W.; Deng, N.; Wu, D.; Wong, H. S. P.; Yu, S.; Qian, H. Device and Circuit Optimization of RRAM for Neuromorphic Computing. Technical Digest—International Electron Devices Meeting, 2017; pp 274–277.10.1109/IEDM.2017.8268372 ↗
38. 10.1186/s11671-017-1847-910.1186/s11671-017-1847-9 ↗
39. 10.1109/led.2016.258285910.1109/led.2016.2582859 ↗
40. 10.1186/s11671-017-2114-910.1186/s11671-017-2114-9 ↗
41. 10.3389/fnins.2015.0024110.3389/fnins.2015.00241 ↗
42. 10.1038/srep3151010.1038/srep31510 ↗
43. Chung, W.; Si, M.; Ye, P. D. First Demonstration of Ge Ferroelectric Nanowire FET as Synaptic Device for Online Learning in Neural Network with High Number of Conductance State and GMax/GMin. Technical Digest—International Electron Devices Meeting, 2018; pp 344–347.10.1109/IEDM.2018.8614516 ↗
44. 10.1039/c8nr04734k10.1039/c8nr04734k ↗
45. Mulaosmanovic, H.; Ocker, J.; Muller, S.; Noack, M.; Muller, J.; Polakowski, P.; Mikolajick, T.; Slesazeck, S. Novel Ferroelectric FET Based Synapse for Neuromorphic Systems. Digest of Technical Papers—Symposium on VLSI Technology, 2017; pp T176–T177.10.23919/VLSIT.2017.7998165 ↗
46. Jerry, M.; Chen, P.; Zhang, J.; Sharma, P.; Ni, K.; Yu, S.; Datta, S. Ferroelectric FET Analog Synapse for Acceleration of Deep Neural Network Training. Technical Digest—International Electron Devices Meeting, 2017; pp 139–142.10.1109/IEDM.2017.8268338 ↗
47. Kim S. K. · Re-use · 2016 · 6 · 616
48. 10.1109/ted.2017.272248210.1109/ted.2017.2722482 ↗
49. 10.1109/jeds.2018.280284010.1109/jeds.2018.2802840 ↗
50. 10.1021/acsphotonics.8b0087610.1021/acsphotonics.8b00876 ↗
51. Long J. P. · Opto-Electron. Rev. · 2002 · 10 · 251
52. Geum, D.M.; Kim, S. H.; Kim, S. K.; Kang, S. S.; Kyhm, J. H.; Song, J. D.; Choi, W. J.; Yoon, E. Monolithic Integration of GaAs//InGaAs Photodetectors for Multicolor Detection. Digest of Technical Papers—Symposium on VLSI Technology, 2019; pp T194–T195.10.23919/VLSIT.2019.8776526 ↗
53. 10.1364/oe.26.00624910.1364/oe.26.006249 ↗
54. 10.1109/led.2015.241787210.1109/led.2015.2417872 ↗
55. 10.1364/oe.23.02688810.1364/oe.23.026888 ↗
56. 10.1038/srep2061010.1038/srep20610 ↗
57. 10.1109/led.2016.260108110.1109/led.2016.2601081 ↗
58. 10.1063/1.498012210.1063/1.4980122 ↗
59. 10.1109/ted.2018.281030410.1109/ted.2018.2810304 ↗
60. 10.1063/1.500053210.1063/1.5000532 ↗
61. 10.3938/jkps.55.96210.3938/jkps.55.962 ↗
62. 10.1109/led.2015.241834210.1109/led.2015.2418342 ↗
63. 10.1063/1.495271810.1063/1.4952718 ↗
64. 10.1063/1.497489310.1063/1.4974893 ↗