journal article·2024-10-30

Ferrimagnet-Based Neuromorphic Device Mimicking the Ventral Visual Pathway for High-Accuracy Target Recognition

Junwei Zeng, Yabo Chen, Jiahao Liu, Teng Xu, Liang Fang, Yang Guo

ACS Applied Materials & Interfaces· Volume 16· Issue 43
Publisher page

Abstract

The ventral visual pathway (VVP) of the human brain efficiently implements target recognition by employing a deep hierarchical structure to build complex visual concepts from simple features. Artificial neural networks (ANNs) based on spintronic devices are capable of target recognition, but their poor interpretability and limited network depth hinder ANNs from mimicking the VVP. Hardware implementation of the VVP requires a biorealistic spintronic device as well as the corresponding interpretable and deep network structure, which have not been reported so far. Here, we report a ferrimagnetic neuron with a continuously differentiable exponential linear unit (CeLu) activation function, which is closer to biological neurons and could mitigate the issue of limited network depth. Meanwhile, we also demonstrate that a ferrimagnet can construct artificial synapses with high linearity and symmetry to meet the requirements of weight update algorithms. Based on these neurons and synapses, we propose an all-spin convolutional neural network (CNN) with a high interpretability and deep neural network, to mimic the VVP. Compared to the state-of-the-art spintronic-based neuromorphic computing model, the CNN with bionic function, using experimentally derived device parameters, achieves high recognition accuracies of over 91% and 98% on the CIFAR-10 datasets and the MNIST datasets, respectively, showing improvements of 1.13% and 1.76%. Our work provides a promising method to improve the bionic performance of spintronic device-based neural networks.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Ferroelectric and Negative Capacitance Devices

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

The Key Laboratory of Advanced Microprocessor Chips and Systems, College of Computer

National University of Defense Technology

Institute for Quantum Information & State Key Laboratory of High Performance Computing, College of Computer

College of Advanced Interdisciplinary Studies & Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices

Nanhu Laser Laboratory

Anhui Province Key Laboratory of Low-Energy Quantum Materials and Devices, High Magnetic Field Laboratory, HFIPS

Chinese Academy of Sciences

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · Research Foundation from NUDT

References (54)

Show source-provided references
1. 10.1073/pnas.201419611810.1073/pnas.2014196118 ↗
2. Geirhos R. · Adv. Neural Inf. Process. Syst. · 2021 · 34 · 23885
3. 10.1002/adma.20230198610.1002/adma.202301986 ↗
4. 10.1038/s41528-024-00313-310.1038/s41528-024-00313-3 ↗
5. 10.1007/s11433-019-1499-310.1007/s11433-019-1499-3 ↗
6. 10.1038/s41928-019-0360-910.1038/s41928-019-0360-9 ↗
7. 10.7567/APEX.11.03010110.7567/APEX.11.030101 ↗
8. 10.1038/s42254-020-0208-210.1038/s42254-020-0208-2 ↗
9. 10.1063/5.010461810.1063/5.0104618 ↗
10. 10.1038/s41563-021-01139-410.1038/s41563-021-01139-4 ↗
11. 10.1016/j.mattod.2023.10.00410.1016/j.mattod.2023.10.004 ↗
12. 10.1002/adma.20190714810.1002/adma.201907148 ↗
13. 10.1021/acsnano.2c0974410.1021/acsnano.2c09744 ↗
14. 10.1002/adma.20210367210.1002/adma.202103672 ↗
15. 10.1002/advs.20220247810.1002/advs.202202478 ↗
16. 10.1038/s41467-024-48631-410.1038/s41467-024-48631-4 ↗
17. 10.1038/s41928-020-0385-010.1038/s41928-020-0385-0 ↗
18. 10.1021/acsaelm.3c0042910.1021/acsaelm.3c00429 ↗
19. 10.1021/acsami.3c1206110.1021/acsami.3c12061 ↗
20. 10.1002/adfm.20210787010.1002/adfm.202107870 ↗
21. 10.1002/adfm.20240467910.1002/adfm.202404679 ↗
22. 10.1038/s41467-024-45109-110.1038/s41467-024-45109-1 ↗
23. 10.1063/5.000948210.1063/5.0009482 ↗
24. 10.1021/acs.nanolett.4c0171210.1021/acs.nanolett.4c01712 ↗
25. 10.1126/science.285.5429.86710.1126/science.285.5429.867 ↗
26. 10.1103/PhysRevLett.109.09660210.1103/PhysRevLett.109.096602 ↗
27. 10.1126/science.121819710.1126/science.1218197 ↗
28. 10.1523/JNEUROSCI.1922-17.201810.1523/JNEUROSCI.1922-17.2018 ↗
29. 10.1038/nature0461010.1038/nature04610 ↗
30. Lau, M. M.; Lim, K. H. Review of Adaptive Activation Function in Deep Neural Network. In 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), 2018; pp 686–690.10.1109/IECBES.2018.8626714 ↗
31. 10.1063/1.509056610.1063/1.5090566 ↗
32. Chen, P.Y.; Peng, X.; Yu, S. NeuroSim+: An integrated device-to-algorithm framework for benchmarking synaptic devices and array architectures. In 2017 IEEE International Electron Devices Meeting, 2017; pp 6.1.1–6.1.4.10.1109/IEDM.2017.8268337 ↗
33. 10.1002/adfm.20180417010.1002/adfm.201804170 ↗
34. 10.1038/323533a010.1038/323533a0 ↗
35. 10.1038/nature1453910.1038/nature14539 ↗
36. 10.1038/nrn300810.1038/nrn3008 ↗
37. 10.1038/npre.2011.6117.210.1038/npre.2011.6117.2 ↗
38. 10.1038/nrn321410.1038/nrn3214 ↗
39. 10.1093/cercor/1.1.110.1093/cercor/1.1.1 ↗
40. 10.1146/annurev.neuro.23.1.31510.1146/annurev.neuro.23.1.315 ↗
41. 10.1073/pnas.152550511310.1073/pnas.1525505113 ↗
42. 10.1016/j.neuron.2013.02.02410.1016/j.neuron.2013.02.024 ↗
43. 10.1038/s41586-020-2350-510.1038/s41586-020-2350-5 ↗
44. 10.1002/aelm.20180078210.1002/aelm.201800782 ↗
45. 10.1038/s41427-021-00282-310.1038/s41427-021-00282-3 ↗
46. 10.1103/PhysRevApplied.19.02403410.1103/PhysRevApplied.19.024034 ↗
47. 10.1109/TED.2022.322049210.1109/TED.2022.3220492 ↗
48. 10.1109/TED.2023.332703110.1109/TED.2023.3327031 ↗
49. 10.1021/acsaelm.2c0148810.1021/acsaelm.2c01488 ↗
50. 10.1039/D4NR01003E10.1039/D4NR01003E ↗
51. 10.1038/s44306-023-00006-z10.1038/s44306-023-00006-z ↗
52. 10.1021/acsami.3c1719510.1021/acsami.3c17195 ↗
53. Ojha, D. K.; Huang, Y.H.; Lin, Y.L.; Chatterjee, R.; Chang, W.Y.; Tseng, Y.C. Neuromorphic Computing with the Ferromagnetic/Antiferromagnetic SOT Systems: The Role of Emerging Antiferromagnetic Phase. In 2024 IEEE International Magnetic Conference─Short Papers (INTERMAG Short Papers), 2024.10.1109/INTERMAGShortPapers61879.2024.10576959 ↗
54. 10.1109/Tnnls.2024.336996910.1109/Tnnls.2024.3369969 ↗