journal article·2021-04Open access

An atomic Boltzmann machine capable of self-adaption

Brian Kiraly, Elze J. Knol, Werner M. J. van Weerdenburg, Hilbert J. Kappen, Alexander A. Khajetoorians

Nature Nanotechnology· Volume 16· Issue 4

Abstract

The quest to implement machine learning algorithms in hardware has focused on combining various materials, each mimicking a computational primitive, to create device functionality. Ultimately, these piecewise approaches limit functionality and efficiency, while complicating scaling and on-chip learning, necessitating new approaches linking physical phenomena to machine learning models. Here, we create an atomic spin system that emulates a Boltzmann machine directly in the orbital dynamics of one well-defined material system. Utilizing the concept of orbital memory based on individual cobalt atoms on black phosphorus, we fabricate the prerequisite tuneable multi-well energy landscape by gating patterned atomic ensembles using scanning tunnelling microscopy. Exploiting the anisotropic behaviour of black phosphorus, we realize plasticity with multi-valued and interlinking synapses that lead to tuneable probability distributions. Furthermore, we observe an autonomous reorganization of the synaptic weights in response to external electrical stimuli, which evolves at a different time scale compared to neural dynamics. This self-adaptive architecture paves the way for autonomous learning directly in atomic-scale machine learning hardware.
Source: europepmc · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Ferroelectric and Negative Capacitance Devices

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (38)

Show source-provided references
1. Strukov, D. B., Snider, G. S., Stewart, D. R. & Williams, R. S. The missing memristor found. Nature 453, 80–83 (2008).10.1038/nature06932 ↗
2. Chen, T. et al. Classification with a disordered dopant-atom network in silicon. Nature 577, 341–345 (2020).10.1038/s41586-019-1901-0 ↗
3. Bose, S. K. et al. Evolution of a designless nanoparticle network into reconfigurable Boolean logic. Nat. Nanotechnol. 10, 1048–1052 (2015).10.1038/nnano.2015.207 ↗
4. Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428–431 (2017).10.1038/nature23011 ↗
5. Romera, M. et al. Vowel recognition with four coupled spin-torque nano-oscillators. Nature 563, 230–234 (2018).10.1038/s41586-018-0632-y ↗
6. Grollier, J., Querlioz, D. & Stiles, M. D. Spintronic nanodevices for bioinspired computing. proceedings of the IEEE. Inst. Electr. Electron. Eng. 104, 2024–2039 (2016).10.1109/JPROC.2016.2597152 ↗
7. McMahon, P. L. et al. A fully programmable 100-spin coherent ising machine with all-to-all connections. Science 354, 614–617 (2016).10.1126/science.aah5178 ↗
8. Prezioso, M. et al. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521, 61–64 (2015).10.1038/nature14441 ↗
9. Burr, G. W. et al. Neuromorphic computing using non-volatile memory. Adv. Phys. X 2, 89–124 (2017).
10. Borders, W. A. et al. Integer factorization using stochastic magnetic tunnel junctions. Nature 573, 390–393 (2019).10.1038/s41586-019-1557-9 ↗
11. Feldmann, J., Youngblood, N., Wright, C. D., Bhaskaran, H. & Pernice, W. H. P. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature 569, 208–214 (2019).10.1038/s41586-019-1157-8 ↗
12. Wang, Z. et al. Fully memristive neural networks for pattern classification with unsupervised learning. Nat. Electron. 1, 137–145 (2018).10.1038/s41928-018-0023-2 ↗
13. Ishii, M. et al. On-Chip Trainable 1.4M 6T2R PCM Synaptic Array with 1.6K Stochastic LIF Neurons for Spiking RBM. In IEEE International Electron Devices Meeting (IEDM) 14.2.1–14.2.4 (IEEE, 2019).10.1109/IEDM19573.2019.8993466 ↗
14. Kieferová, M. & Wiebe, N. Tomography and generative training with quantum boltzmann machines. Phys. Rev. A 96, 062327 (2017).10.1103/PhysRevA.96.062327 ↗
15. Amin, M. H., Andriyash, E., Rolfe, J., Kulchytskyy, B. & Melko, R. Quantum boltzmann Machine. Phys. Rev. X 8, 021050 (2018).
16. Kappen, H. J. Learning quantum models from quantum or classical data. J. Phys. A: Math. Theor. 53, 214001 (2020).10.1088/1751-8121/ab7df6 ↗
17. Hinton, G. & Sejnowski, T. Optimal perceptual inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 448–453 (IEEE, 1983).
18. Hertz, J., Krough, A. & Palmer, R. G. Introduction to the Theory of Neural Computation (CRC Press, 1991).10.1063/1.2810360 ↗
19. Edwards, S. F. & Anderson, P. W. Theory of spin glasses. II. J. Phys. F. 6, 1927 (1976).10.1088/0305-4608/6/10/022 ↗
20. Edwards, S. F. & Anderson, P. W. Theory of spin glasses. J. Phys. F. 5, 965 (1975).10.1088/0305-4608/5/5/017 ↗
21. Sherrington, D. & Kirkpatrick, S. Solvable model of a Spin-Glass. Phys. Rev. Lett. 35, 1792 (1975).10.1103/PhysRevLett.35.1792 ↗
22. Hirjibehedin, C. F., Lutz, C. P. & Heinrich, A. J. Spin coupling in engineered atomic structures. Science 312, 1021–1024 (2006).10.1126/science.1125398 ↗
23. Khajetoorians, A. A., Wiebe, J., Chilian, B. & Wiesendanger, R. Realizing all-spin–based logic operations atom by atom. Science 332, 1062–1064 (2011).10.1126/science.1201725 ↗
24. Khajetoorians, A. A. et al. Atom-by-atom engineering and magnetometry of tailored nanomagnets. Nat. Phys. 8, 497–503 (2012).10.1038/nphys2299 ↗
25. Toskovic, R. et al. Atomic spin-chain realization of a model for quantum criticality. Nat. Phys. 12, 656–660 (2016).10.1038/nphys3722 ↗
26. Loth, S., Baumann, S., Lutz, C. P., Eigler, D. M. & Heinrich, A. J. Bistability in atomic-scale antiferromagnets. Science 335, 196–199 (2012).10.1126/science.1214131 ↗
27. Khajetoorians, A. A. et al. Current-Driven spin dynamics of artificially constructed quantum magnets. Science 339, 55–59 (2013).10.1126/science.1228519 ↗
28. Kiraly, B. et al. An orbitally derived single-atom magnetic memory. Nat. Commun. 9, 3904 (2018).10.1038/s41467-018-06337-4 ↗
29. Kiraly, B. et al. Anisotropic Two-Dimensional screening at the surface of black phosphorus. Phys. Rev. Lett. 123, 216403 (2019).10.1103/PhysRevLett.123.216403 ↗
30. Prishchenko, D. A., Mazurenko, V. G., Katsnelson, M. I. & Rudenko, A. N. Coulomb interactions and screening effects in few-layer black phosphorus: a tight-binding consideration beyond the long-wavelength limit. 2D Mater. 4, 025064 (2017).10.1088/2053-1583/aa676b ↗
31. Baldassi, C., Braunstein, A., Brunel, N. & Zecchina, R. Efficient supervised learning in networks with binary synapses. Proc. Natl Acad. Sci. USA 104, 11079–11084 (2007).10.1073/pnas.0700324104 ↗
32. Purves, D. et al. Neuroscience (Sinauer Associates, 2019).
33. Heskes, T. M. & Kappen, B. Learning processes in neural networks. Phys. Rev. A 44, 2718–2726 (1991).10.1103/PhysRevA.44.2718 ↗
34. Fuechsle, M. et al. A single-atom transistor. Nat. Nanotechnol. 7, 242–246 (2012).10.1038/nnano.2012.21 ↗
35. Rudenko, A. N., Keil, F. J., Katsnelson, M. I. & Lichtenstein, A. I. Adsorption of cobalt on graphene: electron correlation effects from a quantum chemical perspective. Phys. Rev. B 86, 075422 (2012).10.1103/PhysRevB.86.075422 ↗
36. Kolmus, A., Katsnelson, M. I., Khajetoorians, A. A. & Kappen, H. J. Atom-by-atom construction of attractors in a tunable finite size spin array. New J. Phys. 22, 023038 (2020).10.1088/1367-2630/ab6f91 ↗
37. Lavielle, M. Using penalized contrasts for the change-point problem. Signal Process. 85, 1501–1510 (2005).10.1016/j.sigpro.2005.01.012 ↗
38. Killick, R., Fearnhead, P. & Eckley, I. A. Optimal detection of changepoints with a linear computational cost. J. Am. Stat. Assoc. 107, 1590–1598 (2012).10.1080/01621459.2012.737745 ↗