journal article·2023-07-20Open access

STDP-Driven Rewiring in Spiking Neural Networks under Stimulus-Induced and Spontaneous Activity

Sergey A. Lobov, Ekaterina S. Berdnikova, Alexey I. Zharinov, Dmitry P. Kurganov, Victor B. Kazantsev

Biomimetics· Volume 8· Issue 3

Abstract

Mathematical and computer simulation of learning in living neural networks have typically focused on changes in the efficiency of synaptic connections represented by synaptic weights in the models. Synaptic plasticity is believed to be the cellular basis for learning and memory. In spiking neural networks composed of dynamical spiking units, a biologically relevant learning rule is based on the so-called spike-timing-dependent plasticity or STDP. However, experimental data suggest that synaptic plasticity is only a part of brain circuit plasticity, which also includes homeostatic and structural plasticity. A model of structural plasticity proposed in this study is based on the activity-dependent appearance and disappearance of synaptic connections. The results of the research indicate that such adaptive rewiring enables the consolidation of the effects of STDP in response to a local external stimulation of a neural network. Subsequently, a vector field approach is used to demonstrate the successive “recording” of spike paths in both functional connectome and synaptic connectome, and finally in the anatomical connectome of the network. Moreover, the findings suggest that the adaptive rewiring could stabilize network dynamics over time in the context of activity patterns’ reproducibility. A universal measure of such reproducibility introduced in this article is based on similarity between time-consequent patterns of the special vector fields characterizing both functional and anatomical connectomes.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural dynamics and brain function · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Laboratory of Neurobiomorphic Technologies, The Moscow Institute of Physics and Technology, 117303 Moscow, Russia

Neurotechnology Department, Lobachevsky State University of Nizhny Novgorod, 603022 Nizhny Novgorod, Russia

Laboratory of Neuromodeling, Samara State Medical University, 443079 Samara, Russia

Funding

Priority 2030 Program (development of the rewiring model and numerical experiments) and by the Ministry of Science and Higher Education of the Russian Federation

References (56)

Show source-provided references
1. Hall, P. (1998). Neural Networks. A Comprehensive Foundation, Prentice Hall PTR. [2nd ed.].
2. Hebb, D.O. (1949). The Organization of Behavior: A Neuropsychological Theory, Wiley.
3. Self-Organized Formation of Topologically Correct Feature Maps10.1007/BF00337288 ↗
4. A History of Spike-Timing-Dependent Plasticity10.3389/fnsyn.2011.00004 ↗
5. The Dialectic of Hebb and Homeostasis10.1098/rstb.2016.0258 ↗
6. Cortical Rewiring and Information Storage10.1038/nature03012 ↗
7. Structural Homeostasis in the Nervous System: A Balancing Act for Wiring Plasticity and Stability10.3389/fncel.2014.00439 ↗
8. Lazarevich, I., Stasenko, S., Rozhnova, M., Pankratova, E., Dityatev, A., and Kazantsev, V. (2020). Activity-Dependent Switches between Dynamic Regimes of Extracellular Matrix Expression. PLoS ONE, 15.10.1371/journal.pone.0227917 ↗
9. Astrocytes Mediate Analogous Memory in a Multi-Layer Neuron–Astrocyte Network10.1007/s00521-022-06936-9 ↗
10. Controlling Synchronization of Gamma Oscillations by Astrocytic Modulation in a Model Hippocampal Neural Network10.1038/s41598-022-10649-3 ↗
11. Estimating Integrated Information in Bidirectional Neuron-Astrocyte Communication10.1103/PhysRevE.103.022410 ↗
12. Long-Term Dendritic Spine Stability in the Adult Cortex10.1038/nature01276 ↗
13. Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue10.1016/S0896-6273(01)00252-5 ↗
14. Choice and Value Flexibility Jointly Contribute to the Capacity of a Subsampled Quadratic Classifier10.1162/089976600300015556 ↗
15. MacKay, D.J.C., and Mac Kay, D.J.C. (2003). ; others Information Theory, Inference and Learning Algorithms, Cambridge University Press.
16. Brain Plasticity and Behavior10.1146/annurev.psych.49.1.43 ↗
17. Differential Rearing Effects on Rat Visual Cortex Synapses. I. Synaptic and Neuronal Density and Synapses per Neuron10.1016/0006-8993(85)90525-6 ↗
18. Long-Term in Vivo Imaging of Experience-Dependent Synaptic Plasticity in Adult Cortex10.1038/nature01273 ↗
19. Formation of Dendritic Spines with GABAergic Synapses Induced by Whisker Stimulation in Adult Mice10.1016/S0896-6273(02)00663-3 ↗
20. A Golgi-Cox Morphological Analysis of Neuronal Changes Induced by Environmental Enrichment10.1016/S0165-3806(02)00642-9 ↗
21. Somatosensory Cortical Map Changes Following Digit Amputation in Adult Monkeys10.1002/cne.902240408 ↗
22. Massive Cortical Reorganization After Sensory Deafferentation in Adult Macaques10.1126/science.1843843 ↗
23. Axonal Sprouting Accompanies Functional Reorganization in Adult Cat Striate Cortex10.1038/368737a0 ↗
24. Adult Cortical Dynamics10.1152/physrev.1998.78.2.467 ↗
25. Recovery of Visual Responses in Foveal V1 Neurons Following Bilateral Foveal Lesions in Adult Monkey10.1007/BF00229845 ↗
26. Gallinaro, J.V., Gašparović, N., and Rotter, S. (2022). Homeostatic Control of Synaptic Rewiring in Recurrent Networks Induces the Formation of Stable Memory Engrams. PLoS Comput. Biol., 18.10.1371/journal.pcbi.1009836 ↗
27. Butz, M., and van Ooyen, A. (2013). A Simple Rule for Dendritic Spine and Axonal Bouton Formation Can Account for Cortical Reorganization after Focal Retinal Lesions. PLoS Comput. Biol., 9.10.1371/annotation/e8b7df48-4639-4ac1-8a98-cb13dea3415b ↗
28. Automatic Generation of Connectivity for Large-Scale Neuronal Network Models through Structural Plasticity
29. Effect of Stimulus-Driven Pruning on the Detection of Spatiotemporal Patterns of Activity in Large Neural Networks10.1016/j.biosystems.2006.05.020 ↗
30. Multicontact Co-Operativity in Spike-Timing–Dependent Structural Plasticity Stabilizes Networks10.1093/cercor/bhx339 ↗
31. Emergence of Stable Synaptic Clusters on Dendrites Through Synaptic Rewiring10.3389/fncom.2020.00057 ↗
32. Basic Principles Drive Self-Organization of Brain-like Connectivity Structure10.1016/j.cnsns.2019.105065 ↗
33. Miner, D., and Triesch, J. (2016). Plasticity-Driven Self-Organization under Topological Constraints Accounts for Non-Random Features of Cortical Synaptic Wiring. PLoS Comput. Biol., 12.10.1371/journal.pcbi.1004759 ↗
34. Structural Plasticity Denoises Responses and Improves Learning Speed10.3389/fncom.2016.00093 ↗
35. Adaptive Rewiring in Weighted Networks Shows Specificity, Robustness, and Flexibility10.3389/fnsys.2021.580569 ↗
36. A Soft-Pruning Method Applied During Training of Spiking Neural Networks for In-Memory Computing Applications10.3389/fnins.2019.00405 ↗
37. Chen, Y., Yu, Z., Fang, W., Huang, T., and Tian, Y. (2021). Pruning of Deep Spiking Neural Networks through Gradient Rewiring. IJCAI Int. Jt. Conf. Artif. Intell., 1713–1721.10.24963/ijcai.2021/236 ↗
38. STDP-Based Pruning of Connections and Weight Quantization in Spiking Neural Networks for Energy-Efficient Recognition10.1109/TCAD.2018.2819366 ↗
39. Lobov, S.A., Mikhaylov, A.N., Berdnikova, E.S., Makarov, V.A., and Kazantsev, V.B. (2023). Spatial Computing in Modular Spiking Neural Networks with a Robotic Embodiment. Mathematics, 11.10.3390/math11010234 ↗
40. Lobov, S.A., Zharinov, A.I., Makarov, V.A., and Kazantsev, V.B. (2021). Spatial Memory in a Spiking Neural Network with Robot Embodiment. Sensors, 21.10.3390/s21082678 ↗
41. Simple Model of Spiking Neurons10.1109/TNN.2003.820440 ↗
42. Which Model to Use for Cortical Spiking Neurons?10.1109/TNN.2004.832719 ↗
43. Neural Networks with Dynamic Synapses10.1162/089976698300017502 ↗
44. An Extremely Rich Repertoire of Bursting Patterns during the Development of Cortical Cultures10.1186/1471-2202-7-11 ↗
45. Gritsun, T.A., le Feber, J., and Rutten, W.L.C. (2012). Growth Dynamics Explain the Development of Spatiotemporal Burst Activity of Young Cultured Neuronal Networks in Detail. PLoS ONE, 7.10.1371/journal.pone.0043352 ↗
46. Spiking Signatures of Spontaneous Activity Bursts in Hippocampal Cultures10.3389/fncom.2011.00046 ↗
47. Phenomenological Models of Synaptic Plasticity Based on Spike Timing10.1007/s00422-008-0233-1 ↗
48. Competitive Hebbian Learning through Spike-Timing-Dependent Synaptic Plasticity10.1038/78829 ↗
49. Network Response Synchronization Enhanced by Synaptic Plasticity10.1140/epjst/e2016-02614-y ↗
50. (2022, December 29). Spiking Neurosimulator NeuroNet with a User-Friendly Graphical Interface. Available online: http://spneuro.net.
51. Toward Reflective Spiking Neural Networks Exploiting Memristive Devices10.3389/fncom.2022.859874 ↗
52. Identifying Repeating Motifs in the Activation of Synchronized Bursts in Cultured Neuronal Networks10.1016/j.jneumeth.2007.12.020 ↗
53. Ikegaya, Y., Matsumoto, W., Chiou, H.-Y., Yuste, R., and Aaron, G. (2008). Statistical Significance of Precisely Repeated Intracellular Synaptic Patterns. PLoS ONE, 3.10.1371/journal.pone.0003983 ↗
54. Kazantsev, V., Gordleeva, S., Stasenko, S., and Dityatev, A. (2012). A Homeostatic Model of Neuronal Firing Governed by Feedback Signals from the Extracellular Matrix. PLoS ONE, 7.10.1371/journal.pone.0041646 ↗
55. Llinás, R.R. (2002). I of the Vortex: From Neurons to Self, MIT Press.10.7551/mitpress/3626.001.0001 ↗
56. Molecular Signals of Plasticity at the Tetrapartite Synapse10.1016/j.conb.2010.12.006 ↗