Understanding plasticity in neural networks

C Lyle, Z Zheng, E Nikishin, BA Pires… - International …, 2023 - proceedings.mlr.press
… The robustness of existing optimizers across a wide range of datasets and network
architectures has played a key role in the widespread adoption of deep learning methods. For …

Cerebellar plasticity and associative memories are controlled by perineuronal nets

D Carulli, R Broersen, F de Winter… - Proceedings of the …, 2020 - National Acad Sciences
nets (PNNs) are assemblies of extracellular matrix molecules, which surround the cell body
and dendrites of many types of neuron and regulate neural plasticity. … observed a wide range …

Excitation dropout: Encouraging plasticity in deep neural networks

A Zunino, SA Bargal, P Morerio, J Zhang… - International Journal of …, 2021 - Springer
… We show a consistent increased network utilization using … We then study network resilience
to neuron dropping at test … that Excitation Dropout has a wider range of saliency values …

Population coupling predicts the plasticity of stimulus responses in cortical circuits

Y Sweeney, C Clopath - Elife, 2020 - elifesciences.org
… Using a recurrent network model, we explore whether this could be due to an underlying
diversity in their synaptic plasticity. We find that, in a network with diverse learning rates, …

An extracellular perspective on CNS maturation: perineuronal nets and the control of plasticity

D Carulli, J Verhaagen - International Journal of Molecular Sciences, 2021 - mdpi.com
… of perineuronal nets (PNNs). In this review, we address the role of PNNs in restricting
critical period plasticity. Next, we discuss the modulation of PNNs during adult brain plasticity, …

Evidence for exercise-related plasticity in functional and structural neural network connectivity

J Won, DD Callow, GS Pena, MA Gogniat… - Neuroscience & …, 2021 - Elsevier
… on the brain are better represented by network dynamics. Here, we reviewed the … network
integrity. This review will provide a comprehensive understanding of trends in exercise-network

Local plasticity rules can learn deep representations using self-supervised contrastive predictions

B Illing, J Ventura, G Bellec… - Advances in neural …, 2021 - proceedings.neurips.cc
… yt = ±1 is a network-wide broadcast signal (self-awareness) indicating a saccade (−1) or a
fixation (+1) and Ht 2 {0, 7} is a layer-wide broadcast signal indicating whether the saccade or …

Contributions of cortical neuron firing patterns, synaptic connectivity, and plasticity to task performance

MN Insanally, BF Albanna, J Toth… - Nature …, 2024 - nature.com
… In previous work 50,51 , only network-wide averages of these synaptic patterns were … the
full network-wide motif cumulants providing a neuron-by-neuron view of synaptic structure. …

Synaptic plasticity dynamics for deep continuous local learning (DECOLLE)

J Kaiser, H Mostafa, E Neftci - Frontiers in Neuroscience, 2020 - frontiersin.org
… using half of the features per layer (see Appendix for network layers). We note that the C3D
network is deeper and wider than the DECOLLE network. We found that 16 × 32 × 32 frames, …

Meta-learning families of plasticity rules in recurrent spiking networks using simulation-based inference

B Confavreux, P Ramesh… - … in Neural …, 2023 - proceedings.neurips.cc
… In order to explore a wide range of possible plasticity rules, we defined parameterized
functional forms for these rules (ie, search spaces) enabling us to flexibly generate various rules, …