Gradient descent for spiking neural networks

D Huh, TJ Sejnowski - Advances in neural information …, 2018 - proceedings.neurips.cc
Most large-scale network models use neurons with static nonlinearities that produce analog
output, despite the fact that information processing in the brain is predominantly carried out …

Gradient-based learning drives robust representations in recurrent neural networks by balancing compression and expansion

M Farrell, S Recanatesi, T Moore, G Lajoie… - Nature Machine …, 2022 - nature.com
Neural networks need the right representations of input data to learn. Here we ask how
gradient-based learning shapes a fundamental property of representations in recurrent …

[HTML][HTML] Dynamical models of cortical circuits

F Wolf, R Engelken, M Puelma-Touzel… - Current opinion in …, 2014 - Elsevier
Highlights•Inhibition-stabilized networks describe the visual cortical operating
point.•Dynamic synapses cause nonlinearity and multi-stability in balanced …

Lyapunov spectra of chaotic recurrent neural networks

R Engelken, F Wolf, LF Abbott - Physical Review Research, 2023 - APS
This article is part of the Physical Review Research collection titled Physics of
Neuroscience. Recurrent networks are widely used as models of biological neural circuits …

Optimal sequence memory in driven random networks

J Schuecker, S Goedeke, M Helias - Physical Review X, 2018 - APS
Autonomous, randomly coupled, neural networks display a transition to chaos at a critical
coupling strength. Here, we investigate the effect of a time-varying input on the onset of …

Neurodynamics

S Coombes, KCA Wedgwood - Texts in applied mathematics, 2023 - Springer
This is a book about 'Neurodynamics'. What we mean is that this is a book about how ideas
from dynamical systems theory have been developed and employed in recent years to give …

Cross frequency coupling in next generation inhibitory neural mass models

A Ceni, S Olmi, A Torcini… - Chaos: An Interdisciplinary …, 2020 - pubs.aip.org
Coupling among neural rhythms is one of the most important mechanisms at the basis of
cognitive processes in the brain. In this study, we consider a neural mass model, rigorously …

On lyapunov exponents for rnns: Understanding information propagation using dynamical systems tools

R Vogt, M Puelma Touzel, E Shlizerman… - Frontiers in Applied …, 2022 - frontiersin.org
Recurrent neural networks (RNNs) have been successfully applied to a variety of problems
involving sequential data, but their optimization is sensitive to parameter initialization …

Cortical reliability amid noise and chaos

M Nolte, MW Reimann, JG King, H Markram… - Nature …, 2019 - nature.com
Typical responses of cortical neurons to identical sensory stimuli appear highly variable. It
has thus been proposed that the cortex primarily uses a rate code. However, other studies …

Collective behaviors of neural network regulated by the spatially distributed stimuli

Y Xie, W Huang, Y Jia, Z Ye, Y Wu - Physica A: Statistical Mechanics and its …, 2024 - Elsevier
Most external stimuli, including sound, temperature, and illumination, exhibit spatially
heterogeneous, and different amplitudes of the same signal are received by neurons at …