Convolutional neural networks as a model of the visual system: Past, present, and future

GW Lindsay - Journal of cognitive neuroscience, 2021 - direct.mit.edu
Convolutional neural networks (CNNs) were inspired by early findings in the study of
biological vision. They have since become successful tools in computer vision and state-of …

[HTML][HTML] Neural population geometry: An approach for understanding biological and artificial neural networks

SY Chung, LF Abbott - Current opinion in neurobiology, 2021 - Elsevier
Advances in experimental neuroscience have transformed our ability to explore the structure
and function of neural circuits. At the same time, advances in machine learning have …

Unsupervised neural network models of the ventral visual stream

C Zhuang, S Yan, A Nayebi… - Proceedings of the …, 2021 - National Acad Sciences
Deep neural networks currently provide the best quantitative models of the response
patterns of neurons throughout the primate ventral visual stream. However, such networks …

Towards a definition of disentangled representations

I Higgins, D Amos, D Pfau, S Racaniere… - arXiv preprint arXiv …, 2018 - arxiv.org
How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The
disentangled representation learning approach posits that such an agent would benefit from …

Interpreting neural computations by examining intrinsic and embedding dimensionality of neural activity

M Jazayeri, S Ostojic - Current opinion in neurobiology, 2021 - Elsevier
The ongoing exponential rise in recording capacity calls for new approaches for analysing
and interpreting neural data. Effective dimensionality has emerged as an important property …

Neural tuning and representational geometry

N Kriegeskorte, XX Wei - Nature Reviews Neuroscience, 2021 - nature.com
A central goal of neuroscience is to understand the representations formed by brain activity
patterns and their connection to behaviour. The classic approach is to investigate how …

STDP-based spiking deep convolutional neural networks for object recognition

SR Kheradpisheh, M Ganjtabesh, SJ Thorpe… - Neural Networks, 2018 - Elsevier
Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in
spiking neural networks (SNN) to extract visual features of low or intermediate complexity in …

Cognitive computational neuroscience

N Kriegeskorte, PK Douglas - Nature neuroscience, 2018 - nature.com
To learn how cognition is implemented in the brain, we must build computational models
that can perform cognitive tasks, and test such models with brain and behavioral …

[HTML][HTML] Statistical mechanics of deep learning

Y Bahri, J Kadmon, J Pennington… - Annual Review of …, 2020 - annualreviews.org
The recent striking success of deep neural networks in machine learning raises profound
questions about the theoretical principles underlying their success. For example, what can …

Exponential expressivity in deep neural networks through transient chaos

B Poole, S Lahiri, M Raghu… - Advances in neural …, 2016 - proceedings.neurips.cc
We combine Riemannian geometry with the mean field theory of high dimensional chaos to
study the nature of signal propagation in deep neural networks with random weights. Our …