Training spiking neural networks using lessons from deep learning

JK Eshraghian, M Ward, EO Neftci… - Proceedings of the …, 2023 - ieeexplore.ieee.org
The brain is the perfect place to look for inspiration to develop more efficient neural
networks. The inner workings of our synapses and neurons provide a glimpse at what the …

[HTML][HTML] Measuring and modeling the motor system with machine learning

SB Hausmann, AM Vargas, A Mathis… - Current opinion in …, 2021 - Elsevier
The utility of machine learning in understanding the motor system is promising a revolution
in how to collect, measure, and analyze data. The field of movement science already …

[PDF][PDF] Modern language models refute Chomsky's approach to language

S Piantadosi - Lingbuzz Preprint, lingbuzz, 2023 - lingbuzz.net
The rise and success of large language models undermines virtually every strong claim for
the innateness of language that has been proposed by generative linguistics. Modern …

[PDF][PDF] Deep learning needs a prefrontal cortex

J Russin, RC O'Reilly, Y Bengio - Work Bridging AI Cogn …, 2020 - baicsworkshop.github.io
Research seeking to build artificial systems capable of reproducing elements of human
intelligence may benefit from a deeper consideration of the architecture and learning …

The functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning

S Bakhtiari, P Mineault, T Lillicrap… - Advances in Neural …, 2021 - proceedings.neurips.cc
The visual system of mammals is comprised of parallel, hierarchical specialized pathways.
Different pathways are specialized in so far as they use representations that are more …

The combination of Hebbian and predictive plasticity learns invariant object representations in deep sensory networks

MS Halvagal, F Zenke - Nature neuroscience, 2023 - nature.com
Recognition of objects from sensory stimuli is essential for survival. To that end, sensory
networks in the brain must form object representations invariant to stimulus changes, such …

Supervised learning in physical networks: From machine learning to learning machines

M Stern, D Hexner, JW Rocks, AJ Liu - Physical Review X, 2021 - APS
Materials and machines are often designed with particular goals in mind, so that they exhibit
desired responses to given forces or constraints. Here we explore an alternative approach …

Meta-learning through hebbian plasticity in random networks

E Najarro, S Risi - Advances in Neural Information …, 2020 - proceedings.neurips.cc
Lifelong learning and adaptability are two defining aspects of biological agents. Modern
reinforcement learning (RL) approaches have shown significant progress in solving complex …

Seeing is believing: Brain-inspired modular training for mechanistic interpretability

Z Liu, E Gan, M Tegmark - Entropy, 2023 - mdpi.com
We introduce Brain-Inspired Modular Training (BIMT), a method for making neural networks
more modular and interpretable. Inspired by brains, BIMT embeds neurons in a geometric …

Your head is there to move you around: Goal-driven models of the primate dorsal pathway

P Mineault, S Bakhtiari, B Richards… - Advances in Neural …, 2021 - proceedings.neurips.cc
Neurons in the dorsal visual pathway of the mammalian brain are selective for motion
stimuli, with the complexity of stimulus representations increasing along the hierarchy. This …