Spiking neural network integrated circuits: A review of trends and future directions

A Basu, L Deng, C Frenkel… - 2022 IEEE Custom …, 2022 - ieeexplore.ieee.org
The rapid growth of deep learning, spurred by its successes in various fields ranging from
face recognition [1] to game playing [2], has also triggered a growing interest in the design of …

An optical neural network using less than 1 photon per multiplication

T Wang, SY Ma, LG Wright, T Onodera… - Nature …, 2022 - nature.com
Deep learning has become a widespread tool in both science and industry. However,
continued progress is hampered by the rapid growth in energy costs of ever-larger deep …

SNIB: improving spike-based machine learning using nonlinear information bottleneck

S Yang, B Chen - IEEE Transactions on Systems, Man, and …, 2023 - ieeexplore.ieee.org
Spiking neural networks (SNNs) have garnered increased attention in the field of artificial
general intelligence (AGI) research due to their low power consumption, high computational …

Spike-driven multi-scale learning with hybrid mechanisms of spiking dendrites

S Yang, Y Pang, H Wang, T Lei, J Pan, J Wang, Y Jin - Neurocomputing, 2023 - Elsevier
Neural dendrites play a critical role in various cognitive functions, including spatial
navigation, sensory processing, adaptive learning, and perception. The spatial layout, signal …

Training an ising machine with equilibrium propagation

J Laydevant, D Marković, J Grollier - Nature Communications, 2024 - nature.com
Ising machines, which are hardware implementations of the Ising model of coupled spins,
have been influential in the development of unsupervised learning algorithms at the origins …

Learning where to learn: Gradient sparsity in meta and continual learning

J Von Oswald, D Zhao, S Kobayashi… - Advances in …, 2021 - proceedings.neurips.cc
Finding neural network weights that generalize well from small datasets is difficult. A
promising approach is to learn a weight initialization such that a small number of weight …

Bottom-up and top-down approaches for the design of neuromorphic processing systems: tradeoffs and synergies between natural and artificial intelligence

C Frenkel, D Bol, G Indiveri - Proceedings of the IEEE, 2023 - ieeexplore.ieee.org
While Moore's law has driven exponential computing power expectations, its nearing end
calls for new avenues for improving the overall system performance. One of these avenues …

Nadol: Neuromorphic architecture for spike-driven online learning by dendrites

S Yang, H Wang, Y Pang, MR Azghadi… - … Circuits and Systems, 2023 - ieeexplore.ieee.org
Biologically plausible learning with neuronal dendrites is a promising perspective to improve
the spike-driven learning capability by introducing dendritic processing as an additional …

Bottom-up and top-down neural processing systems design: Neuromorphic intelligence as the convergence of natural and artificial intelligence

CP Frenkel, D Bol, G Indiveri - ArXiv. org, 2021 - zora.uzh.ch
While Moore's law has driven exponential computing power expectations, its nearing end
calls for new avenues for improving the overall system performance. One of these avenues …

Learning without feedback: Fixed random learning signals allow for feedforward training of deep neural networks

C Frenkel, M Lefebvre, D Bol - Frontiers in neuroscience, 2021 - frontiersin.org
While the backpropagation of error algorithm enables deep neural network training, it
implies (i) bidirectional synaptic weight transport and (ii) update locking until the forward and …