[HTML][HTML] Quantifying the separability of data classes in neural networks

A Schilling, A Maier, R Gerum, C Metzner, P Krauss - Neural Networks, 2021 - Elsevier
Abstract We introduce the Generalized Discrimination Value (GDV) that measures, in a non-
invasive manner, how well different data classes separate in each given layer of an artificial …

[HTML][HTML] Optimizing the energy consumption of spiking neural networks for neuromorphic applications

M Sorbaro, Q Liu, M Bortone, S Sheik - Frontiers in neuroscience, 2020 - frontiersin.org
In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on
par with regular convolutional neural networks. Several works have proposed methods to …

[HTML][HTML] A developmental approach to machine learning?

LB Smith, LK Slone - Frontiers in psychology, 2017 - frontiersin.org
Visual learning depends on both the algorithms and the training material. This essay
considers the natural statistics of infant-and toddler-egocentric vision. These natural training …

[HTML][HTML] Illusory motion reproduced by deep neural networks trained for prediction

E Watanabe, A Kitaoka, K Sakamoto, M Yasugi… - Frontiers in …, 2018 - frontiersin.org
The cerebral cortex predicts visual motion to adapt human behavior to surrounding objects
moving in real time. Although the underlying mechanisms are still unknown, predictive …

[HTML][HTML] Analogues of mental simulation and imagination in deep learning

JB Hamrick - Current Opinion in Behavioral Sciences, 2019 - Elsevier
Highlights•There are many methods in deep learning for learning predictive models of the
world.•Such models can be leveraged to produce behavior via a number of planning …

Direct feedback alignment scales to modern deep learning tasks and architectures

J Launay, I Poli, F Boniface… - Advances in neural …, 2020 - proceedings.neurips.cc
Despite being the workhorse of deep learning, the backpropagation algorithm is no
panacea. It enforces sequential layer updates, thus preventing efficient parallelization of the …

Towards algorithmic analytics for large-scale datasets

D Bzdok, TE Nichols, SM Smith - Nature Machine Intelligence, 2019 - nature.com
The traditional goal of quantitative analytics is to find simple, transparent models that
generate explainable insights. In recent years, large-scale data acquisition enabled, for …

[HTML][HTML] Evolving artificial neural networks with feedback

S Herzog, C Tetzlaff, F Wörgötter - Neural Networks, 2020 - Elsevier
Neural networks in the brain are dominated by sometimes more than 60% feedback
connections, which most often have small synaptic weights. Different from this, little is known …

CNN architectures for geometric transformation-invariant feature representation in computer vision: a review

A Mumuni, F Mumuni - SN Computer Science, 2021 - Springer
One of the main challenges in machine vision relates to the problem of obtaining robust
representation of visual features that remain unaffected by geometric transformations. This …

Language ERPs reflect learning through prediction error propagation

H Fitz, F Chang - Cognitive Psychology, 2019 - Elsevier
Event-related potentials (ERPs) provide a window into how the brain is processing
language. Here, we propose a theory that argues that ERPs such as the N400 and P600 …