Toward a formal theory for computing machines made out of whatever physics offers

H Jaeger, B Noheda, WG Van Der Wiel - Nature communications, 2023 - nature.com
Approaching limitations of digital computing technologies have spurred research in
neuromorphic and other unconventional approaches to computing. Here we argue that if we …

Recent advances at the interface of neuroscience and artificial neural networks

Y Cohen, TA Engel, C Langdon… - Journal of …, 2022 - Soc Neuroscience
Biological neural networks adapt and learn in diverse behavioral contexts. Artificial neural
networks (ANNs) have exploited biological properties to solve complex problems. However …

The emergence of a concept in shallow neural networks

E Agliari, F Alemanno, A Barra, G De Marzo - Neural Networks, 2022 - Elsevier
We consider restricted Boltzmann machine (RBMs) trained over an unstructured dataset
made of blurred copies of definite but unavailable “archetypes” and we show that there …

[HTML][HTML] Regularization, early-stopping and dreaming: a Hopfield-like setup to address generalization and overfitting

E Agliari, F Alemanno, M Aquaro, A Fachechi - Neural Networks, 2024 - Elsevier
In this work we approach attractor neural networks from a machine learning perspective: we
look for optimal network parameters by applying a gradient descent over a regularized loss …

Hierarchical associative memory

D Krotov - arXiv preprint arXiv:2107.06446, 2021 - arxiv.org
Dense Associative Memories or Modern Hopfield Networks have many appealing properties
of associative memory. They can do pattern completion, store a large number of memories …

Dense Hebbian neural networks: a replica symmetric picture of supervised learning

E Agliari, L Albanese, F Alemanno… - Physica A: Statistical …, 2023 - Elsevier
We consider dense, associative neural-networks trained by a teacher (ie, with supervision)
and we investigate their computational capabilities analytically, via statistical-mechanics …

Simplicial hopfield networks

TF Burns, T Fukai - arXiv preprint arXiv:2305.05179, 2023 - arxiv.org
Hopfield networks are artificial neural networks which store memory patterns on the states of
their neurons by choosing recurrent connection weights and update rules such that the …

[HTML][HTML] An introduction to machine learning: a perspective from statistical physics

A Decelle - Physica A: Statistical Mechanics and its Applications, 2022 - Elsevier
The recent progresses in Machine Learning opened the door to actual applications of
learning algorithms but also to new research directions both in the field of Machine Learning …

On the effective initialisation for restricted Boltzmann machines via duality with Hopfield model

FE Leonelli, E Agliari, L Albanese, A Barra - Neural Networks, 2021 - Elsevier
Abstract Restricted Boltzmann machines (RBMs) with a binary visible layer of size N and a
Gaussian hidden layer of size P have been proved to be equivalent to a Hopfield neural …

Replica symmetry breaking in dense hebbian neural networks

L Albanese, F Alemanno, A Alessandrelli… - Journal of Statistical …, 2022 - Springer
Understanding the glassy nature of neural networks is pivotal both for theoretical and
computational advances in Machine Learning and Theoretical Artificial Intelligence. Keeping …