A generative model of memory construction and consolidation

E Spens, N Burgess - Nature Human Behaviour, 2024 - nature.com
Episodic memories are (re) constructed, share neural substrates with imagination, combine
unique features with schema-based predictions and show schema-based distortions that …

Outlier-efficient hopfield layers for large transformer-based models

JYC Hu, PH Chang, R Luo, HY Chen, W Li… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce an Outlier-Efficient Modern Hopfield Model (termed $\mathtt {OutEffHop} $)
and use it to address the outlier-induced challenge of quantizing gigantic transformer-based …

Sequential memory with temporal predictive coding

M Tang, H Barron, R Bogacz - Advances in neural …, 2024 - proceedings.neurips.cc
Forming accurate memory of sequential stimuli is a fundamental function of biological
agents. However, the computational mechanism underlying sequential memory in the brain …

Bishop: Bi-directional cellular learning for tabular data with generalized sparse modern hopfield model

C Xu, YC Huang, JYC Hu, W Li, A Gilani… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce the\textbf {B} i-Directional\textbf {S} parse\textbf {Hop} field Network (\textbf
{BiSHop}), a novel end-to-end framework for deep tabular learning. BiSHop handles the two …

[HTML][HTML] Resolution of similar patterns in a solvable model of unsupervised deep learning with structured data

A Baroffio, P Rotondo, M Gherardi - Chaos, Solitons & Fractals, 2024 - Elsevier
Empirical data, on which deep learning relies, has substantial internal structure, yet
prevailing theories often disregard this aspect. Recent research has led to the definition of …

Learning sequence attractors in recurrent networks with hidden neurons

Y Lu, S Wu - Neural Networks, 2024 - Elsevier
The brain is targeted for processing temporal sequence information. It remains largely
unclear how the brain learns to store and retrieve sequence memories. Here, we study how …

Predictive Attractor Models

R Mounir, S Sarkar - arXiv preprint arXiv:2410.02430, 2024 - arxiv.org
Sequential memory, the ability to form and accurately recall a sequence of events or stimuli
in the correct order, is a fundamental prerequisite for biological and artificial intelligence as it …

Episodic Memory Theory for the Mechanistic Interpretation of Recurrent Neural Networks

A Karuvally, P Delmastro, HT Siegelmann - arXiv preprint arXiv …, 2023 - arxiv.org
Understanding the intricate operations of Recurrent Neural Networks (RNNs)
mechanistically is pivotal for advancing their capabilities and applications. In this pursuit, we …

Modern Hopfield Networks meet Encoded Neural Representations--Addressing Practical Considerations

S Kashyap, NS D'Souza, L Shi, KCL Wong… - arXiv preprint arXiv …, 2024 - arxiv.org
Content-addressable memories such as Modern Hopfield Networks (MHN) have been
studied as mathematical models of auto-association and storage/retrieval in the human …

Computational modeling of the interactions between episodic memory and cognitive control

H Chateau-Laurent - 2024 - theses.hal.science
Episodic memory is often illustrated with the madeleine de Proust excerpt as the ability to re-
experience a situation from the past following the perception of a stimulus. This simplistic …