Grid Cells in Cognition: Mechanisms and Function

LL Dong, IR Fiete - Annual Review of Neuroscience, 2024 - annualreviews.org
The activity patterns of grid cells form distinctively regular triangular lattices over the
explored spatial environment and are largely invariant to visual stimuli, animal movement …

Harmonics of learning: Universal fourier features emerge in invariant networks

GL Marchetti, CJ Hillar, D Kragic… - The Thirty Seventh …, 2024 - proceedings.mlr.press
In this work, we formally prove that, under certain conditions, if a neural network is invariant
to a finite group then its weights recover the Fourier transform on that group. This provides a …

Cognitive Overload Attack: Prompt Injection for Long Context

B Upadhayay, V Behzadan, A Karbasi - arXiv preprint arXiv:2410.11272, 2024 - arxiv.org
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing
tasks across various domains without needing explicit retraining. This capability, known as …

Sequential predictive learning is a unifying theory for hippocampal representation and replay

D Levenstein, A Efremov, RH Eyono, A Peyrache… - bioRxiv, 2024 - biorxiv.org
The mammalian hippocampus contains a cognitive map that represents an animal's position
in the environment and generates offline “replay”, for the purposes of recall, planning,, and …

Testing assumptions underlying a unified theory for the origin of grid cells

R Schaeffer, M Khona, A Bertagnoli, S Koyejo… - arXiv preprint arXiv …, 2023 - arxiv.org
Representing and reasoning about physical space is fundamental to animal survival, and
the mammalian lineage expresses a wealth of specialized neural representations that …

Position: Maximizing Neural Regression Scores May Not Identify Good Models of the Brain

R Schaeffer, M Khona, S Chandra… - UniReps: 2nd Edition …, 2024 - openreview.net
A prominent methodology in computational neuroscience posits that the brain can be
understood by identifying which artificial neural network models most accurately predict …

[HTML][HTML] Disentangling Fact from Grid Cell Fiction in Trained Deep Path Integrators

R Schaeffer, M Khona, S Koyejo, IR Fiete - ArXiv, 2023 - ncbi.nlm.nih.gov
Work on deep learning-based models of grid cells suggests that grid cells generically and
robustly arise from optimizing networks to path integrate, ie, track one's spatial position by …

Learning grid cells by predictive coding

M Tang, H Barron, R Bogacz - arXiv preprint arXiv:2410.01022, 2024 - arxiv.org
Grid cells in the medial entorhinal cortex (MEC) of the mammalian brain exhibit a strikingly
regular hexagonal firing field over space. These cells are learned after birth and are thought …

Hexagons all the way down: Grid cells as a conformal isometric map of space

VS Schoyen, K Beshkov, MB Pettersen, E Hermansen… - bioRxiv, 2024 - biorxiv.org
The brain's ability to navigate is often attributed to spatial cells in the hippocampus and
entorhinal cortex. Grid cells, found in the entorhinal cortex, are known for their hexagonal …

Geometric sparsification in recurrent neural networks

W Mackey, I Schizas, J Deighton, DL Boothe Jr… - arXiv preprint arXiv …, 2024 - arxiv.org
A common technique for ameliorating the computational costs of running large neural
models is sparsification, or the removal of neural connections during training. Sparse …