The neural architecture of language: Integrative modeling converges on predictive processing
The neuroscience of perception has recently been revolutionized with an integrative
modeling approach in which computation, brain function, and behavior are linked across …
modeling approach in which computation, brain function, and behavior are linked across …
Artificial neural networks accurately predict language processing in the brain
The neuroscience of perception has recently been revolutionized with an integrative
modeling approach in which computation, brain function, and behavior are linked across …
modeling approach in which computation, brain function, and behavior are linked across …
Reconstructing the cascade of language processing in the brain using the internal computations of a transformer-based language model
Piecing together the meaning of a narrative requires understanding not only the individual
words but also the intricate relationships between them. How does the brain construct this …
words but also the intricate relationships between them. How does the brain construct this …
[HTML][HTML] Evidence of a predictive coding hierarchy in the human brain listening to speech
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …
learning algorithms are increasingly able to generate, summarize, translate and classify …
Inducing brain-relevant bias in natural language processing models
D Schwartz, M Toneva… - Advances in neural …, 2019 - proceedings.neurips.cc
Progress in natural language processing (NLP) models that estimate representations of
word sequences has recently been leveraged to improve the understanding of language …
word sequences has recently been leveraged to improve the understanding of language …
fMRI reveals language-specific predictive coding during naturalistic sentence comprehension
Much research in cognitive neuroscience supports prediction as a canonical computation of
cognition across domains. Is such predictive coding implemented by feedback from higher …
cognition across domains. Is such predictive coding implemented by feedback from higher …
[HTML][HTML] Brains and algorithms partially converge in natural language processing
C Caucheteux, JR King - Communications biology, 2022 - nature.com
Deep learning algorithms trained to predict masked words from large amount of text have
recently been shown to generate activations similar to those of the human brain. However …
recently been shown to generate activations similar to those of the human brain. However …
Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects
A popular approach to decompose the neural bases of language consists in correlating,
across individuals, the brain responses to different stimuli (eg regular speech versus …
across individuals, the brain responses to different stimuli (eg regular speech versus …
Neurocomputational models of language processing
Efforts to understand the brain bases of language face the Mapping Problem: At what level
do linguistic computations and representations connect to human neurobiology? We review …
do linguistic computations and representations connect to human neurobiology? We review …
Probabilistic language models in cognitive neuroscience: Promises and pitfalls
Cognitive neuroscientists of language comprehension study how neural computations relate
to cognitive computations during comprehension. On the cognitive part of the equation, it is …
to cognitive computations during comprehension. On the cognitive part of the equation, it is …