Evidence of a predictive coding hierarchy in the human brain listening to speech

C Caucheteux, A Gramfort, JR King - Nature human behaviour, 2023 - nature.com
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …

A hierarchy of linguistic predictions during natural language comprehension

M Heilbron, K Armeni, JM Schoffelen… - Proceedings of the …, 2022 - National Acad Sciences
Understanding spoken language requires transforming ambiguous acoustic streams into a
hierarchy of representations, from phonemes to meaning. It has been suggested that the …

Driving and suppressing the human language network using large language models

G Tuckute, A Sathe, S Srikant, M Taliaferro… - Nature Human …, 2024 - nature.com
Transformer models such as GPT generate human-like language and are predictive of
human brain responses to language. Here, using functional-MRI-measured brain responses …

Lexical-semantic content, not syntactic structure, is the main contributor to ANN-brain similarity of fMRI responses in the language network

C Kauf, G Tuckute, R Levy, J Andreas… - Neurobiology of …, 2024 - direct.mit.edu
Abstract Representations from artificial neural network (ANN) language models have been
shown to predict human brain activity in the language network. To understand what aspects …

Introducing MEG-MASC a high-quality magneto-encephalography dataset for evaluating natural speech processing

L Gwilliams, G Flick, A Marantz, L Pylkkänen… - Scientific data, 2023 - nature.com
The “MEG-MASC” dataset provides a curated set of raw magnetoencephalography (MEG)
recordings of 27 English speakers who listened to two hours of naturalistic stories. Each …

Word contexts enhance the neural representation of individual letters in early visual cortex

M Heilbron, D Richter, M Ekman, P Hagoort… - Nature …, 2020 - nature.com
Visual context facilitates perception, but how this is neurally implemented remains unclear.
One example of contextual facilitation is found in reading, where letters are more easily …

[图书][B] Communicative efficiency

N Levshina - 2022 - books.google.com
All living beings try to save effort, and humans are no exception. This groundbreaking book
shows how we save time and energy during communication by unconsciously making …

Long-range and hierarchical language predictions in brains and algorithms

C Caucheteux, A Gramfort, JR King - arXiv preprint arXiv:2111.14232, 2021 - arxiv.org
Deep learning has recently made remarkable progress in natural language processing. Yet,
the resulting algorithms remain far from competing with the language abilities of the human …

Lexical surprisal shapes the time course of syntactic structure building

S Slaats, AS Meyer, AE Martin - Neurobiology of Language, 2024 - direct.mit.edu
When we understand language, we recognize words and combine them into sentences. In
this article, we explore the hypothesis that listeners use probabilistic information about …

Large GPT-like Models are Bad Babies: A Closer Look at the Relationship between Linguistic Competence and Psycholinguistic Measures

J Steuer, M Mosbach, D Klakow - arXiv preprint arXiv:2311.04547, 2023 - arxiv.org
Research on the cognitive plausibility of language models (LMs) has so far mostly
concentrated on modelling psycholinguistic response variables such as reading times, gaze …