How efficiency shapes human language

E Gibson, R Futrell, SP Piantadosi, I Dautriche… - Trends in cognitive …, 2019 - cell.com
Cognitive science applies diverse tools and perspectives to study human language.
Recently, an exciting body of work has examined linguistic phenomena through the lens of …

Predicting while comprehending language: A theory and review.

MJ Pickering, C Gambi - Psychological bulletin, 2018 - psycnet.apa.org
Researchers agree that comprehenders regularly predict upcoming language, but they do
not always agree on what prediction is (and how to differentiate it from integration) or what …

[PDF][PDF] Modern language models refute Chomsky's approach to language

S Piantadosi - Lingbuzz Preprint, lingbuzz, 2023 - lingbuzz.net
The rise and success of large language models undermines virtually every strong claim for
the innateness of language that has been proposed by generative linguistics. Modern …

The neural architecture of language: Integrative modeling converges on predictive processing

M Schrimpf, IA Blank, G Tuckute… - Proceedings of the …, 2021 - National Acad Sciences
The neuroscience of perception has recently been revolutionized with an integrative
modeling approach in which computation, brain function, and behavior are linked across …

Embers of autoregression: Understanding large language models through the problem they are trained to solve

RT McCoy, S Yao, D Friedman, M Hardy… - arXiv preprint arXiv …, 2023 - arxiv.org
The widespread adoption of large language models (LLMs) makes it important to recognize
their strengths and limitations. We argue that in order to develop a holistic understanding of …

A resource-rational model of human processing of recursive linguistic structure

M Hahn, R Futrell, R Levy… - Proceedings of the …, 2022 - National Acad Sciences
A major goal of psycholinguistic theory is to account for the cognitive constraints limiting the
speed and ease of language comprehension and production. Wide-ranging evidence …

Does ChatGPT resemble humans in language use?

ZG Cai, DA Haslett, X Duan, S Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) and LLM-driven chatbots such as ChatGPT have shown
remarkable capacities in comprehending and producing language. However, their internal …

The language network as a natural kind within the broader landscape of the human brain

E Fedorenko, AA Ivanova, TI Regev - Nature Reviews Neuroscience, 2024 - nature.com
Abstract Language behaviour is complex, but neuroscientific evidence disentangles it into
distinct components supported by dedicated brain areas or networks. In this Review, we …

The now-or-never bottleneck: A fundamental constraint on language

MH Christiansen, N Chater - Behavioral and brain sciences, 2016 - cambridge.org
Memory is fleeting. New material rapidly obliterates previous material. How, then, can the
brain deal successfully with the continual deluge of linguistic input? We argue that, to deal …

Out of order: How important is the sequential order of words in a sentence in natural language understanding tasks?

TM Pham, T Bui, L Mai, A Nguyen - arXiv preprint arXiv:2012.15180, 2020 - arxiv.org
Do state-of-the-art natural language understanding models care about word order-one of the
most important characteristics of a sequence? Not always! We found 75% to 90% of the …