Formal and functional theories of language seem disparate, because formal theories answer
the question of what a language is, while functional theories answer the question of what …

The social sciences and digital humanities have recently adopted the machine learning
technique of topic modeling to address research questions in their fields. This is problematic …

Simple Summary An information theory approach provides new methods for experimental
studying and analysis of animals' communication and behavioural sequences. One of the …

In this paper, we present corpus data that questions the concept of native speaker
homogeneity as it is presumed in many studies using native speakers (L1) as a control …

Irreducible grammars are a class of context-free grammars with well-known representatives,
such as Repair (with a few tweaks), Longest Match, Greedy, and Sequential. We show that a …

We study the language of legal codes from different countries and legal traditions, using
concepts from physics, algorithmic complexity theory and information theory. We show that …

The Predictive Rate–Distortion curve quantifies the trade-off between compressing
information about the past of a stochastic process and predicting its future accurately …

We present a hypothetical argument against finite-state processes in statistical language
modeling that is based on semantics rather than syntax. In this theoretical model, we …

The thesis located in corpus linguistics analyzes the acquisition of coselectional constraint in
learners of German as a second language in a quasi-longitudinal design based on the …

As it is known, universal codes, which estimate the entropy rate consistently, exist for
stationary ergodic sources over finite alphabets but not over countably infinite ones. We …