Complex systems approach to natural language

T Stanisz, S Drożdż, J Kwapień - Physics Reports, 2024 - Elsevier
The science of complexity aims to answer the question of what rules nature chooses when
assembling the basic constituents of matter and energy into structures and dynamical …

Information theoretic methods for variable selection—A review

J Mielniczuk - Entropy, 2022 - mdpi.com
We review the principal information theoretic tools and their use for feature selection, with
the main emphasis on classification problems with discrete features. Since it is known that …

Examining the continuity between life and mind: Is there a continuity between autopoietic intentionality and representationality?

W Wiese, KJ Friston - Philosophies, 2021 - mdpi.com
A weak version of the life-mind continuity thesis entails that every living system also has a
basic mind (with a non-representational form of intentionality). The strong version entails that …

IEEE P2668-compliant multi-layer IoT-DDoS defense system using deep reinforcement learning

Y Liu, KF Tsang, CK Wu, Y Wei… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
The Internet of Things (IoT) has been attracting people to its capability to deal with smart
applications. However, with the development of IoT, there are more attacks to threaten IoT …

Quantifiers in natural language: Efficient communication and degrees of semantic universals

S Steinert-Threlkeld - Entropy, 2021 - mdpi.com
While the languages of the world vary greatly, they exhibit systematic patterns, as well.
Semantic universals are restrictions on the variation in meaning exhibit cross-linguistically …

Modeling word and morpheme order in natural language as an efficient trade-off of memory and surprisal.

M Hahn, J Degen, R Futrell - Psychological Review, 2021 - psycnet.apa.org
Memory limitations are known to constrain language comprehension and production, and
have been argued to account for crosslinguistic word order regularities. However, a …

[图书][B] Statistical Universals of Language

K Tanaka-Ishii - 2021 - Springer
1.1 Aims For nearly hundred years, researchers have noticed how language ubiquitously
follows certain mathematical properties. These properties differ from linguistic universals that …

Semantic and sentiment trajectories of literary masterpieces

VA Gromov, QN Dang - Chaos, Solitons & Fractals, 2023 - Elsevier
The paper deals with semantic and sentiment trajectories of literary masterpieces (we used
corpora of 12 languages of various language families), composed of individual embeddings …

A simplistic model of neural scaling laws: Multiperiodic Santa Fe processes

Ł Dębowski - arXiv preprint arXiv:2302.09049, 2023 - arxiv.org
It was observed that large language models exhibit a power-law decay of cross entropy with
respect to the number of parameters and training tokens. When extrapolated literally, this …

When is a Language Process a Language Model?

L Du, H Lee, J Eisner, R Cotterell - Findings of the Association for …, 2024 - aclanthology.org
A language model may be viewed as a 𝛴-valued stochastic process for some alphabet 𝛴.
However, in some pathological situations, such a stochastic process may “leak” probability …