[PDF][PDF] Don't count, predict! a systematic comparison of context-counting vs. context-predicting semantic vectors

M Baroni, G Dinu, G Kruszewski - … of the 52nd Annual Meeting of …, 2014 - aclanthology.org
Context-predicting models (more commonly known as embeddings or neural language
models) are the new kids on the distributional semantics block. Despite the buzz …

A comparative evaluation and analysis of three generations of Distributional Semantic Models

A Lenci, M Sahlgren, P Jeuniaux… - Language resources …, 2022 - Springer
Distributional semantics has deeply changed in the last decades. First, predict models stole
the thunder from traditional count ones, and more recently both of them were replaced in …

What do you mean, BERT? Assessing BERT as a Distributional Semantics Model

T Mickus, D Paperno, M Constant… - arXiv preprint arXiv …, 2019 - arxiv.org
Contextualized word embeddings, ie vector representations for words in context, are
naturally seen as an extension of previous noncontextual distributional semantic models. In …

A large scale evaluation of distributional semantic models: Parameters, interactions and model selection

G Lapesa, S Evert - Transactions of the Association for Computational …, 2014 - direct.mit.edu
This paper presents the results of a large-scale evaluation study of window-based
Distributional Semantic Models on a wide variety of tasks. Our study combines a broad …

[PDF][PDF] How well do distributional models capture different types of semantic knowledge?

D Rubinstein, E Levi, R Schwartz… - Proceedings of the 53rd …, 2015 - aclanthology.org
In recent years, distributional models (DMs) have shown great success in representing
lexical semantics. In this work we show that the extent to which DMs represent semantic …

Predicting human similarity judgments with distributional models: The value of word associations.

S De Deyne, A Perfors, DJ Navarro - Proceedings of COLING …, 2016 - aclanthology.org
Most distributional lexico-semantic models derive their representations based on external
language resources such as text corpora. In this study, we propose that internal language …

[PDF][PDF] A practical and linguistically-motivated approach to compositional distributional semantics

D Paperno, M Baroni - Proceedings of the 52nd Annual Meeting …, 2014 - aclanthology.org
Distributional semantic methods to approximate word meaning with context vectors have
been very successful empirically, and the last years have seen a surge of interest in their …

Non-distributional word vector representations

M Faruqui, C Dyer - arXiv preprint arXiv:1506.05230, 2015 - arxiv.org
Data-driven representation learning for words is a technique of central importance in NLP.
While indisputably useful as a source of features in downstream tasks, such vectors tend to …

Distributional models of word meaning

A Lenci - Annual review of Linguistics, 2018 - annualreviews.org
Distributional semantics is a usage-based model of meaning, based on the assumption that
the statistical distribution of linguistic items in context plays a key role in characterizing their …

Building a shared world: Mapping distributional to model-theoretic semantic spaces

A Herbelot, EM Vecchi - … 2015: Conference on Empirical Methods in …, 2015 - iris.unitn.it
In this paper, we introduce an approach to automatically map a standard distributional
semantic space onto a set-theoretic model. We predict that there is a functional relationship …