Problems with cosine as a measure of embedding similarity for high frequency words

K Zhou, K Ethayarajh, D Card, D Jurafsky - arXiv preprint arXiv …, 2022 - arxiv.org
Cosine similarity of contextual embeddings is used in many NLP tasks (eg, QA, IR, MT) and
metrics (eg, BERTScore). Here, we uncover systematic ways in which word similarities …

A pilot evaluation of chatgpt and dall-e 2 on decision making and spatial reasoning

Z Tang, M Kejriwal - arXiv preprint arXiv:2302.09068, 2023 - arxiv.org
We conduct a pilot study selectively evaluating the cognitive abilities (decision making and
spatial reasoning) of two recently released generative transformer models, ChatGPT and …

Evaluating deep generative models on cognitive tasks: a case study

Z Tang, M Kejriwal - Discover Artificial Intelligence, 2023 - Springer
We present a detailed case study evaluating selective cognitive abilities (decision making
and spatial reasoning) of two recently released generative transformer models, ChatGPT …

Machine Reading Comprehension Model in Domain-Transfer Task

IS Rozhkov, NV Loukachevitch - Lobachevskii Journal of Mathematics, 2023 - Springer
The paper studies domain-transfer capabilities of the machine reading comprehension
model (MRC) in named entity recognition task. In such a task, the model is required to …

Probe-less probing of BERT's layer-wise linguistic knowledge with masked word prediction

T Aoyama, N Schneider - Proceedings of the 2022 Conference of …, 2022 - aclanthology.org
The current study quantitatively (and qualitatively for an illustrative purpose) analyzes
BERT's layer-wise masked word prediction on an English corpus, and finds that (1) the …

Monolingual alignment of word senses and definitions in lexicographical resources

S Ahmadi - arXiv preprint arXiv:2209.02465, 2022 - arxiv.org
The focus of this thesis is broadly on the alignment of lexicographical data, particularly
dictionaries. In order to tackle some of the challenges in this field, two main tasks of word …

Xposition: An online multilingual database of adpositional semantics

L Gessler, A Blodgett, JC Ledford… - Proceedings of the …, 2022 - aclanthology.org
We present Xposition, an online platform for documenting adpositional semantics across
languages in terms of supersenses (Schneider et al., 2018). More than just a lexical …

[PDF][PDF] Discover Artificial Intelligence

KD Strang, Z Sun - Discover, 2022 - researchgate.net
The purpose of this study was to evaluate the effectiveness of using natural language
processing (NLP) artificial intelligence (AI) in enterprise resources planning (ERP) to identify …

[PDF][PDF] BERTological Lexicography for Prepositions

K Litkowski - 2022 - researchgate.net
Contextualized word embedding (CWE) models such as BERT (Devlin et al.(2019)) have
been used in many NLP tasks. Gessler and Schneider (2021)(G&S) focus on the use of …

[PDF][PDF] 1 Lexical Semantic Disambiguation

N Schneider - 2022 - people.cs.georgetown.edu
To a first approximation, understanding the meaning of a sentence involves understanding
the meanings of individual words, and how they relate to one another as signaled by …