Inducing relational knowledge from BERT
Z Bouraoui, J Camacho-Collados… - Proceedings of the AAAI …, 2020 - ojs.aaai.org
One of the most remarkable properties of word embeddings is the fact that they capture
certain types of semantic and syntactic relationships. Recently, pre-trained language models …
certain types of semantic and syntactic relationships. Recently, pre-trained language models …
BERT is to NLP what AlexNet is to CV: Can pre-trained language models identify analogies?
Analogies play a central role in human commonsense reasoning. The ability to recognize
analogies such as" eye is to seeing what ear is to hearing", sometimes referred to as …
analogies such as" eye is to seeing what ear is to hearing", sometimes referred to as …
Analogies explained: Towards understanding word embeddings
C Allen, T Hospedales - International Conference on …, 2019 - proceedings.mlr.press
Word embeddings generated by neural network methods such as word2vec (W2V) are well
known to exhibit seemingly linear behaviour, eg the embeddings of analogy “woman is to …
known to exhibit seemingly linear behaviour, eg the embeddings of analogy “woman is to …
Emergence of relational reasoning
KJ Holyoak, H Lu - Current Opinion in Behavioral Sciences, 2021 - Elsevier
Highlights• Relational reasoning underlies a myriad uniquely human abilities.• Multiple
cognitive and neural systems underlie abilities to perceive and reason about relations.• …
cognitive and neural systems underlie abilities to perceive and reason about relations.• …
Lack of selectivity for syntax relative to word meanings throughout the language network
To understand what you are reading now, your mind retrieves the meanings of words and
constructions from a linguistic knowledge store (lexico-semantic processing) and identifies …
constructions from a linguistic knowledge store (lexico-semantic processing) and identifies …
Word embeddings, analogies, and machine learning: Beyond king-man+ woman= queen
A Drozd, A Gladkova, S Matsuoka - Proceedings of coling 2016 …, 2016 - aclanthology.org
Solving word analogies became one of the most popular benchmarks for word embeddings
on the assumption that linear relations between word pairs (such as king: man:: woman …
on the assumption that linear relations between word pairs (such as king: man:: woman …
Fair is better than sensational: Man is to doctor as woman is to doctor
Analogies such as man is to king as woman is to X are often used to illustrate the amazing
power of word embeddings. Concurrently, they have also been used to expose how strongly …
power of word embeddings. Concurrently, they have also been used to expose how strongly …
Context-aware misinformation detection: A benchmark of deep learning architectures using word embeddings
New mass media paradigms for information distribution have emerged with the digital age.
With new digital-enabled mass media, the communication process is centered around the …
With new digital-enabled mass media, the communication process is centered around the …
[HTML][HTML] Considerations about learning Word2Vec
G Di Gennaro, A Buonanno, FAN Palmieri - The Journal of …, 2021 - Springer
Despite the large diffusion and use of embedding generated through Word2Vec, there are
still many open questions about the reasons for its results and about its real capabilities. In …
still many open questions about the reasons for its results and about its real capabilities. In …