Attention in natural language processing

A Galassi, M Lippi, P Torroni - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …

A survey on recognizing textual entailment as an NLP evaluation

A Poliak - arXiv preprint arXiv:2010.03061, 2020 - arxiv.org
Recognizing Textual Entailment (RTE) was proposed as a unified evaluation framework to
compare semantic understanding of different NLP systems. In this survey paper, we provide …

[PDF][PDF] Improving language understanding by generative pre-training

A Radford, K Narasimhan, T Salimans, I Sutskever - 2018 - mikecaptain.com
Natural language understanding comprises a wide range of diverse tasks such as textual
entailment, question answering, semantic similarity assessment, and document …

The natural language decathlon: Multitask learning as question answering

B McCann, NS Keskar, C Xiong, R Socher - arXiv preprint arXiv …, 2018 - arxiv.org
Deep learning has improved performance on many natural language processing (NLP)
tasks individually. However, general NLP models cannot emerge within a paradigm that …

Rethinking search: making domain experts out of dilettantes

D Metzler, Y Tay, D Bahri, M Najork - Acm sigir forum, 2021 - dl.acm.org
When experiencing an information need, users want to engage with a domain expert, but
often turn to an information retrieval system, such as a search engine, instead. Classical …

Multi-pointer co-attention networks for recommendation

Y Tay, AT Luu, SC Hui - Proceedings of the 24th ACM SIGKDD …, 2018 - dl.acm.org
Many recent state-of-the-art recommender systems such as D-ATT, TransNet and
DeepCoNN exploit reviews for representation learning. This paper proposes a new neural …

GEAR: Graph-based evidence aggregating and reasoning for fact verification

J Zhou, X Han, C Yang, Z Liu, L Wang, C Li… - arXiv preprint arXiv …, 2019 - arxiv.org
Fact verification (FV) is a challenging task which requires to retrieve relevant evidence from
plain text and use the evidence to verify given claims. Many claims require to simultaneously …

A hierarchical multi-task approach for learning embeddings from semantic tasks

V Sanh, T Wolf, S Ruder - Proceedings of the AAAI conference on …, 2019 - ojs.aaai.org
Much effort has been devoted to evaluate whether multi-task learning can be leveraged to
learn rich representations that can be used in various Natural Language Processing (NLP) …

Simple and effective text matching with richer alignment features

R Yang, J Zhang, X Gao, F Ji, H Chen - arXiv preprint arXiv:1908.00300, 2019 - arxiv.org
In this paper, we present a fast and strong neural approach for general purpose text
matching applications. We explore what is sufficient to build a fast and well-performed text …

Semantic sentence matching with densely-connected recurrent and co-attentive information

S Kim, I Kang, N Kwak - Proceedings of the AAAI conference on artificial …, 2019 - ojs.aaai.org
Sentence matching is widely used in various natural language tasks such as natural
language inference, paraphrase identification, and question answering. For these tasks …