Transformer models used for text-based question answering systems

K Nassiri, M Akhloufi - Applied Intelligence, 2023 - Springer
The question answering system is frequently applied in the area of natural language
processing (NLP) because of the wide variety of applications. It consists of answering …

Bringing order into the realm of Transformer-based language models for artificial intelligence and law

CM Greco, A Tagarelli - Artificial Intelligence and Law, 2023 - Springer
Transformer-based language models (TLMs) have widely been recognized to be a cutting-
edge technology for the successful development of deep-learning-based solutions to …

Pre-training methods in information retrieval

Y Fan, X Xie, Y Cai, J Chen, X Ma, X Li… - … and Trends® in …, 2022 - nowpublishers.com
The core of information retrieval (IR) is to identify relevant information from large-scale
resources and return it as a ranked list to respond to user's information need. In recent years …

What does bert know about books, movies and music? probing bert for conversational recommendation

G Penha, C Hauff - Proceedings of the 14th ACM conference on …, 2020 - dl.acm.org
Heavily pre-trained transformer models such as BERT have recently shown to be
remarkably powerful at language modelling, achieving impressive results on numerous …

Bert for evidence retrieval and claim verification

A Soleimani, C Monz, M Worring - … Conference on IR Research, ECIR 2020 …, 2020 - Springer
We investigate BERT in an evidence retrieval and claim verification pipeline for the task of
evidence-based claim verification. To this end, we propose to use two BERT models, one for …

A survey on the techniques, applications, and performance of short text semantic similarity

M Han, X Zhang, X Yuan, J Jiang… - Concurrency and …, 2021 - Wiley Online Library
Short text similarity plays an important role in natural language processing (NLP). It has
been applied in many fields. Due to the lack of sufficient context in the short text, it is difficult …

Strubert: Structure-aware bert for table search and matching

M Trabelsi, Z Chen, S Zhang, BD Davison… - Proceedings of the ACM …, 2022 - dl.acm.org
A table is composed of data values that are organized in rows and columns providing
implicit structural information. A table is usually accompanied by secondary information such …

Table search using a deep contextualized language model

Z Chen, M Trabelsi, J Heflin, Y Xu… - Proceedings of the 43rd …, 2020 - dl.acm.org
Pretrained contextualized language models such as BERT have achieved impressive
results on various natural language processing benchmarks. Benefiting from multiple …

Hybrid feature extraction for multi-label emotion classification in English text messages

Z Ahanin, MA Ismail, NSS Singh, A AL-Ashmori - Sustainability, 2023 - mdpi.com
Emotions are vital for identifying an individual's attitude and mental condition. Detecting and
classifying emotions in Natural Language Processing applications can improve Human …

Unsupervised FAQ retrieval with question generation and BERT

Y Mass, B Carmeli, H Roitman… - Proceedings of the 58th …, 2020 - aclanthology.org
We focus on the task of Frequently Asked Questions (FAQ) retrieval. A given user query can
be matched against the questions and/or the answers in the FAQ. We present a fully …