Semantic models for the first-stage retrieval: A comprehensive review

J Guo, Y Cai, Y Fan, F Sun, R Zhang… - ACM Transactions on …, 2022 - dl.acm.org
Multi-stage ranking pipelines have been a practical solution in modern search systems,
where the first-stage retrieval is to return a subset of candidate documents and latter stages …

Colbert: Efficient and effective passage search via contextualized late interaction over bert

O Khattab, M Zaharia - Proceedings of the 43rd International ACM SIGIR …, 2020 - dl.acm.org
Recent progress in Natural Language Understanding (NLU) is driving fast-paced advances
in Information Retrieval (IR), largely owed to fine-tuning deep language models (LMs) for …

Overview of the TREC 2019 deep learning track

N Craswell, B Mitra, E Yilmaz, D Campos… - arXiv preprint arXiv …, 2020 - arxiv.org
The Deep Learning Track is a new track for TREC 2019, with the goal of studying ad hoc
ranking in a large data regime. It is the first track with large human-labeled training sets …

Passage Re-ranking with BERT

R Nogueira, K Cho - arXiv preprint arXiv:1901.04085, 2019 - arxiv.org
Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et
al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved …

Sparse, dense, and attentional representations for text retrieval

Y Luan, J Eisenstein, K Toutanova… - Transactions of the …, 2021 - direct.mit.edu
Dual encoders perform retrieval by encoding documents and queries into dense low-
dimensional vectors, scoring each document by its inner product with the query. We …

Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges

J Wang, JX Huang, X Tu, J Wang, AJ Huang… - ACM Computing …, 2024 - dl.acm.org
Recent years have witnessed a substantial increase in the use of deep learning to solve
various natural language processing (NLP) problems. Early deep learning models were …

Multi-stage document ranking with BERT

R Nogueira, W Yang, K Cho, J Lin - arXiv preprint arXiv:1910.14424, 2019 - arxiv.org
The advent of deep neural networks pre-trained via language modeling tasks has spurred a
number of successful applications in natural language processing. This work explores one …

A deep look into neural ranking models for information retrieval

J Guo, Y Fan, L Pang, L Yang, Q Ai, H Zamani… - Information Processing …, 2020 - Elsevier
Ranking models lie at the heart of research on information retrieval (IR). During the past
decades, different techniques have been proposed for constructing ranking models, from …

Few-shot conversational dense retrieval

S Yu, Z Liu, C Xiong, T Feng, Z Liu - … of the 44th International ACM SIGIR …, 2021 - dl.acm.org
Dense retrieval (DR) has the potential to resolve the query understanding challenge in
conversational search by matching in the learned embedding space. However, this …

TREC CAsT 2019: The conversational assistance track overview

J Dalton, C Xiong, J Callan - arXiv preprint arXiv:2003.13624, 2020 - arxiv.org
The Conversational Assistance Track (CAsT) is a new track for TREC 2019 to facilitate
Conversational Information Seeking (CIS) research and to create a large-scale reusable test …