From matching to generation: A survey on generative information retrieval

X Li, J Jin, Y Zhou, Y Zhang, P Zhang, Y Zhu… - arXiv preprint arXiv …, 2024 - arxiv.org
Information Retrieval (IR) systems are crucial tools for users to access information, widely
applied in scenarios like search engines, question answering, and recommendation …

Recent advances in generative information retrieval

Y Tang, R Zhang, J Guo, M de Rijke - … in Information Retrieval in the Asia …, 2023 - dl.acm.org
Generative retrieval (GR) has become a highly active area of information retrieval (IR) that
has witnessed significant growth recently. Compared to the traditional “index-retrieve-then …

Scalable and effective generative information retrieval

H Zeng, C Luo, B Jin, SM Sarwar, T Wei… - Proceedings of the ACM …, 2024 - dl.acm.org
Recent research has shown that transformer networks can be used as differentiable search
indexes by representing each document as a sequence of document ID tokens. These …

A survey of generative search and recommendation in the era of large language models

Y Li, X Lin, W Wang, F Feng, L Pang, W Li, L Nie… - arXiv preprint arXiv …, 2024 - arxiv.org
With the information explosion on the Web, search and recommendation are foundational
infrastructures to satisfying users' information needs. As the two sides of the same coin, both …

Corpusbrain++: A continual generative pre-training framework for knowledge-intensive language tasks

J Guo, C Zhou, R Zhang, J Chen, M de Rijke… - arXiv preprint arXiv …, 2024 - arxiv.org
Knowledge-intensive language tasks (KILTs) typically require retrieving relevant documents
from trustworthy corpora, eg, Wikipedia, to produce specific answers. Very recently, a pre …

Know where to go: Make LLM a relevant, responsible, and trustworthy searcher

X Shi, J Liu, Y Liu, Q Cheng, W Lu - arXiv preprint arXiv:2310.12443, 2023 - arxiv.org
The advent of Large Language Models (LLMs) has shown the potential to improve
relevance and provide direct answers in web searches. However, challenges arise in …

RIGHT: Retrieval-Augmented Generation for Mainstream Hashtag Recommendation

RZ Fan, Y Fan, J Chen, J Guo, R Zhang… - European Conference on …, 2024 - Springer
Automatic mainstream hashtag recommendation aims to accurately provide users with
concise and popular topical hashtags before publication. Generally, mainstream hashtag …

Generative retrieval as multi-vector dense retrieval

S Wu, W Wei, M Zhang, Z Chen, J Ma, Z Ren… - arXiv preprint arXiv …, 2024 - arxiv.org
Generative retrieval generates identifiers of relevant documents in an end-to-end manner
using a sequence-to-sequence architecture for a given query. The relation between …

Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decoding

H Zeng, C Luo, H Zamani - arXiv preprint arXiv:2404.14600, 2024 - arxiv.org
This paper introduces PAG-a novel optimization and decoding approach that guides
autoregressive generation of document identifiers in generative retrieval models through …

Generative Information Retrieval Evaluation

M Alaofi, N Arabzadeh, CLA Clarke… - arXiv preprint arXiv …, 2024 - arxiv.org
In this chapter, we consider generative information retrieval evaluation from two distinct but
interrelated perspectives. First, large language models (LLMs) themselves are rapidly …