User simulation for evaluating information access systems

K Balog, CX Zhai - Proceedings of the Annual International ACM SIGIR …, 2023 - dl.acm.org
With the emergence of various information access systems exhibiting increasing complexity,
there is a critical need for sound and scalable means of automatic evaluation. To address …

Unbiased learning-to-rank needs unconfounded propensity estimation

D Luo, L Zou, Q Ai, Z Chen, C Li, D Yin… - Proceedings of the 47th …, 2024 - dl.acm.org
The logs of the use of a search engine provide sufficient data to train a better ranker.
However, it is well known that such implicit feedback reflects biases, and in particular a …

Report on the 1st simulation for information retrieval workshop (Sim4IR 2021) at SIGIR 2021

K Balog, D Maxwell, P Thomas, S Zhang - ACM SIGIR Forum, 2022 - dl.acm.org
Simulation is used as a low-cost and repeatable means of experimentation. As Information
Retrieval (IR) researchers, we are no strangers to the idea of using simulation within our …

Model-based unbiased learning to rank

D Luo, L Zou, Q Ai, Z Chen, D Yin… - Proceedings of the …, 2023 - dl.acm.org
Unbiased Learning to Rank (ULTR), ie, learning to rank documents with biased user
feedback data, is a well-known challenge in information retrieval. Existing methods in …

Fairness in Search Systems

Y Fang, A Singh, Z Tao - Foundations and Trends® in …, 2024 - nowpublishers.com
Search engines play a crucial role in organizing and delivering information to billions of
users worldwide. However, these systems often reflect and amplify existing societal biases …

Unconfounded Propensity Estimation for Unbiased Ranking

D Luo, L Zou, Q Ai, Z Chen, C Li, D Yin… - arXiv preprint arXiv …, 2023 - arxiv.org
The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for
optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms …

User behavior simulation for search result re-ranking

J Zhang, Y Liu, J Mao, W Ma, J Xu, S Ma… - ACM Transactions on …, 2023 - dl.acm.org
Result ranking is one of the major concerns for Web search technologies. Most existing
methodologies rank search results in descending order of relevance. To model the …

AliExpress Learning-To-Rank: Maximizing online model performance without going online

G Huzhang, ZJ Pang, Y Gao, Y Liu… - … on Knowledge and …, 2021 - ieeexplore.ieee.org
Learning-to-rank (LTR) has become a key technology in E-commerce applications. Most
existing LTR approaches follow a supervised learning paradigm with data collected from an …

Models and evaluation of user simulation in information retrieval

S Labhishetty - 2023 - ideals.illinois.edu
Search and recommendation are crucial parts of many applications. Additionally, assistive AI
systems have become very popular with successful intelligent agent systems. Although the …

Learning From Implicit Feedback for Unbiased Learning to Rank

D Luo - 2025 - search.proquest.com
Search engines serve as one of the most important tools for accessing information online. In
modern search engines, learning to rank~(LTR) algorithms play a critical role by creating …