Large language models can accurately predict searcher preferences
Much of the evaluation and tuning of a search system relies on relevance labels---
annotations that say whether a document is useful for a given search and searcher. Ideally …
annotations that say whether a document is useful for a given search and searcher. Ideally …
Search under Uncertainty: Cognitive Biases and Heuristics-Tutorial on Modeling Search Interaction using Behavioral Economics
L Azzopardi, J Liu - Proceedings of the 2024 Conference on Human …, 2024 - dl.acm.org
Modeling how people interact with search interfaces is core to the field of Interactive
Information Retrieval. While various models have been proposed ranging from conceptual …
Information Retrieval. While various models have been proposed ranging from conceptual …
Topic difficulty: Collection and query formulation effects
Several recent studies have explored the interaction effects between topics, systems,
corpora, and components when measuring retrieval effectiveness. However, all of these …
corpora, and components when measuring retrieval effectiveness. However, all of these …
Computer-assisted screening in systematic evidence synthesis requires robust and well-evaluated stopping criteria
Systematic reviews, systematic maps, rapid reviews, and other evidence synthesis products
are important resources for evidence-based decision-making [1–3]. To synthesise evidence …
are important resources for evidence-based decision-making [1–3]. To synthesise evidence …
Toward Cranfield-inspired reusability assessment in interactive information retrieval evaluation
J Liu - Information Processing & Management, 2022 - Elsevier
Re-using research resources is essential for advancing knowledge and developing
repeatable, empirically solid experiments in scientific fields, including interactive information …
repeatable, empirically solid experiments in scientific fields, including interactive information …
Investigating reference dependence effects on user search interaction and satisfaction: A behavioral economics perspective
J Liu, F Han - Proceedings of the 43rd international ACM SIGIR …, 2020 - dl.acm.org
How users think, behave, and make decisions when interacting with information retrieval
(IR) systems is a fundamental research problem in the area of Interactive IR. There is …
(IR) systems is a fundamental research problem in the area of Interactive IR. There is …
Constructing better evaluation metrics by incorporating the anchoring effect into the user model
Models of existing evaluation metrics assume that users are rational decision-makers trying
to pursue maximised utility. However, studies in behavioural economics show that people …
to pursue maximised utility. However, studies in behavioural economics show that people …
A reference-dependent model for web search evaluation: Understanding and measuring the experience of boundedly rational users
Previous researches demonstrate that users' actions in search interaction are associated
with relative gains and losses to reference points, known as the reference dependence …
with relative gains and losses to reference points, known as the reference dependence …
Ai can be cognitively biased: An exploratory study on threshold priming in llm-based batch relevance assessment
Cognitive biases are systematic deviations in thinking that lead to irrational judgments and
problematic decision-making, extensively studied across various fields. Recently, large …
problematic decision-making, extensively studied across various fields. Recently, large …
Toward A Two-Sided Fairness Framework in Search and Recommendation
J Liu - Proceedings of the 2023 Conference on Human …, 2023 - dl.acm.org
As artificial intelligence (AI) assisted search and recommender systems have become
ubiquitous in workplaces and everyday lives, understanding and accounting for fairness has …
ubiquitous in workplaces and everyday lives, understanding and accounting for fairness has …