Geographic information retrieval: Progress and challenges in spatial search of text
Significant amounts of information available today contain references to places on earth.
Traditionally such information has been held as structured data and was the concern of …
Traditionally such information has been held as structured data and was the concern of …
[图书][B] Pretrained transformers for text ranking: Bert and beyond
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in
response to a query. Although the most common formulation of text ranking is search …
response to a query. Although the most common formulation of text ranking is search …
Large language models can accurately predict searcher preferences
Much of the evaluation and tuning of a search system relies on relevance labels---
annotations that say whether a document is useful for a given search and searcher. Ideally …
annotations that say whether a document is useful for a given search and searcher. Ideally …
[PDF][PDF] Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities.
The rise of online misinformation is posing a threat to the functioning of democratic
processes. The ability to algorithmically spread false information through online social …
processes. The ability to algorithmically spread false information through online social …
Methods for evaluating interactive information retrieval systems with users
D Kelly - Foundations and Trends® in Information Retrieval, 2009 - nowpublishers.com
This paper provides overview and instruction regarding the evaluation of interactive
information retrieval systems with users. The primary goal of this article is to catalog and …
information retrieval systems with users. The primary goal of this article is to catalog and …
Test collection based evaluation of information retrieval systems
M Sanderson - Foundations and Trends® in Information …, 2010 - nowpublishers.com
Use of test collections and evaluation measures to assess the effectiveness of information
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …
In search of quality in crowdsourcing for search engine evaluation
G Kazai - Advances in Information Retrieval: 33rd European …, 2011 - Springer
Crowdsourcing is increasingly looked upon as a feasible alternative to traditional methods of
gathering relevance labels for the evaluation of search engines, offering a solution to the …
gathering relevance labels for the evaluation of search engines, offering a solution to the …
Evaluation of machine-learning protocols for technology-assisted review in electronic discovery
GV Cormack, MR Grossman - Proceedings of the 37th international ACM …, 2014 - dl.acm.org
Using a novel evaluation toolkit that simulates a human reviewer in the loop, we compare
the effectiveness of three machine-learning protocols for technology-assisted review as …
the effectiveness of three machine-learning protocols for technology-assisted review as …
Offline evaluation options for recommender systems
We undertake a detailed examination of the steps that make up offline experiments for
recommender system evaluation, including the manner in which the available ratings are …
recommender system evaluation, including the manner in which the available ratings are …
Using crowdsourcing for TREC relevance assessment
Crowdsourcing has recently gained a lot of attention as a tool for conducting different kinds
of relevance evaluations. At a very high level, crowdsourcing describes outsourcing of tasks …
of relevance evaluations. At a very high level, crowdsourcing describes outsourcing of tasks …