… of TREC 2017 and 2018 used multi-arm bandit optimization techniques to select documents
to be judged. TRECs … taken from Ellen Voorhees’ 2019 TREC Overview. I am grateful to be …

… In this paper we provide an overview of the TREC 2017 OpenSearch track. The OpenSearch
track provides researchers the opportunity to have their retrieval approaches evaluated in a …

… is paper gives a brief overview of the Webis network’s participation in the TREC 2018
Common Core track. e basic idea applied in our approach is to axiomatically re-rank the top-50 …

… an online system into the OpenSearch evaluation campaign. This … in the two overview papers
of the OpenSearch track [1,3]. … of our ranking method in OpenSearch 2017 and 2016. Last …

… Specifically, TREC OpenSearch focuses on the task of … obtained from the TREC 2016–2017
OpenSearch tracks and discuss … Next, we provide an overview of the living labs evaluation …

… TREC 2017 OpenSearch track, which relied on an online evaluation process based on the
Living Labs API, and we also participated in TREC … Overview of TREC tracks relevant to entity-…

… Last year, in TREC 2017 OpenSearch Track, the FEUP team had explored a similar
representation … Table 2 shows an overview of these features used for document profiling of …

… in shared tasks at TREC or CLEF. While some labs focused on living labs or interactive
evaluations (like iCLEF [9], OpenSearch [13], or LiLaS [20]), no shared tasks in TREC/CLEF did …

Livings labs were introduced in CLEF and TREC by initiatives like NewsREEL [1], Open-Search
[2] or, more recently, LiLAS [3], with a particular focus on academic search evaluation. …

… Following an introduction into the field and a broad overview of the possible manifestations
of … Still, during preparing our system for the TREC OpenSearch, we ran into the following …