Ranked lists are encountered in research and daily life and it is often of interest to compare
these lists even when they are incomplete or have only some members in common. An …

Recommender systems are now popular both commercially and in the research community,
where many approaches have been suggested for providing recommendations. In many …

Use of test collections and evaluation measures to assess the effectiveness of information
retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 …

Spearman's footrule and Kendall's tau are two well established distances between rankings.
They, however, fail to take into account concepts crucial to evaluating a result set in …

Hypergraphs are used in machine learning to model higher-order relationships in data.
While spectral methods for graphs are well-established, spectral theory for hypergraphs …

We undertake a detailed examination of the steps that make up offline experiments for
recommender system evaluation, including the manner in which the available ratings are …

Outlier detection research is currently focusing on the development of new methods and on
improving the computation time for these methods. Evaluation however is rather heuristic …

High-recall retrieval---finding all or nearly all relevant documents---is critical to applications
such as electronic discovery, systematic review, and the construction of test collections for …

With the rapid development of cloud computing, cloud service has become an indispensable
component of modern information systems where quality of service (QoS) has a direct …

This paper presents results comparing user preference for search engine rankings with
measures of effectiveness computed from a test collection. It establishes that preferences …