A search log-based approach to evaluation

J Zhang, J Kamps - Research and Advanced Technology for Digital …, 2010 - Springer
Anyone offering content in a digital library is naturally interested in assessing its
performance: how well does my system meet the users' information needs? Standard …

A logging scheme for comparative digital library evaluation

CP Klas, H Albrechtsen, N Fuhr, P Hansen… - Research and Advanced …, 2006 - Springer
Abstract Evaluation of digital libraries assesses their effectiveness, quality and overall
impact. To facilitate the comparison of different evaluations and to support the re-use of …

Why did you pick that? Visualising relevance criteria in exploratory search

UC Beresi, Y Kim, D Song, I Ruthven - International journal on digital …, 2010 - Springer
In this article, we present a set of approaches in analysing data gathered during
experimentation with exploratory search systems and users' acts of judging the relevance of …

Search log analysis of user stereotypes, information seeking behavior, and contextual evaluation

J Zhang, J Kamps - Proceedings of the third symposium on Information …, 2010 - dl.acm.org
Evaluation is needed in order to benchmark and improve systems. In information retrieval
(IR), evaluation is centered around the test collection, ie the set of documents that systems …

Information retrieval system evaluation: effort, sensitivity, and reliability

M Sanderson, J Zobel - Proceedings of the 28th annual international …, 2005 - dl.acm.org
The effectiveness of information retrieval systems is measured by comparing performance
on a common set of queries and documents. Significance tests are often used to evaluate …

A usability study of the Belgian‐American Research Collection: measuring the functionality of a digital library

JA Clark - OCLC Systems & Services: International digital library …, 2004 - emerald.com
This study presents findings with a particular digital library system, the Belgian‐American
Research Collection at the University of Wisconsin Digital Collections Center (UWDCC). It …

Evaluating the user experience in a digital library

M Barifah, M Landoni… - Proceedings of the …, 2020 - Wiley Online Library
Digital libraries (DLs) have been evaluated implicitly by analyzing the query behavior
extracted from the log files (LFs), and explicitly by conducting user studies and usability …

[PDF][PDF] Evaluation of digital library services using complementary logs

M Agostii, F Crivellari, GM Di Nunzio - Understanding the User …, 2009 - academia.edu
In recent years, the importance of log analysis has grown, log data constitute a relevant
aspect in the evaluation process of the quality of a digital library system. In this paper, we …

A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

C Behnert, D Lewandowski - Journal of Documentation, 2017 - emerald.com
Purpose The purpose of this paper is to demonstrate how to apply traditional information
retrieval (IR) evaluation methods based on standards from the Text REtrieval Conference …

Measuring the retrievability of digital library content using analytics data

H Jahani, L Azzopardi… - Journal of the Association …, 2024 - Wiley Online Library
Digital libraries aim to provide value to users by housing content that is accessible and
searchable. Often such access is afforded through external web search engines. In this …