Older versions of the ROUGEeval summarization evaluation system were easier to fool

J Sjöbergh - Information Processing & Management, 2007 - Elsevier
We show some limitations of the ROUGE evaluation method for automatic summarization.
We present a method for automatic summarization based on a Markov model of the source …

[PDF][PDF] A Comparison of Methods for the Evaluation of Text Summarization Techniques.

M Barbella, M Risi, G Tortora - DATA, 2021 - scitepress.org
Automatic Text Summarization techniques aim to extract key information from one or more
input texts automatically, producing summaries and preserving the meaning of content …

Evaluation measures for text summarization

J Steinberger, K Ježek - Computing and Informatics, 2009 - cai.sk
We explain the ideas of automatic text summarization approaches and the taxonomy of
summary evaluation methods. Moreover, we propose a new evaluation measure for …

Rouge metric evaluation for text summarization techniques

M Barbella, G Tortora - Available at SSRN 4120317, 2022 - papers.ssrn.com
Abstract Approaches to Automatic Text Summarization try to extract key information from one
or more input texts and generate summaries whilst preserving content meaning. These …

[PDF][PDF] A Repository of State of the Art and Competitive Baseline Summaries for Generic News Summarization.

K Hong, JM Conroy, B Favre, A Kulesza, H Lin… - LREC, 2014 - lrec-conf.org
In the period since 2004, many novel sophisticated approaches for generic multi-document
summarization have been developed. Intuitive simple approaches have also been shown to …

[PDF][PDF] Evaluating Summarisation Technologies: A Task Oriented Approach.

P McLellan, A Tombros, JM Jose, I Ounis, M Whitehead - NDDL, 2001 - eecs.qmul.ac.uk
This paper presents a novel task-oriented approach for the evaluation of automatic text
summarisation systems. Evaluation of systems has traditionally been a troublesome area in …

[PDF][PDF] Evaluation of automatic text summarization

M Hassel - Licentiate Thesis, Stockholm, Sweden, 2004 - Citeseer
Summaries are an important tool for familiarizing oneself with a subject area. Text
summaries are essential when forming an opinion on if reading a document in whole is …

[PDF][PDF] Creating Summarization Systems with SUMMA.

H Saggion - LREC, 2014 - Citeseer
Automatic text summarization, the reduction of a text to its essential content is fundamental
for an on-line information society. Although many summarization algorithms exist, there are …

Automatic summarization: an overview

H Saggion - Revue française de linguistique appliquée, 2008 - cairn.info
A summary is a condensed version of a document. It contains the most relevant information
in context found in the source document. Automatic summarization is the process of …

[PDF][PDF] Automated Summarization Evaluation with Basic Elements.

EH Hovy, CY Lin, L Zhou, J Fukumoto - LREC, 2006 - lrec-conf.org
As part of evaluating a summary automatically, it is usual to determine how much of the
contents of one or more humanproduced 'ideal'summaries it contains. Previous automated …