Older versions of the ROUGEeval summarization evaluation system were easier to fool

J Sjöbergh - Information Processing & Management, 2007 - Elsevier
We show some limitations of the ROUGE evaluation method for automatic summarization.
We present a method for automatic summarization based on a Markov model of the source
text. By a simple greedy word selection strategy, summaries with high ROUGE-scores are
generated. These summaries would however not be considered good by human readers.
The method can be adapted to trick different settings of the ROUGEeval package.
以上显示的是最相近的搜索结果。 查看全部搜索结果