Repairing the cracked foundation: A survey of obstacles in evaluation practices for generated text

S Gehrmann, E Clark, T Sellam - Journal of Artificial Intelligence Research, 2023 - jair.org
Abstract Evaluation practices in natural language generation (NLG) have many known flaws,
but improved evaluation approaches are rarely widely adopted. This issue has become …

The challenging task of summary evaluation: an overview

E Lloret, L Plaza, A Aker - Language Resources and Evaluation, 2018 - Springer
Abstract Evaluation is crucial in the research and development of automatic summarization
applications, in order to determine the appropriateness of a summary based on different …

[HTML][HTML] Summarization of scholarly articles using BERT and BiGRU: Deep learning-based extractive approach

S Bano, S Khalid, NM Tairan, H Shah… - Journal of King Saud …, 2023 - Elsevier
Extractive text summarization involves selecting and combining key sentences directly from
the original text, rather than generating new content. While various methods, both statistical …

[图书][B] Automatic text summarization

JM Torres-Moreno - 2014 - books.google.com
Textual information in the form of digital documents quickly accumulates to create huge
amounts of data. The majority of these documents are unstructured: it is unrestricted text and …

Text summarization using topic-based vector space model and semantic measure

RC Belwal, S Rai, A Gupta - Information Processing & Management, 2021 - Elsevier
The primary shortcoming associated with extractive text summarization is redundancy,
where more than one sentence representing a similar type of information are incorporated in …

Automatic text summarization: Past, present and future

H Saggion, T Poibeau - Multi-source, multilingual information extraction …, 2013 - Springer
Automatic text summarization, the computer-based production of condensed versions of
documents, is an important technology for the information society. Without summaries it …

Automatically assessing machine summary content without a gold standard

A Louis, A Nenkova - Computational Linguistics, 2013 - direct.mit.edu
The most widely adopted approaches for evaluation of summary content follow some
protocol for comparing a summary with gold-standard human summaries, which are …

[图书][B] Quality estimation for machine translation

L Specia, C Scarton, GH Paetzold - 2018 - books.google.com
Many applications within natural language processing involve performing text-to-text
transformations, ie, given a text in natural language as input, systems are required to …

Making it simplext: Implementation and evaluation of a text simplification system for spanish

H Saggion, S Štajner, S Bott, S Mille, L Rello… - ACM Transactions on …, 2015 - dl.acm.org
The way in which a text is written can be a barrier for many people. Automatic text
simplification is a natural language processing technology that, when mature, could be used …

A survey on evaluation of summarization methods

L Ermakova, JV Cossu, J Mothe - Information processing & management, 2019 - Elsevier
The increasing volume of textual information on any topic requires its compression to allow
humans to digest it. This implies detecting the most important information and condensing it …