PARAPHRASUS: A Comprehensive Benchmark for Evaluating Paraphrase Detection Models

A Michail, S Clematide, J Opitz - arXiv preprint arXiv:2409.12060, 2024 - arxiv.org
The task of determining whether two texts are paraphrases has long been a challenge in
NLP. However, the prevailing notion of paraphrase is often quite simplistic, offering only a …

A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

H Zhang, PS Yu, J Zhang - arXiv preprint arXiv:2406.11289, 2024 - arxiv.org
Text summarization research has undergone several significant transformations with the
advent of deep neural networks, pre-trained language models (PLMs), and recent large …

QAPyramid: Fine-grained Evaluation of Content Selection for Text Summarization

S Zhang, D Wan, A Cattan, A Klein, I Dagan… - arXiv preprint arXiv …, 2024 - arxiv.org
How to properly conduct human evaluations for text summarization is a longstanding
challenge. The Pyramid human evaluation protocol, which assesses content selection by …

uMedSum: A Unified Framework for Advancing Medical Abstractive Summarization

A Nagar, Y Liu, AT Liu, V Schlegel, VP Dwivedi… - arXiv preprint arXiv …, 2024 - arxiv.org
Medical abstractive summarization faces the challenge of balancing faithfulness and
informativeness. Current methods often sacrifice key information for faithfulness or introduce …

Towards an Automated Pointwise Evaluation Metric for Generated Long-Form Legal Summaries

SM Tan, Q Grail, L Quartey - Proceedings of the Natural Legal …, 2024 - aclanthology.org
Long-form abstractive summarization is a task that has particular importance in the legal
domain. Automated evaluation metrics are important for the development of text generation …

Assessing the Impact of Prompt Strategies on Text Summarization with Large Language Models

A Onan, H Alhumyani - … Conference on Computer Applications in Industry …, 2024 - Springer
The advent of large language models (LLMs) has significantly advanced the field of text
summarization, enabling the generation of coherent and contextually accurate summaries …