Discoscore: Evaluating text generation with bert and discourse coherence

W Zhao, M Strube, S Eger - arXiv preprint arXiv:2201.11176, 2022 - arxiv.org
Recently, there has been a growing interest in designing text generation systems from a
discourse coherence perspective, eg, modeling the interdependence between sentences …

A neural local coherence model for text quality assessment

M Mesgar, M Strube - Proceedings of the 2018 conference on …, 2018 - aclanthology.org
We propose a local coherence model that captures the flow of what semantically connects
adjacent sentences in a text. We represent the semantics of a sentence by a vector and …

Multiattentive recurrent neural network architecture for multilingual readability assessment

IM Azpiazu, MS Pera - Transactions of the Association for …, 2019 - direct.mit.edu
We present a multiattentive recurrent neural network architecture for automatic multilingual
readability assessment. This architecture considers raw words as its main input, but …

Discourse coherence in the wild: A dataset, evaluation and methods

A Lai, J Tetreault - arXiv preprint arXiv:1805.04993, 2018 - arxiv.org
To date there has been very little work on assessing discourse coherence methods on real-
world data. To address this, we present a new corpus of real-world texts (GCDC) as well as …

Evaluating document coherence modeling

A Shen, M Mistica, B Salehi, H Li… - Transactions of the …, 2021 - direct.mit.edu
While pretrained language models (LMs) have driven impressive gains over morpho-
syntactic and semantic tasks, their ability to model discourse and pragmatic phenomena is …

Modeling structural similarities between documents for coherence assessment with graph convolutional networks

W Liu, X Fu, M Strube - arXiv preprint arXiv:2306.06472, 2023 - arxiv.org
Coherence is an important aspect of text quality, and various approaches have been applied
to coherence modeling. However, existing methods solely focus on a single document's …

Towards evaluating narrative quality in student writing

S Somasundaran, M Flor, M Chodorow… - Transactions of the …, 2018 - direct.mit.edu
This work lays the foundation for automated assessments of narrative quality in student
writing. We first manually score essays for narrative-relevant traits and sub-traits, and …

How coherent are neural models of coherence?

L Pishdad, F Fancellu, R Zhang… - Proceedings of the 28th …, 2020 - aclanthology.org
Despite the recent advances in coherence modelling, most such models including state-of-
the-art neural ones, are evaluated on either contrived proxy tasks such as the standard order …

How to find strong summary coherence measures? a toolbox and a comparative study for summary coherence measure evaluation

J Steen, K Markert - arXiv preprint arXiv:2209.06517, 2022 - arxiv.org
Automatically evaluating the coherence of summaries is of great significance both to enable
cost-efficient summarizer evaluation and as a tool for improving coherence by selecting high …

A neural graph-based local coherence model

M Mesgar, LFR Ribeiro, I Gurevych - Findings of the Association …, 2021 - aclanthology.org
Entity grids and entity graphs are two frameworks for modeling local coherence. These
frameworks represent entity relations between sentences and then extract features from …