A survey on long text modeling with transformers

Z Dong, T Tang, L Li, WX Zhao - arXiv preprint arXiv:2302.14502, 2023 - arxiv.org
Modeling long texts has been an essential technique in the field of natural language
processing (NLP). With the ever-growing number of long documents, it is important to …

ChatGPT vs human-authored text: Insights into controllable text summarization and sentence style transfer

D Pu, V Demberg - arXiv preprint arXiv:2306.07799, 2023 - arxiv.org
Large-scale language models, like ChatGPT, have garnered significant media attention and
stunned the public with their remarkable capacity for generating coherent text from short …

Visual writing prompts: Character-grounded story generation with curated image sequences

X Hong, A Sayeed, K Mehra, V Demberg… - Transactions of the …, 2023 - direct.mit.edu
Current work on image-based story generation suffers from the fact that the existing image
sequence collections do not have coherent plots behind them. We improve visual story …

Moviesum: An abstractive summarization dataset for movie screenplays

R Saxena, F Keller - arXiv preprint arXiv:2408.06281, 2024 - arxiv.org
Movie screenplay summarization is challenging, as it requires an understanding of long
input contexts and various elements unique to movies. Large language models have shown …

Incorporating distributions of discourse structure for long document abstractive summarization

D Pu, Y Wang, V Demberg - arXiv preprint arXiv:2305.16784, 2023 - arxiv.org
For text summarization, the role of discourse structure is pivotal in discerning the core
content of a text. Regrettably, prior studies on incorporating Rhetorical Structure Theory …

Visual coherence loss for coherent and visually grounded story generation

X Hong, V Demberg, A Sayeed, Q Zheng… - Findings of the …, 2023 - aclanthology.org
Local coherence is essential for long-form text generation models. We identify two important
aspects of local coherence within the visual storytelling task:(1) the model needs to …

Summary of the Visually Grounded Story Generation Challenge

X Hong, A Sayeed, V Demberg - Proceedings of the 17th …, 2024 - aclanthology.org
Recent advancements in vision-and-language models have opened new possibilities for
natural language generation, particularly in generating creative stories from visual input. We …

The Bart-based Model for Scientific Articles Summarization.

M Ülker, AB Özer - Journal of Universal Computer Science …, 2024 - search.ebscohost.com
With the development of deep learning techniques, many models have been proposed for
abstractive text summarization. However, the problem of summarizing source documents …

Two-step Text Summarization for Long-form Biographical Narrative Genre

A Bleiweiss - Proceedings of the 4th Workshop on Computational …, 2023 - aclanthology.org
Transforming narrative structure to implicit discourse relations in long-form text has recently
seen a mindset shift toward assessing generation consistency. To this extent, summarization …

T4S: Two-Stage Screenplay Synopsis Summary Generation with Turning Points

D Wang, W Sun, C Luo, D Liu, R Mao, R Xu - International Conference on …, 2023 - Springer
The recent advancements in neural network models and the availability of vast amounts of
data, automatic summarization technology has become one of the primary solutions for …