Storytelling with image data: A systematic review and comparative analysis of methods and tools

F Lotfi, A Beheshti, H Farhood, M Pooshideh… - Algorithms, 2023 - mdpi.com
In our digital age, data are generated constantly from public and private sources, social
media platforms, and the Internet of Things. A significant portion of this information comes in …

Visual writing prompts: Character-grounded story generation with curated image sequences

X Hong, A Sayeed, K Mehra, V Demberg… - Transactions of the …, 2023 - direct.mit.edu
Current work on image-based story generation suffers from the fact that the existing image
sequence collections do not have coherent plots behind them. We improve visual story …

AOG-LSTM: An adaptive attention neural network for visual storytelling

H Liu, J Yang, CH Chang, W Wang, HT Zheng, Y Jiang… - Neurocomputing, 2023 - Elsevier
Visual storytelling is the task of generating a related story for a given image sequence, which
has received significant attention. However, using general RNNs (such as LSTM and GRU) …

Latent memory-augmented graph transformer for visual storytelling

M Qi, J Qin, D Huang, Z Shen, Y Yang… - Proceedings of the 29th …, 2021 - dl.acm.org
Visual storytelling aims to automatically generate a human-like short story given an image
stream. Most existing works utilize either scene-level or object-level representations …

Visual Storytelling with Question-Answer Plans

D Liu, M Lapata, F Keller - arXiv preprint arXiv:2310.05295, 2023 - arxiv.org
Visual storytelling aims to generate compelling narratives from image sequences. Existing
models often focus on enhancing the representation of the image sequence, eg, with …

Sentistory: A multi-layered sentiment-aware generative model for visual storytelling

W Chen, X Liu, J Niu - … on Circuits and Systems for Video …, 2022 - ieeexplore.ieee.org
The visual storytelling (VIST) task aims at generating reasonable, human-like and coherent
stories with the image streams as input. Although many deep learning models have …

Visual coherence loss for coherent and visually grounded story generation

X Hong, V Demberg, A Sayeed, Q Zheng… - Findings of the …, 2023 - aclanthology.org
Local coherence is essential for long-form text generation models. We identify two important
aspects of local coherence within the visual storytelling task:(1) the model needs to …

DataNarrative: Automated data-driven storytelling with visualizations and texts

MS Islam, MTR Laskar, MR Parvez, E Hoque… - arXiv preprint arXiv …, 2024 - arxiv.org
Data-driven storytelling is a powerful method for conveying insights by combining narrative
techniques with visualizations and text. These stories integrate visual aids, such as …

Detecting and grounding important characters in visual stories

D Liu, F Keller - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Characters are essential to the plot of any story. Establishing the characters before writing a
story can improve the clarity of the plot and the overall flow of the narrative. However …

Ordered attention for coherent visual storytelling

T Braude, I Schwartz, A Schwing, A Shamir - Proceedings of the 30th …, 2022 - dl.acm.org
We address the problem of visual storytelling, ie, generating a story for a given sequence of
images. While each story sentence should describe a corresponding image, a coherent …