Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Report from the nsf future directions workshop on automatic evaluation of dialog: Research directions and challenges

S Mehri, J Choi, LF D'Haro, J Deriu, M Eskenazi… - arXiv preprint arXiv …, 2022 - arxiv.org
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog.
The workshop explored the current state of the art along with its limitations and suggested …

Lift yourself up: Retrieval-augmented text generation with self-memory

X Cheng, D Luo, X Chen, L Liu… - Advances in Neural …, 2024 - proceedings.neurips.cc
With direct access to human-written reference as memory, retrieval-augmented generation
has achieved much progress in a wide range of text generation tasks. Since better memory …

InstructDial: Improving zero and few-shot generalization in dialogue through instruction tuning

P Gupta, C Jiao, YT Yeh, S Mehri, M Eskenazi… - arXiv preprint arXiv …, 2022 - arxiv.org
Instruction tuning is an emergent paradigm in NLP wherein natural language instructions
are leveraged with language models to induce zero-shot performance on unseen tasks …

A comprehensive assessment of dialog evaluation metrics

YT Yeh, M Eskenazi, S Mehri - arXiv preprint arXiv:2106.03706, 2021 - arxiv.org
Automatic evaluation metrics are a crucial component of dialog systems research. Standard
language evaluation metrics are known to be ineffective for evaluating dialog. As such …

Iseeq: Information seeking question generation using dynamic meta-information retrieval and knowledge graphs

M Gaur, K Gunaratna, V Srinivasan, H Jin - Proceedings of the AAAI …, 2022 - ojs.aaai.org
Abstract Conversational Information Seeking (CIS) is a relatively new research area within
conversational AI that attempts to seek information from end-users in order to understand …

PLANET: Dynamic content planning in autoregressive transformers for long-form text generation

Z Hu, HP Chan, J Liu, X Xiao, H Wu… - arXiv preprint arXiv …, 2022 - arxiv.org
Despite recent progress of pre-trained language models on generating fluent text, existing
methods still suffer from incoherence problems in long-form text generation tasks that …

Convntm: conversational neural topic model

H Sun, Q Tu, J Li, R Yan - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Topic models have been thoroughly investigated for multiple years due to their great
potential in analyzing and understanding texts. Recently, researchers combine the study of …

RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue

Z Shi, W Sun, S Zhang, Z Zhang, P Ren… - arXiv preprint arXiv …, 2023 - arxiv.org
Evaluating open-domain dialogue systems is challenging for reasons such as the one-to-
many problem, ie, many appropriate responses other than just the golden response. As of …

Transesc: Smoothing emotional support conversation via turn-level state transition

W Zhao, Y Zhao, S Wang, B Qin - arXiv preprint arXiv:2305.03296, 2023 - arxiv.org
Emotion Support Conversation (ESC) is an emerging and challenging task with the goal of
reducing the emotional distress of people. Previous attempts fail to maintain smooth …