Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

SimCLS: A simple framework for contrastive learning of abstractive summarization

Y Liu, P Liu - arXiv preprint arXiv:2106.01890, 2021 - arxiv.org
In this paper, we present a conceptually simple while empirically powerful framework for
abstractive summarization, SimCLS, which can bridge the gap between the learning …

Survey of low-resource machine translation

B Haddow, R Bawden, AVM Barone, J Helcl… - Computational …, 2022 - direct.mit.edu
We present a survey covering the state of the art in low-resource machine translation (MT)
research. There are currently around 7,000 languages spoken in the world and almost all …

Ml-lmcl: Mutual learning and large-margin contrastive learning for improving asr robustness in spoken language understanding

X Cheng, B Cao, Q Ye, Z Zhu, H Li, Y Zou - arXiv preprint arXiv …, 2023 - arxiv.org
Spoken language understanding (SLU) is a fundamental task in the task-oriented dialogue
systems. However, the inevitable errors from automatic speech recognition (ASR) usually …

Automated self-supervised learning for recommendation

L Xia, C Huang, C Huang, K Lin, T Yu… - Proceedings of the ACM …, 2023 - dl.acm.org
Graph neural networks (GNNs) have emerged as the state-of-the-art paradigm for
collaborative filtering (CF). To improve the representation quality over limited labeled data …

Cross-modal contrastive learning for speech translation

R Ye, M Wang, L Li - arXiv preprint arXiv:2205.02444, 2022 - arxiv.org
How can we learn unified representations for spoken utterances and their written text?
Learning similar representations for semantically similar speech and text is important for …

Zero-shot stance detection via contrastive learning

B Liang, Z Chen, L Gui, Y He, M Yang… - Proceedings of the ACM …, 2022 - dl.acm.org
Zero-shot stance detection (ZSSD) is challenging as it requires detecting the stance of
previously unseen targets during the inference stage. Being able to detect the target-related …

Recent advances in neural text generation: A task-agnostic survey

C Tang, F Guerin, C Lin - arXiv preprint arXiv:2203.03047, 2022 - arxiv.org
In recent years, considerable research has been dedicated to the application of neural
models in the field of natural language generation (NLG). The primary objective is to …

Contrastive data and learning for natural language processing

R Zhang, Y Ji, Y Zhang… - Proceedings of the 2022 …, 2022 - aclanthology.org
Current NLP models heavily rely on effective representation learning algorithms. Contrastive
learning is one such technique to learn an embedding space such that similar data sample …

Improving neural cross-lingual abstractive summarization via employing optimal transport distance for knowledge distillation

TT Nguyen, AT Luu - Proceedings of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
Current state-of-the-art cross-lingual summarization models employ multi-task learning
paradigm, which works on a shared vocabulary module and relies on the self-attention …