Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Neural machine translation for low-resource languages: A survey

S Ranathunga, ESA Lee, M Prifti Skenduli… - ACM Computing …, 2023 - dl.acm.org
Neural Machine Translation (NMT) has seen tremendous growth in the last ten years since
the early 2000s and has already entered a mature phase. While considered the most widely …

Scene graph as pivoting: Inference-time image-free unsupervised multimodal machine translation with visual scene hallucination

H Fei, Q Liu, M Zhang, M Zhang, TS Chua - arXiv preprint arXiv …, 2023 - arxiv.org
In this work, we investigate a more realistic unsupervised multimodal machine translation
(UMMT) setup, inference-time image-free UMMT, where the model is trained with source-text …

Multilingual unsupervised neural machine translation with denoising adapters

A Üstün, A Berard, L Besacier, M Gallé - arXiv preprint arXiv:2110.10472, 2021 - arxiv.org
We consider the problem of multilingual unsupervised machine translation, translating to
and from languages that only have monolingual data by using auxiliary parallel language …

Using natural language prompts for machine translation

X Garcia, O Firat - arXiv preprint arXiv:2202.11822, 2022 - arxiv.org
We explore the use of natural language prompts for controlling various aspects of the
outputs generated by machine translation models. We demonstrate that natural language …

Adapting high-resource NMT models to translate low-resource related languages without parallel data

WJ Ko, A El-Kishky, A Renduchintala… - arXiv preprint arXiv …, 2021 - arxiv.org
The scarcity of parallel data is a major obstacle for training high-quality machine translation
systems for low-resource languages. Fortunately, some low-resource languages are …

Harnessing multilinguality in unsupervised machine translation for rare languages

X Garcia, A Siddhant, O Firat, AP Parikh - arXiv preprint arXiv:2009.11201, 2020 - arxiv.org
Unsupervised translation has reached impressive performance on resource-rich language
pairs such as English-French and English-German. However, early studies have shown that …

A multilingual view of unsupervised machine translation

X Garcia, P Foret, T Sellam, AP Parikh - arXiv preprint arXiv:2002.02955, 2020 - arxiv.org
We present a probabilistic framework for multilingual neural machine translation that
encompasses supervised and unsupervised setups, focusing on unsupervised translation …

SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

Z Li, H Zhao, R Wang, K Chen, M Utiyama… - arXiv preprint arXiv …, 2020 - arxiv.org
In this paper, we introduced our joint team SJTU-NICT's participation in the WMT 2020
machine translation shared task. In this shared task, we participated in four translation …

Integrating unsupervised data generation into self-supervised neural machine translation for low-resource languages

D Ruiter, D Klakow, J van Genabith… - arXiv preprint arXiv …, 2021 - arxiv.org
For most language combinations, parallel data is either scarce or simply unavailable. To
address this, unsupervised machine translation (UMT) exploits large amounts of …