Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Transformer: A general framework from machine translation to others

Y Zhao, J Zhang, C Zong - Machine Intelligence Research, 2023 - Springer
Abstract Machine translation is an important and challenging task that aims at automatically
translating natural language sentences from one language into another. Recently …

Understanding the benefits and challenges of deploying conversational AI leveraging large language models for public health intervention

E Jo, DA Epstein, H Jung, YH Kim - … of the 2023 CHI Conference on …, 2023 - dl.acm.org
Recent large language models (LLMs) have advanced the quality of open-ended
conversations with chatbots. Although LLM-driven chatbots have the potential to support …

Ddcot: Duty-distinct chain-of-thought prompting for multimodal reasoning in language models

G Zheng, B Yang, J Tang, HY Zhou… - Advances in Neural …, 2023 - proceedings.neurips.cc
A long-standing goal of AI systems is to perform complex multimodal reasoning like humans.
Recently, large language models (LLMs) have made remarkable strides in such multi-step …

[PDF][PDF] Multilingual denoising pre-training for neural machine translation

Y Liu - arXiv preprint arXiv:2001.08210, 2020 - fq.pkwyx.com
This paper demonstrates that multilingual denoising pre-training produces significant
performance gains across a wide variety of machine translation (MT) tasks. We present …

Look before you leap: An exploratory study of uncertainty measurement for large language models

Y Huang, J Song, Z Wang, S Zhao, H Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
The recent performance leap of Large Language Models (LLMs) opens up new
opportunities across numerous industrial applications and domains. However, erroneous …

Incorporating bert into neural machine translation

J Zhu, Y Xia, L Wu, D He, T Qin, W Zhou, H Li… - arXiv preprint arXiv …, 2020 - arxiv.org
The recently proposed BERT has shown great power on a variety of natural language
understanding tasks, such as text classification, reading comprehension, etc. However, how …

Do llms understand user preferences? evaluating llms on user rating prediction

WC Kang, J Ni, N Mehta, M Sathiamoorthy… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing
to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can …

Survey of low-resource machine translation

B Haddow, R Bawden, AVM Barone, J Helcl… - Computational …, 2022 - direct.mit.edu
We present a survey covering the state of the art in low-resource machine translation (MT)
research. There are currently around 7,000 languages spoken in the world and almost all …

Natural language processing advancements by deep learning: A survey

A Torfi, RA Shirvani, Y Keneshloo, N Tavaf… - arXiv preprint arXiv …, 2020 - arxiv.org
Natural Language Processing (NLP) helps empower intelligent machines by enhancing a
better understanding of the human language for linguistic-based human-computer …