Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Machine-generated text: A comprehensive survey of threat models and detection methods

E Crothers, N Japkowicz, HL Viktor - IEEE Access, 2023 - ieeexplore.ieee.org
Machine-generated text is increasingly difficult to distinguish from text authored by humans.
Powerful open-source models are freely available, and user-friendly tools that democratize …

A survey of large language models

WX Zhao, K Zhou, J Li, T Tang, X Wang, Y Hou… - arXiv preprint arXiv …, 2023 - arxiv.org
Language is essentially a complex, intricate system of human expressions governed by
grammatical rules. It poses a significant challenge to develop capable AI algorithms for …

Controlled text generation with natural language instructions

W Zhou, YE Jiang, E Wilcox… - International …, 2023 - proceedings.mlr.press
Large language models can be prompted to pro-duce fluent output for a wide range of tasks
without being specifically trained to do so. Nevertheless, it is notoriously difficult to control …

Medusa: Simple llm inference acceleration framework with multiple decoding heads

T Cai, Y Li, Z Geng, H Peng, JD Lee, D Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
The inference process in Large Language Models (LLMs) is often limited due to the absence
of parallelism in the auto-regressive decoding process, resulting in most operations being …

Ssd-lm: Semi-autoregressive simplex-based diffusion language model for text generation and modular control

X Han, S Kumar, Y Tsvetkov - arXiv preprint arXiv:2210.17432, 2022 - arxiv.org
Despite the growing success of diffusion models in continuous-valued domains (eg,
images), similar efforts for discrete domains such as text have yet to match the performance …

Look before you leap: An exploratory study of uncertainty measurement for large language models

Y Huang, J Song, Z Wang, H Chen, L Ma - arXiv preprint arXiv:2307.10236, 2023 - arxiv.org
The recent performance leap of Large Language Models (LLMs) opens up new
opportunities across numerous industrial applications and domains. However, erroneous …

Does Writing with Language Models Reduce Content Diversity?

V Padmakumar, H He - arXiv preprint arXiv:2309.05196, 2023 - arxiv.org
Large language models (LLMs) have led to a surge in collaborative writing with model
assistance. As different users incorporate suggestions from the same model, there is a risk of …

Bag of tricks for training data extraction from language models

W Yu, T Pang, Q Liu, C Du, B Kang… - International …, 2023 - proceedings.mlr.press
With the advance of language models, privacy protection is receiving more attention.
Training data extraction is therefore of great importance, as it can serve as a potential tool to …

[HTML][HTML] Applying large language models and chain-of-thought for automatic scoring

GG Lee, E Latif, X Wu, N Liu, X Zhai - Computers and Education: Artificial …, 2024 - Elsevier
This study investigates the application of large language models (LLMs), specifically GPT-
3.5 and GPT-4, with Chain-of-Though (CoT) in the automatic scoring of student-written …