A survey on evaluation of large language models

Y Chang, X Wang, J Wang, Y Wu, L Yang… - ACM Transactions on …, 2024 - dl.acm.org
Large language models (LLMs) are gaining increasing popularity in both academia and
industry, owing to their unprecedented performance in various applications. As LLMs …

Combating misinformation in the age of llms: Opportunities and challenges

C Chen, K Shu - AI Magazine, 2024 - Wiley Online Library
Misinformation such as fake news and rumors is a serious threat for information ecosystems
and public trust. The emergence of large language models (LLMs) has great potential to …

Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attacks

J Wu, J Guo, B Hooi - Proceedings of the 30th ACM SIGKDD conference …, 2024 - dl.acm.org
It is commonly perceived that fake news and real news exhibit distinct writing styles, such as
the use of sensationalist versus objective language. However, we emphasize that style …

Cfbench: A comprehensive constraints-following benchmark for llms

T Zhang, Y Shen, W Luo, Y Zhang, H Liang… - arXiv preprint arXiv …, 2024 - arxiv.org
The adeptness of Large Language Models (LLMs) in comprehending and following natural
language instructions is critical for their deployment in sophisticated real-world applications …

Parrot: Enhancing multi-turn instruction following for large language models

Y Sun, C Liu, K Zhou, J Huang, R Song… - Proceedings of the …, 2024 - aclanthology.org
Humans often interact with large language models (LLMs) in multi-turn interaction to obtain
desired answers or more information. However, most existing studies overlook the multi-turn …

Preventing and detecting misinformation generated by large language models

A Liu, Q Sheng, X Hu - Proceedings of the 47th International ACM SIGIR …, 2024 - dl.acm.org
As large language models (LLMs) become increasingly capable and widely deployed, the
risk of them generating misinformation poses a critical challenge. Misinformation from LLMs …

L-eval: Instituting standardized evaluation for long context language models

C An, S Gong, M Zhong, X Zhao, M Li, J Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Recently, there has been growing interest in extending the context length of large language
models (LLMs), aiming to effectively process long inputs of one turn or conversations with …

Data management for large language models: A survey

Z Wang, W Zhong, Y Wang, Q Zhu, F Mi, B Wang… - CoRR, 2023 - openreview.net
Data plays a fundamental role in the training of Large Language Models (LLMs). Effective
data management, particularly in the formulation of a well-suited training dataset, holds …

Datasets for large language models: A comprehensive survey

Y Liu, J Cao, C Liu, K Ding, L Jin - arXiv preprint arXiv:2402.18041, 2024 - arxiv.org
This paper embarks on an exploration into the Large Language Model (LLM) datasets,
which play a crucial role in the remarkable advancements of LLMs. The datasets serve as …

Targen: Targeted data generation with large language models

H Gupta, K Scaria, U Anantheswaran, S Verma… - arXiv preprint arXiv …, 2023 - arxiv.org
The rapid advancement of large language models (LLMs) has sparked interest in data
synthesis techniques, aiming to generate diverse and high-quality synthetic datasets …