A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions

L Huang, W Yu, W Ma, W Zhong, Z Feng… - ACM Transactions on …, 2023 - dl.acm.org
The emergence of large language models (LLMs) has marked a significant breakthrough in
natural language processing (NLP), fueling a paradigm shift in information acquisition …

Explainability for large language models: A survey

H Zhao, H Chen, F Yang, N Liu, H Deng, H Cai… - ACM Transactions on …, 2024 - dl.acm.org
Large language models (LLMs) have demonstrated impressive capabilities in natural
language processing. However, their internal mechanisms are still unclear and this lack of …

Towards measuring the representation of subjective global opinions in language models

E Durmus, K Nyugen, TI Liao, N Schiefer… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) may not equitably represent diverse global perspectives on
societal issues. In this paper, we develop a quantitative framework to evaluate whose …

Bias and unfairness in information retrieval systems: New challenges in the llm era

S Dai, C Xu, S Xu, L Pang, Z Dong, J Xu - Proceedings of the 30th ACM …, 2024 - dl.acm.org
With the rapid advancements of large language models (LLMs), information retrieval (IR)
systems, such as search engines and recommender systems, have undergone a significant …

The troubling emergence of hallucination in large language models--an extensive definition, quantification, and prescriptive remediations

V Rawte, S Chakraborty, A Pathak, A Sarkar… - arXiv preprint arXiv …, 2023 - arxiv.org
The recent advancements in Large Language Models (LLMs) have garnered widespread
acclaim for their remarkable emerging capabilities. However, the issue of hallucination has …

Unifying Bias and Unfairness in Information Retrieval: A Survey of Challenges and Opportunities with Large Language Models

S Dai, C Xu, S Xu, L Pang, Z Dong, J Xu - arXiv preprint arXiv:2404.11457, 2024 - arxiv.org
With the rapid advancement of large language models (LLMs), information retrieval (IR)
systems, such as search engines and recommender systems, have undergone a significant …

Math-LLMs: AI cyberinfrastructure with pre-trained transformers for math education

F Zhang, C Li, O Henkel, W Xing, S Baral… - International Journal of …, 2024 - Springer
In recent years, the pre-training of Large Language Models (LLMs) in the educational
domain has garnered significant attention. However, a discernible gap exists in the …

Literature Review of AI Hallucination Research Since the Advent of ChatGPT: Focusing on Papers from arXiv

DM Park, HJ Lee - Informatization Policy, 2024 - koreascience.kr
Hallucination is a significant barrier to the utilization of large-scale language models or
multimodal models. In this study, we collected 654 computer science papers with" …

Understanding the effect of model compression on social bias in large language models

G Gonçalves, E Strubell - arXiv preprint arXiv:2312.05662, 2023 - arxiv.org
Large Language Models (LLMs) trained with self-supervision on vast corpora of web text fit
to the social biases of that text. Without intervention, these social biases persist in the …

Survey of cultural awareness in language models: Text and beyond

S Pawar, J Park, J Jin, A Arora, J Myung… - arXiv preprint arXiv …, 2024 - arxiv.org
Large-scale deployment of large language models (LLMs) in various applications, such as
chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure …