Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models

Z Lin, S Guan, W Zhang, H Zhang, Y Li… - Artificial Intelligence …, 2024 - Springer
Recently, large language models (LLMs) have attracted considerable attention due to their
remarkable capabilities. However, LLMs' generation of biased or hallucinatory content …

Automatic prompt augmentation and selection with chain-of-thought from labeled data

KS Shum, S Diao, T Zhang - arXiv preprint arXiv:2302.12822, 2023 - arxiv.org
Chain-of-thought prompting (CoT) advances the reasoning abilities of large language
models (LLMs) and achieves superior performance in arithmetic, commonsense, and …

Fairness in large language models: A taxonomic survey

Z Chu, Z Wang, W Zhang - ACM SIGKDD explorations newsletter, 2024 - dl.acm.org
Large Language Models (LLMs) have demonstrated remarkable success across various
domains. However, despite their promising performance in numerous real-world …

Unlearning bias in language models by partitioning gradients

C Yu, S Jeoung, A Kasi, P Yu, H Ji - Findings of the Association for …, 2023 - aclanthology.org
Recent research has shown that large-scale pretrained language models, specifically
transformers, tend to exhibit issues relating to racism, sexism, religion bias, and toxicity in …

Bias and unfairness in information retrieval systems: New challenges in the llm era

S Dai, C Xu, S Xu, L Pang, Z Dong, J Xu - Proceedings of the 30th ACM …, 2024 - dl.acm.org
With the rapid advancements of large language models (LLMs), information retrieval (IR)
systems, such as search engines and recommender systems, have undergone a significant …

[PDF][PDF] Social-group-agnostic bias mitigation via the stereotype content model

A Omrani, A Salkhordeh_Ziabari, C Yu, P Golazizian… - 2023 - par.nsf.gov
A bstr act E xisti ng bias miti gati on met ho ds re q uire s ocialgr ou ps peci fic w or d pairs
(eg,“ma n”–“wo ma n”) f or eac hs ocial attri b ute (eg, ge nder), restricti ngt he bias miti gati …

From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Models

KH Huang, HP Chan, YR Fung, H Qiu, M Zhou… - arXiv preprint arXiv …, 2024 - arxiv.org
Data visualization in the form of charts plays a pivotal role in data analysis, offering critical
insights and aiding in informed decision-making. Automatic chart understanding has …

Normsage: Multi-lingual multi-cultural norm discovery from conversations on-the-fly

YR Fung, T Chakraborty, H Guo, O Rambow… - arXiv preprint arXiv …, 2022 - arxiv.org
Norm discovery is important for understanding and reasoning about the acceptable
behaviors and potential violations in human communication and interactions. We introduce …

Word embeddings are steers for language models

C Han, J Xu, M Li, Y Fung, C Sun, N Jiang… - Proceedings of the …, 2024 - aclanthology.org
Abstract Language models (LMs) automatically learn word embeddings during pre-training
on language corpora. Although word embeddings are usually interpreted as feature vectors …

Knowledge overshadowing causes amalgamated hallucination in large language models

Y Zhang, S Li, J Liu, P Yu, YR Fung, J Li, M Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Hallucination is often regarded as a major impediment for using large language models
(LLMs), especially for knowledge-intensive tasks. Even when the training corpus consists …