Facet: Fairness in computer vision evaluation benchmark

L Gustafson, C Rolland, N Ravi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Computer vision models have known performance disparities across attributes such as
gender and skin tone. This means during tasks such as classification and detection, model …

Debiasing vision-language models via biased prompts

CY Chuang, V Jampani, Y Li, A Torralba… - arXiv preprint arXiv …, 2023 - arxiv.org
Machine learning models have been shown to inherit biases from their training datasets.
This can be particularly problematic for vision-language foundation models trained on …

The bias amplification paradox in text-to-image generation

P Seshadri, S Singh, Y Elazar - arXiv preprint arXiv:2308.00755, 2023 - arxiv.org
Bias amplification is a phenomenon in which models increase imbalances present in the
training data. In this paper, we study bias amplification in the text-to-image domain using …

Mitigating test-time bias for fair image retrieval

F Kong, S Yuan, W Hao… - Advances in Neural …, 2024 - proceedings.neurips.cc
We address the challenge of generating fair and unbiased image retrieval results given
neutral textual queries (with no explicit gender or race connotations), while maintaining the …

Would Deep Generative Models Amplify Bias in Future Models?

T Chen, Y Hirota, M Otani, N Garcia… - Proceedings of the …, 2024 - openaccess.thecvf.com
We investigate the impact of deep generative models on potential social biases in upcoming
computer vision models. As the internet witnesses an increasing influx of AI-generated …

No filter: Cultural and socioeconomic diversityin contrastive vision-language models

A Pouget, L Beyer, E Bugliarello, X Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
We study cultural and socioeconomic diversity in contrastive vision-language models
(VLMs). Using a broad range of benchmark datasets and evaluation metrics, we bring to …

Avibench: Towards evaluating the robustness of large vision-language model on adversarial visual-instructions

H Zhang, W Shao, H Liu, Y Ma, P Luo, Y Qiao… - arXiv preprint arXiv …, 2024 - arxiv.org
Large Vision-Language Models (LVLMs) have shown significant progress in well
responding to visual-instructions from users. However, these instructions, encompassing …

Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Images

KC Fraser, S Kiritchenko - arXiv preprint arXiv:2402.05779, 2024 - arxiv.org
Following on recent advances in large language models (LLMs) and subsequent chat
models, a new wave of large vision-language models (LVLMs) has emerged. Such models …

SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples

P Howard, A Madasu, T Le… - Proceedings of the …, 2024 - openaccess.thecvf.com
While vision-language models (VLMs) have achieved remarkable performance
improvements recently there is growing evidence that these models also posses harmful …

Fairness in Large Language Models: A Taxonomic Survey

Z Chu, Z Wang, W Zhang - ACM SIGKDD Explorations Newsletter, 2024 - dl.acm.org
Large Language Models (LLMs) have demonstrated remarkable success across various
domains. However, despite their promising performance in numerous real-world …