Facet: Fairness in computer vision evaluation benchmark

L Gustafson, C Rolland, N Ravi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Computer vision models have known performance disparities across attributes such as
gender and skin tone. This means during tasks such as classification and detection, model …

Identifying Implicit Social Biases in Vision-Language Models

K Hamidieh, H Zhang, T Hartvigsen, M Ghassemi - 2023 - openreview.net
Vision-language models like CLIP are widely used for multimodal retrieval tasks. However,
they can learn historical biases from their training data, resulting in the perpetuation of …

Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost

O Ignat, L Bai, J Nwatu, R Mihalcea - arXiv preprint arXiv:2403.07687, 2024 - arxiv.org
Current foundation models have shown impressive performance across various tasks.
However, several studies have revealed that these models are not effective for everyone …