Visual classification via description from large language models

S Menon, C Vondrick - arXiv preprint arXiv:2210.07183, 2022 - arxiv.org
Vision-language models (VLMs) such as CLIP have shown promising performance on a
variety of recognition tasks using the standard zero-shot classification procedure--computing …

Multimodal datasets: misogyny, pornography, and malignant stereotypes

A Birhane, VU Prabhu, E Kahembwe - arXiv preprint arXiv:2110.01963, 2021 - arxiv.org
We have now entered the era of trillion parameter machine learning models trained on
billion-sized datasets scraped from the internet. The rise of these gargantuan datasets has …

Wilds: A benchmark of in-the-wild distribution shifts

PW Koh, S Sagawa, H Marklund… - International …, 2021 - proceedings.mlr.press
Distribution shifts—where the training distribution differs from the test distribution—can
substantially degrade the accuracy of machine learning (ML) systems deployed in the wild …

Weighted boxes fusion: Ensembling boxes from different object detection models

R Solovyev, W Wang, T Gabruseva - Image and Vision Computing, 2021 - Elsevier
Object detection is a crucial task in computer vision systems with a wide range of
applications in autonomous driving, medical imaging, retail, security, face recognition …

A framework for understanding sources of harm throughout the machine learning life cycle

H Suresh, J Guttag - Proceedings of the 1st ACM Conference on Equity …, 2021 - dl.acm.org
As machine learning (ML) increasingly affects people and society, awareness of its potential
unwanted consequences has also grown. To anticipate, prevent, and mitigate undesirable …

A step toward more inclusive people annotations for fairness

C Schumann, S Ricco, U Prabhu, V Ferrari… - Proceedings of the …, 2021 - dl.acm.org
The Open Images Dataset contains approximately 9 million images and is a widely accepted
dataset for computer vision research. As is common practice for large datasets, the …

Diversity in sociotechnical machine learning systems

S Fazelpour, M De-Arteaga - Big Data & Society, 2022 - journals.sagepub.com
There has been a surge of recent interest in sociocultural diversity in machine learning
research. Currently, however, there is a gap between discussions of measures and benefits …

A systematic assessment of national artificial intelligence policies: Perspectives from the Nordics and beyond

N van Berkel, E Papachristos, A Giachanou… - Proceedings of the 11th …, 2020 - dl.acm.org
Echoing the evolving interest and impact of artificial intelligence on society, governments are
increasingly looking for ways to strategically position themselves as both innovators and …

Automating ambiguity: Challenges and pitfalls of artificial intelligence

A Birhane - arXiv preprint arXiv:2206.04179, 2022 - arxiv.org
Machine learning (ML) and artificial intelligence (AI) tools increasingly permeate every
possible social, political, and economic sphere; sorting, taxonomizing and predicting …

Cultural and linguistic diversity improves visual representations

A Ye, S Santy, JD Hwang, AX Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Computer vision often treats perception as objective, and this assumption gets reflected in
the way that datasets are collected and models are trained. For instance, image descriptions …