From colouring-in to pointillism: revisiting semantic segmentation supervision

R Benenson, V Ferrari - arXiv preprint arXiv:2210.14142, 2022 - arxiv.org
The prevailing paradigm for producing semantic segmentation training data relies on
densely labelling each pixel of each image in the training set, akin to colouring-in books …

Computing crowd consensus with partial agreement

NQV Hung, HH Viet, NT Tam… - … on Knowledge and …, 2017 - ieeexplore.ieee.org
Crowdsourcing has been widely established as a means to enable human computation at
large-scale, in particular for tasks that require manual labelling of large sets of data items …

Crowdsourcing multi-label audio annotation tasks with citizen scientists

M Cartwright, G Dove, AE Méndez Méndez… - Proceedings of the …, 2019 - dl.acm.org
Annotating rich audio data is an essential aspect of training and evaluating machine
listening systems. We approach this task in the context of temporally-complex urban …

Towards good practices for efficiently annotating large-scale image classification datasets

YH Liao, A Kar, S Fidler - … of the IEEE/CVF Conference on …, 2021 - openaccess.thecvf.com
Data is the engine of modern computer vision, which necessitates collecting large-scale
datasets. This is expensive, and guaranteeing the quality of the labels is a major challenge …

Searching for computer vision north stars

L Fei-Fei, R Krishna - Daedalus, 2022 - direct.mit.edu
Computer vision is one of the most fundamental areas of artificial intelligence research. It
has contributed to the tremendous progress in the recent deep learning revolution in AI. In …

Plmcl: Partial-label momentum curriculum learning for multi-label image classification

R Abdelfattah, X Zhang, Z Wu, X Wu, X Wang… - … on Computer Vision, 2022 - Springer
Multi-label image classification aims to predict all possible labels in an image. It is usually
formulated as a partial-label learning problem, given the fact that it could be expensive in …

A review of judgment analysis algorithms for crowdsourced opinions

S Chatterjee, A Mukhopadhyay… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
The crowd-powered systems have been shown to be highly successful in the current decade
to manage collective contribution of online workers for solving different complex tasks. It can …

Lean crowdsourcing: Combining humans and machines in an online system

S Branson, G Van Horn… - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
We introduce a method to greatly reduce the amount of redundant annotations required
when crowdsourcing annotations such as bounding boxes, parts, and class labels. For …

Seeing sound: Investigating the effects of visualizations and complexity on crowdsourced audio annotations

M Cartwright, A Seals, J Salamon, A Williams… - Proceedings of the …, 2017 - dl.acm.org
Audio annotation is key to developing machine-listening systems; yet, effective ways to
accurately and rapidly obtain crowdsourced audio annotations is understudied. In this work …

Exploiting weakly supervised visual patterns to learn from partial annotations

K Kundu, J Tighe - Advances in Neural Information …, 2020 - proceedings.neurips.cc
As classifications datasets progressively get larger in terms of label space and number of
examples, annotating them with all labels becomes non-trivial and expensive task. For …