Towards Long-term Annotators: A Supervised Label Aggregation Baseline

H Liu, F Wang, M Lin, R Wu, R Zhu, S Zhao… - arXiv preprint arXiv …, 2023 - arxiv.org
Relying on crowdsourced workers, data crowdsourcing platforms are able to efficiently
provide vast amounts of labeled data. Due to the variability in the annotation quality of crowd …

A Lightweight, Effective, and Efficient Model for Label Aggregation in Crowdsourcing

Y Yang, ZQ Zhao, G Wu, X Zhuo, Q Liu, Q Bai… - ACM Transactions on …, 2024 - dl.acm.org
Due to the presence of noise in crowdsourced labels, label aggregation (LA) has become a
standard procedure for post-processing these labels. LA methods estimate true labels from …

Stability of Weighted Majority Voting under Estimated Weights

S Bai, D Wang, T Muller, P Cheng, J Chen - arXiv preprint arXiv …, 2022 - arxiv.org
Weighted Majority Voting (WMV) is a well-known optimal decision rule for collective decision
making, given the probability of sources to provide accurate information (trustworthiness) …

Collaborative classification from noisy labels

L Maystre, N Kumarappan… - International …, 2021 - proceedings.mlr.press
We consider a setting where users interact with a collection of N items on an online platform.
We are given class labels possibly corrupted by noise, and we seek to recover the true class …

On the efficiency of data collection and aggregation for the combination of multiple classifiers

E Manino - 2020 - eprints.soton.ac.uk
Many classification problems are solved by combining the output of a group of distinct
predictors. Whether it is voting, consulting domain experts, training an ensemble method or …