Knowledge learning with crowdsourcing: A brief review and systematic perspective

J Zhang - IEEE/CAA Journal of Automatica Sinica, 2022 - ieeexplore.ieee.org
Big data have the characteristics of enormous volume, high velocity, diversity, value-sparsity,
and uncertainty, which lead the knowledge learning from them full of challenges. With the …

Ensemble learning from crowds

J Zhang, M Wu, VS Sheng - IEEE Transactions on Knowledge …, 2018 - ieeexplore.ieee.org
Traditional learning from crowdsourced labeled data consists of two stages: inferring true
labels for instances from their multiple noisy labels and building a learning model using …

Learning from crowds with annotation reliability

Z Cao, E Chen, Y Huang, S Shen… - Proceedings of the 46th …, 2023 - dl.acm.org
Crowdsourcing provides a practical approach for obtaining annotated data to train
supervised learning models. However, since the crowd annotators may have different …

Multi-class ground truth inference in crowdsourcing with clustering

J Zhang, VS Sheng, J Wu, X Wu - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
Due to low quality of crowdsourced labelers, the integrated label of each example is usually
inferred from its multiple noisy labels provided by different labelers. This paper proposes a …

Learning from the crowd: Observational learning in crowdsourcing communities

L Mamykina, TN Smyth, JP Dimond… - Proceedings of the 2016 …, 2016 - dl.acm.org
Crowd work provides solutions to complex problems effectively, efficiently, and at low cost.
Previous research showed that feedback, particularly correctness feedback can help crowd …

Brief survey of crowdsourcing for data mining

G Xintong, W Hongzhi, Y Song, G Hong - Expert Systems with Applications, 2014 - Elsevier
Crowdsourcing allows large-scale and flexible invocation of human input for data gathering
and analysis, which introduces a new paradigm of data mining process. Traditional data …

Unlearn what you have learned: Adaptive crowd teaching with exponentially decayed memory learners

Y Zhou, AR Nelakurthi, J He - Proceedings of the 24th ACM SIGKDD …, 2018 - dl.acm.org
With the increasing demand for large amount of labeled data, crowdsourcing has been used
in many large-scale data mining applications. However, most existing works in …

[PDF][PDF] Cost-Saving Effect of Crowdsourcing Learning.

L Wang, ZH Zhou - IJCAI, 2016 - ijcai.org
Crowdsourcing is widely adopted in many domains as a popular paradigm to outsource
work to individuals. In the machine learning community, crowdsourcing is commonly used as …

Machine learning with crowdsourcing: A brief summary of the past research and future directions

VS Sheng, J Zhang - Proceedings of the AAAI conference on artificial …, 2019 - ojs.aaai.org
With crowdsourcing systems, labels can be obtained with low cost, which facilitates the
creation of training sets for prediction model learning. However, the labels obtained from …

Learning from crowds in the presence of schools of thought

Y Tian, J Zhu - Proceedings of the 18th ACM SIGKDD international …, 2012 - dl.acm.org
Crowdsourcing has recently become popular among machine learning researchers and
social scientists as an effective way to collect large-scale experimental data from distributed …