Human computation: a survey and taxonomy of a growing field
AJ Quinn, BB Bederson - Proceedings of the SIGCHI conference on …, 2011 - dl.acm.org
The rapid growth of human computation within research and industry has produced many
novel ideas aimed at organizing web users to do great things. However, the growth is not …
novel ideas aimed at organizing web users to do great things. However, the growth is not …
Turkit: human computation algorithms on mechanical turk
Mechanical Turk (MTurk) provides an on-demand source of human computation. This
provides a tremendous opportunity to explore algorithms which incorporate human …
provides a tremendous opportunity to explore algorithms which incorporate human …
In search of quality in crowdsourcing for search engine evaluation
G Kazai - Advances in Information Retrieval: 33rd European …, 2011 - Springer
Crowdsourcing is increasingly looked upon as a feasible alternative to traditional methods of
gathering relevance labels for the evaluation of search engines, offering a solution to the …
gathering relevance labels for the evaluation of search engines, offering a solution to the …
Creating a live, public short message service corpus: the NUS SMS corpus
Abstract Short Message Service (SMS) messages are short messages sent from one person
to another from their mobile phones. They represent a means of personal communication …
to another from their mobile phones. They represent a means of personal communication …
Exploring iterative and parallel human computation processes
Services like Amazon's Mechanical Turk have opened the door for exploration of processes
that outsource computation to humans. These human computation processes hold …
that outsource computation to humans. These human computation processes hold …
An analysis of human factors and label accuracy in crowdsourcing relevance judgments
Crowdsourcing relevance judgments for the evaluation of search engines is used
increasingly to overcome the issue of scalability that hinders traditional approaches relying …
increasingly to overcome the issue of scalability that hinders traditional approaches relying …
Crowdsourcing for music: Survey and taxonomy
C Gomes, D Schneider, K Moraes… - … on Systems, Man, and …, 2012 - ieeexplore.ieee.org
Recent behavioral and cultural changes driven by the paradigm of mass collaboration
highlighted the phenomenon of crowdsourcing as an innovative and promising production …
highlighted the phenomenon of crowdsourcing as an innovative and promising production …
Web workers unite! addressing challenges of online laborers
BB Bederson, AJ Quinn - CHI'11 Extended Abstracts on Human Factors …, 2011 - dl.acm.org
The ongoing rise of human computation as a means of solving computational problems has
created an environment where human workers are often regarded as nameless, faceless …
created an environment where human workers are often regarded as nameless, faceless …
Turkomatic: automatic recursive task and workflow design for mechanical turk
AP Kulkarni, M Can, B Hartmann - CHI'11 extended abstracts on human …, 2011 - dl.acm.org
Completing complex tasks on crowdsourcing platforms like Mechanical Turk currently
requires significant up-front investment into task decomposition and workflow design. We …
requires significant up-front investment into task decomposition and workflow design. We …
Distributed or monolithic? A computational architecture decision framework
Distributed architectures have become ubiquitous in many complex technical and socio-
technical systems because of their role in improving uncertainty management …
technical systems because of their role in improving uncertainty management …