Amazon Mechanical Turk (MTurk) is becoming a prevalent source of quick and cost effective
data for organizational research, but there are questions about the appropriateness of the …

Crowdsourcing enables one to leverage on the intelligence and wisdom of potentially large
groups of individuals toward solving problems. Common problems approached with …

Despite the seemingly low switching and search costs of on-demand labor markets like
Amazon Mechanical Turk, we find substantial monopsony power, as measured by the …

Mechanical Turk (MTurk), an online labor market created by Amazon, has recently become
popular among social scientists as a source of survey and experimental data. The workers …

As online data collection services such as Amazon's Mechanical Turk (MTurk) gain
popularity, the quality and representativeness of such data sources have gained research …

Paid crowd work offers remarkable opportunities for improving productivity, social mobility,
and the global economy by engaging a geographically distributed workforce to complete …

Crowdsourcing provides a scalable and efficient way to construct labeled datasets for
training machine learning systems. However, creating comprehensive label guidelines for …

Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …

Identifying ecological patterns across broad spatial and temporal extents requires novel
approaches and methods for acquiring, integrating and modeling massive quantities of …

This survey provides a comprehensive overview of the landscape of crowdsourcing
research, targeted at the machine learning community. We begin with an overview of the …