A survey on task assignment in crowdsourcing
Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …
both for research and industry applications. A popular and broadly applicable method is task …
Demographic stability on Mechanical Turk despite COVID-19
Behavioral scientists often think in abstract terms about the people who participate in
research. University students form a 'subject pool'. People recruited outside the university …
research. University students form a 'subject pool'. People recruited outside the university …
StereoSet: Measuring stereotypical bias in pretrained language models
A stereotype is an over-generalized belief about a particular group of people, eg, Asians are
good at math or Asians are bad drivers. Such beliefs (biases) are known to hurt target …
good at math or Asians are bad drivers. Such beliefs (biases) are known to hurt target …
When to make exceptions: Exploring language models as accounts of human moral judgment
AI systems are becoming increasingly intertwined with human life. In order to effectively
collaborate with humans and ensure safety, AI systems need to be able to understand …
collaborate with humans and ensure safety, AI systems need to be able to understand …
Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
Abstract Amazon Mechanical Turk (MTurk) is widely used by behavioral scientists to recruit
research participants. MTurk offers advantages over traditional student subject pools, but it …
research participants. MTurk offers advantages over traditional student subject pools, but it …
[图书][B] Ghost work: How to stop Silicon Valley from building a new global underclass
ML Gray, S Suri - 2019 - books.google.com
In the spirit ofNickel and Dimed, a necessary and revelatory expose of the invisible human
workforce that powers the web--and that foreshadows the true future of work. Hidden …
workforce that powers the web--and that foreshadows the true future of work. Hidden …
Risk of COVID-19-related bullying, harassment and stigma among healthcare workers: an analytical cross-sectional global study
Objectives Essential healthcare workers (HCW) uniquely serve as both COVID-19 healers
and, potentially, as carriers of SARS-CoV-2. We assessed COVID-19-related stigma and …
and, potentially, as carriers of SARS-CoV-2. We assessed COVID-19-related stigma and …
Towards fairer datasets: Filtering and balancing the distribution of the people subtree in the imagenet hierarchy
Computer vision technology is being used by many but remains representative of only a few.
People have reported misbehavior of computer vision models, including offensive prediction …
People have reported misbehavior of computer vision models, including offensive prediction …
Making replication mainstream
Many philosophers of science and methodologists have argued that the ability to repeat
studies and obtain similar results is an essential component of science. A finding is elevated …
studies and obtain similar results is an essential component of science. A finding is elevated …
NLPositionality: Characterizing design biases of datasets and models
Design biases in NLP systems, such as performance differences for different populations,
often stem from their creator's positionality, ie, views and lived experiences shaped by …
often stem from their creator's positionality, ie, views and lived experiences shaped by …