Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments

KA Thomas, S Clifford - Computers in Human Behavior, 2017 - Elsevier
Social science researchers increasingly recruit participants through Amazon's Mechanical
Turk (MTurk) platform. Yet, the physical isolation of MTurk participants, and perceived lack of …

[HTML][HTML] Human evaluation of automatically generated text: Current trends and best practice guidelines

C van der Lee, A Gatt, E van Miltenburg… - Computer Speech & …, 2021 - Elsevier
Currently, there is little agreement as to how Natural Language Generation (NLG) systems
should be evaluated, with a particularly high degree of variation in the way that human …

Common concerns with MTurk as a participant pool: Evidence and solutions

D Hauser, G Paolacci, J Chandler - Handbook of research …, 2019 - taylorfrancis.com
This chapter discusses common concerns that researchers have with Mechanical Turk
(MTurk), reviewing the evidence that bears upon each concern. It suggests that readers are …

Taking fact-checks literally but not seriously? The effects of journalistic fact-checking on factual beliefs and candidate favorability

B Nyhan, E Porter, J Reifler, TJ Wood - Political behavior, 2020 - Springer
Are citizens willing to accept journalistic fact-checks of misleading claims from candidates
they support and to update their attitudes about those candidates? Previous studies have …

No harm in checking: Using factual manipulation checks to assess attentiveness in experiments

JV Kane, J Barabas - American Journal of Political Science, 2019 - Wiley Online Library
Manipulation checks are often advisable in experimental studies, yet they rarely appear in
practice. This lack of usage may stem from fears of distorting treatment effects and …

Separating the shirkers from the workers? Making sure respondents pay attention on self‐administered surveys

AJ Berinsky, MF Margolis… - American journal of …, 2014 - Wiley Online Library
Good survey and experimental research requires subjects to pay attention to questions and
treatments, but many subjects do not. In this article, we discuss “Screeners” as a potential …

[HTML][HTML] The quality of data collected online: An investigation of careless responding in a crowdsourced sample

F Brühlmann, S Petralito, LF Aeschbach, K Opwis - Methods in Psychology, 2020 - Elsevier
Despite recent concerns about data quality, various academic fields rely increasingly on
crowdsourced samples. Thus, the goal of this study was to systematically assess …

Boomerangs versus javelins: How polarization constrains communication on climate change

J Zhou - Environmental politics, 2016 - Taylor & Francis
Political communicators work under the assumption that information provision, such as
framing, may influence audiences and elicit some desired attitudinal or behavioral shift …

A little shot of humility: Intellectual humility predicts vaccination attitudes and intention to vaccinate against COVID‐19

HP Huynh, AR Senger - Journal of Applied Social Psychology, 2021 - Wiley Online Library
Vaccinations remain a critical, albeit surprisingly controversial, health behavior, especially
with the promise of widely available COVID‐19 vaccine. Intellectual humility, a virtue …

The psychology of coordination and common knowledge.

KA Thomas, P DeScioli, OS Haque… - Journal of personality …, 2014 - psycnet.apa.org
Research on human cooperation has concentrated on the puzzle of altruism, in which 1
actor incurs a cost to benefit another, and the psychology of reciprocity, which evolved to …