Using screeners to measure respondent attention on self-administered surveys: Which items and how many?

AJ Berinsky, MF Margolis, MW Sances… - … Science Research and …, 2021 - cambridge.org
Political Science Research and Methods, 2021cambridge.org
Inattentive respondents introduce noise into data sets, weakening correlations between
items and increasing the likelihood of null findings.“Screeners” have been proposed as a
way to identify inattentive respondents, but questions remain regarding their implementation.
First, what is the optimal number of Screeners for identifying inattentive respondents?
Second, what types of Screener questions best capture inattention? In this paper, we
address both of these questions. Using item-response theory to aggregate individual …
Inattentive respondents introduce noise into data sets, weakening correlations between items and increasing the likelihood of null findings. “Screeners” have been proposed as a way to identify inattentive respondents, but questions remain regarding their implementation. First, what is the optimal number of Screeners for identifying inattentive respondents? Second, what types of Screener questions best capture inattention? In this paper, we address both of these questions. Using item-response theory to aggregate individual Screeners we find that four Screeners are sufficient to identify inattentive respondents. Moreover, two grid and two multiple choice questions work well. Our findings have relevance for applied survey research in political science and other disciplines. Most importantly, our recommendations enable the standardization of Screeners on future surveys.
Cambridge University Press
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References