Download full text
(221.5Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-85346-2
Exports for your reference manager
Using Instructed Response Items as Attention Checks in Web Surveys: Properties and Implementation
[journal article]
Abstract Identifying inattentive respondents in self-administered surveys is a challenging goal for survey researchers. Instructed response items (IRIs) provide a measure for inattentiveness in grid questions that is easy to implement. The present article adds to the sparse research on the use and implementa... view more
Identifying inattentive respondents in self-administered surveys is a challenging goal for survey researchers. Instructed response items (IRIs) provide a measure for inattentiveness in grid questions that is easy to implement. The present article adds to the sparse research on the use and implementation of attention checks by addressing three research objectives. In a first study, we provide evidence that IRIs identify respondents who show an elevated use of straightlining, speeding, item nonresponse, inconsistent answers, and implausible statements throughout a survey. Excluding inattentive respondents, however, did not alter the results of substantive analyses. Our second study suggests that respondents' inattentiveness partially changes as the context in which they complete the survey changes. In a third study, we present experimental evidence that a mere exposure to an IRI does not negatively or positively affect response behavior within a survey. A critical discussion on using IRI attention checks concludes this article.... view less
Keywords
survey research; online survey; data capture; data quality; attention; control; response behavior
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
attention checks; grid questions; instructed response items; measurement error; web surveys
Document language
English
Publication Year
2021
Page/Pages
p. 238-264
Journal
Sociological Methods & Research, 50 (2021) 1
DOI
https://doi.org/10.1177/0049124118769083
ISSN
1552-8294
Status
Published Version; peer reviewed
Licence
Deposit Licence - No Redistribution, No Modifications