Download full text
(external source)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.12758/mda.2016.008
Exports for your reference manager
Prior exposure to instructional manipulation checks does not attenuate survey context effects driven by satisficing or Gricean norms
[journal article]
Abstract "Instructional manipulation checks (IMCs) are frequently included in unsupervised online surveys and experiments to assess whether participants pay close attention to the questions. However, IMCs are more than mere measures of attention - they also change how participants approach subsequent tasks, ... view more
"Instructional manipulation checks (IMCs) are frequently included in unsupervised online surveys and experiments to assess whether participants pay close attention to the questions. However, IMCs are more than mere measures of attention - they also change how participants approach subsequent tasks, increasing attention and systematic reasoning. We test whether these previously documented changes in information processing moderate the emergence of response effects in surveys by presenting an IMC either before or after questions known to produce classic survey context effects. When the items precede an IMC,
familiar satisficing as well as conversational effects replicate. More important, their pattern
and size does not change when the items follow an IMC, in contrast to experiments with reasoning tasks. Given a power of 82% to 98% to detect an effect of d=.3, we conclude that prior exposure to an IMC is unlikely to increase or attenuate these types of context effects in surveys." (author's abstract)... view less
Keywords
survey research; data collection method; online survey; data capture; data quality; response behavior
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Method
basic research; development of methods
Free Keywords
instructional manipulation checks; survey context effects; satisficing; Gricean conversational norms
Document language
English
Publication Year
2016
Page/Pages
p. 195-220
Journal
Methods, data, analyses : a journal for quantitative methods and survey methodology (mda), 10 (2016) 2
ISSN
2190-4936
Status
Published Version; peer reviewed
Licence
Creative Commons - Attribution