Download full text
(522.6Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-92684-7
Exports for your reference manager
Re-Examining the Middle Means Typical and the Left and Top Means First Heuristics Using Eye-Tracking Methodology
[journal article]
Abstract Web surveys are a common self-administered mode of data collection using written language to convey information. This language is usually accompanied by visual design elements, such as numbers, symbols, and graphics. As shown by previous research, such elements of survey questions can affect respons... view more
Web surveys are a common self-administered mode of data collection using written language to convey information. This language is usually accompanied by visual design elements, such as numbers, symbols, and graphics. As shown by previous research, such elements of survey questions can affect response behavior because respondents sometimes use interpretive heuristics, such as the "middle means typical" and the "left and top means first" heuristics when answering survey questions. In this study, we adopted the designs and survey questions of two experiments reported in Tourangeau, Couper, and Conrad (2004). One experiment varied the position of nonsubstantive response options in relation to other substantive response options and the second experiment varied the order of the response options. We implemented both experiments in an eye-tracking study. By recording respondents’ eye movements, we are able to observe how they read question stems and response options and we are able to draw conclusions about the survey response process the questions initiate. This enables us to investigate the mechanisms underlying the two interpretive heuristics and to test the assumptions of Tourangeau et al. (2004) about the ways in which interpretive heuristics influence survey responding. The eye-tracking data reveal mixed results for the two interpretive heuristics. For the middle means typical heuristic, it remains somewhat unclear whether respondents seize on the conceptual or visual midpoint of a response scale when answering survey questions. For the left and top means first heuristic, we found that violations of the heuristic increase response effort in terms of eye fixations. These results are discussed in the context of the findings of the original studies.... view less
Keywords
heuristics; laboratory experiment; response behavior; interpretation; methodology; online survey; survey research; experiment; quantitative method
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
Eye-Tracking; Web Survey; Fragenentwicklung
Document language
English
Publication Year
2021
Page/Pages
p. 25-50
Journal
Journal of Survey Statistics and Methodology, 9 (2021) 1
DOI
https://doi.org/10.1093/jssam/smz028
ISSN
2325-0984
Status
Postprint; peer reviewed
Licence
Deposit Licence - No Redistribution, No Modifications