Download full text
(317.5Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-92526-3
Exports for your reference manager
Comparing the Performance of Agree/Disagree and Item-Specific Questions Across PCs and Smartphones
[journal article]
Abstract The use of agree/disagree (A/D) questions is a common technique to measure attitudes. For instance, this question format is employed frequently in the Eurobarometer and International Social Survey Programme (ISSP). Theoretical considerations, however, suggest that A/D questions require a complex pro... view more
The use of agree/disagree (A/D) questions is a common technique to measure attitudes. For instance, this question format is employed frequently in the Eurobarometer and International Social Survey Programme (ISSP). Theoretical considerations, however, suggest that A/D questions require a complex processing. Therefore, many survey researchers have
recommended the use of item-specific (IS) questions, since they seem to be less burdensome. Parallel to this methodological discussion is the discussion around the use of mobile devices for responding to surveys. However, until now, evidence has been lacking as to whether the use of mobile devices for survey response affects the performance of established question
formats. In this study, implemented in the Netquest panel in Spain (N = 1,476), we investigated the cognitive effort and response quality associated with A/D and IS questions across PCs and smartphones. For this purpose, we applied a split-ballot design defined by device type and question format. Our analyses revealed longer response times for IS questions than A/D
questions, irrespective of the device type and scale length. Also, the IS questions produced better response quality than their A/D counterparts. All in all, the findings indicate a more conscientious response to IS questions compared to A/D questions.... view less
Keywords
questionnaire; survey research; response behavior; quantitative method; methodology; online survey
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
agree/disagree questions; asking manner; device type; item-specific questions; paradata; SurveyFocus; web surveys
Document language
English
Publication Year
2018
Page/Pages
p. 109-118
Journal
Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 14 (2018) 3
DOI
https://doi.org/10.1027/1614-2241/a000151
ISSN
1614-1881
Status
Postprint; peer reviewed