Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality

Abstract

Background: The assessment of relationship quality is a key construct in family research and relies on several indicators. As answer behavior for sensitive and subjective questions can be biased by the interview situation, the emerging switch from face-to-face mode to web or mixed mode in surveys challenges the comparability of measurements. Objective: This study investigates the impact of two modes of data collection - face-to-face mode and web mode - on central measurements of relationship quality in quantitative family research. Methods: In a German experimental pilot study (2018) within the Generations and Gender Programme, target persons were randomly assigned to face-to-face or online interviews. Mode differences are assessed by comparing distributions for various indicators of relationship quality. To adjust for confounders, post-stratification weighting and multivariate regression analysis are applied. Results: Findings reveal consistent mode effects for almost all indicators of relationship quality even after adjusting for confounders. Respondents in web mode assess their relationship quality substantially lower than respondents in face-to-face mode, thinking more often about breaking up and reporting lower satisfaction and more conflicts. Conclusions: Web mode seems to support less socially desirable reflections on respondents' relationships compared to face-to-face mode. Family researchers should consider survey design decisions when evaluating intimate relationships, particularly in longitudinal and cross-national studies. Contribution: Findings on the assessment of relationships in family research based on self-administered modes, such as web mode, can be considered more reliable than those based on interviewer-administered modes.