Authors
Abstract
This report presents findings from cognitive testing commissioned by the Institute for Social and Economic Research (ISER) to evaluate and refine survey measures used or being considered in Understanding Society. The study addresses the methodological challenge of balancing consistency in longitudinal measurement with the need to reflect the increasing diversity and complexity of contemporary UK family structures. Cognitive interviews (n=60), including dyadic interviews with couples and co-parents, were conducted in two rounds to examine how individuals from varied family situations interpret survey questions related to family dynamics. Guided by Tourangeau’s cognitive response framework—focusing on comprehension, recall, judgement, and response—the research assessed the clarity, inclusivity, and sensitivity of new, existing and newly adapted survey items. Participants were purposively sampled to capture a wide range of family types, including separated parents, co-parenting arrangements, same-sex couples, and expectant parents. Data collection involved think-aloud protocols, targeted probing, and systematic analysis of interview transcripts and field notes. Findings highlight areas where question interpretation varies across family contexts, potentially affecting data reliability and validity. The study identifies specific mechanisms underlying these discrepancies and offers recommendations for improving question design while maintaining longitudinal comparability. While the qualitative nature of the research limits generalisability, the insights provide critical guidance for enhancing survey inclusivity and ensuring consistent interpretation across diverse respondent groups.
Paper download