Effective questionnaire design: How to use cognitive interviews to refine questionnaire items
- PMID: 35034911
- PMCID: PMC9524256
- DOI: 10.3233/NPM-210848
Effective questionnaire design: How to use cognitive interviews to refine questionnaire items
Abstract
Background: Cognitive interviewing is a technique that can be used to improve and refine questionnaire items. We describe the basic methodology of cognitive interviewing and illustrate its utility through our experience using cognitive interviews to refine a questionnaire assessing parental understanding of concepts related to preterm birth.
Methods: Cognitive interviews were conducted using current best practices. Results were analyzed by the multidisciplinary research team and questionnaire items that were revealed to be problematic were revised.
Results: Revisions to the questionnaire items were made to improve clarity and to elicit responses that truly reflected the participants understanding of the concept.
Conclusion: Cognitive interviewing is a useful methodology for improving validity of questionnaire items, we recommend researchers developing new questionnaire items design and complete cognitive interviews to improve their items and increase confidence in study conclusions.
Keywords: Cognitive interviews; prematurity; preterm birth; questionnaires; survey validity; surveys.
Conflict of interest statement
Conflict of interest disclosures: The authors have no conflicts of interests to disclose.
Similar articles
-
Cognitive interviewing: verbal data in the design and pretesting of questionnaires.J Adv Nurs. 2003 Apr;42(1):57-63. doi: 10.1046/j.1365-2648.2003.02579.x. J Adv Nurs. 2003. PMID: 12641812 Review.
-
Parental understanding of crucial medical jargon used in prenatal prematurity counseling.BMC Med Inform Decis Mak. 2020 Jul 22;20(1):169. doi: 10.1186/s12911-020-01188-w. BMC Med Inform Decis Mak. 2020. PMID: 32698793 Free PMC article.
-
Cognitive interviews to test and refine questionnaires.Public Health Nurs. 2011 Sep-Oct;28(5):444-50. doi: 10.1111/j.1525-1446.2010.00938.x. Epub 2011 Mar 21. Public Health Nurs. 2011. PMID: 22092429
-
Employing cognitive interviewing to evaluate, improve and validate items for measuring the health-related quality of life of women diagnosed with ovarian cancer.BMC Womens Health. 2022 Sep 27;22(1):391. doi: 10.1186/s12905-022-01966-w. BMC Womens Health. 2022. PMID: 36163023 Free PMC article.
-
[Psychometric characteristics of questionnaires designed to assess the knowledge, perceptions and practices of health care professionals with regards to alcoholic patients].Encephale. 2004 Sep-Oct;30(5):437-46. doi: 10.1016/s0013-7006(04)95458-9. Encephale. 2004. PMID: 15627048 Review. French.
Cited by
-
Use of Cognitive Interviews in the Development of a Survey Assessing American Indian and Alaska Native Adult Perspectives on Genetics and Biological Specimens.Int J Environ Res Public Health. 2024 Aug 29;21(9):1144. doi: 10.3390/ijerph21091144. Int J Environ Res Public Health. 2024. PMID: 39338028 Free PMC article.
-
Cognitive interviewing for assessing the content validity of older-person specific outcome measures for quality assessment and economic evaluation: a scoping review.Qual Life Res. 2025 Mar;34(3):605-619. doi: 10.1007/s11136-024-03849-z. Epub 2024 Dec 3. Qual Life Res. 2025. PMID: 39625627
-
A Protocol for the Development and Validation of the Postpartum Specific Anxiety Scale-Preterm Birth [PSAS-PTB] and the Postpartum Specific Anxiety Scale-Neonatal Intensive Care Unit [PSAS-NICU].Int J Methods Psychiatr Res. 2025 Sep;34(3):e70032. doi: 10.1002/mpr.70032. Int J Methods Psychiatr Res. 2025. PMID: 40782330 Free PMC article.
-
Ranking Future Outcomes Most Important to Parents of Children with Bronchopulmonary Dysplasia.J Pediatr. 2023 Aug;259:113455. doi: 10.1016/j.jpeds.2023.113455. Epub 2023 May 10. J Pediatr. 2023. PMID: 37172804 Free PMC article. Review.
-
Psychometric Evaluation of Bengali, Hindi, and Kannada Versions of the Yale-Brown Obsessive Compulsive Scale.Indian J Psychol Med. 2025 May 3:02537176251335095. doi: 10.1177/02537176251335095. Online ahead of print. Indian J Psychol Med. 2025. PMID: 40330276 Free PMC article.
References
-
- Willis GB. Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications; 2005.
-
- Kamp K, Wyatt G, Dudley-Brown S, Brittain K, Given B. Using cognitive interviewing to improve questionnaires: An exemplar study focusing on individual and condition-specific factors. Appl Nurs Res. 2018;43:121–125. - PubMed
-
- Silva JR, Fera B, Sudula S, Koetzle D, Schwalbe C. Cognitive interviewing to improve questionnaires for justice-involved youth. Int J Offender Ther Comp Criminol. 2019;63(10):1931–1951. - PubMed
-
- Bakker‐van Gijssel EJ, Lucassen PL, olde Hartman TC, Assendelft WJ, van Schrojenstein Lantman‐de Valk HM. Constructing a health assessment questionnaire for people with intellectual disabilities: A cognitive interview study. J Appl Res Intellect Disabil. 2020;33(3):345–353. - PubMed
-
- Dillman DA, Smyth JD, Christian LM. Internet, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: John Wiley; 2014.
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources