Content validity evidence for a simulation-based test of handheld otoscopy skills
- PMID: 32909062
- DOI: 10.1007/s00405-020-06336-6
Content validity evidence for a simulation-based test of handheld otoscopy skills
Abstract
Purpose: At graduation from medical school, competency in otoscopy is often insufficient. Simulation-based training can be used to improve technical skills, but the suitability of the training model and assessment must be supported by validity evidence. The purpose of this study was to collect content validity evidence for a simulation-based test of handheld otoscopy skills.
Methods: First, a three-round Delphi study was conducted with a panel of nine clinical teachers in otorhinolaryngology (ORL) to determine the content requirements in our educational context. Next, the authenticity of relevant cases in a commercially available technology-enhanced simulator (Earsi, VR Magic, Germany) was evaluated by specialists in ORL. Finally, an integrated course was developed for the simulator based on these results.
Results: The Delphi study resulted in nine essential diagnoses of normal variations and pathologies that all junior doctors should be able to diagnose with a handheld otoscope. Twelve out of 15 tested simulator cases were correctly recognized by at least one ORL specialist. Fifteen cases from the simulator case library matched the essential diagnoses determined by the Delphi study and were integrated into the course.
Conclusion: Content validity evidence for a simulation-based test of handheld otoscopy skills was collected. This informed a simulation-based course that can be used for undergraduate training. The course needs to be further investigated in relation to other aspects of validity and for future self-directed training.
Keywords: Evidence-based medical education; Handheld otoscopy; Otology; Simulation-based training; Technical skills training.
Similar articles
-
Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy.Ann Otol Rhinol Laryngol. 2020 Jul;129(7):715-721. doi: 10.1177/0003489420904734. Epub 2020 Feb 22. Ann Otol Rhinol Laryngol. 2020. PMID: 32090596
-
Gathering Validity Evidence for a Simulation-Based Test of Otoscopy Skills.Ann Otol Rhinol Laryngol. 2025 Feb;134(2):70-78. doi: 10.1177/00034894241288434. Epub 2024 Oct 17. Ann Otol Rhinol Laryngol. 2025. PMID: 39417404
-
Face and content validity of a novel, web-based otoscopy simulator for medical education.J Otolaryngol Head Neck Surg. 2015 Feb 24;44(1):7. doi: 10.1186/s40463-015-0060-z. J Otolaryngol Head Neck Surg. 2015. PMID: 25889997 Free PMC article.
-
Current Status of Handheld Otoscopy Training: A Systematic Review.Ann Otol Rhinol Laryngol. 2021 Oct;130(10):1190-1197. doi: 10.1177/0003489421997289. Epub 2021 Feb 25. Ann Otol Rhinol Laryngol. 2021. PMID: 33629599
-
Virtual reality simulation training of mastoidectomy - studies on novice performance.Dan Med J. 2016 Aug;63(8):B5277. Dan Med J. 2016. PMID: 27477803 Review.
Cited by
-
Critical aspects in developing curriculum-based assessment for emerging surgical procedures.Int J Med Educ. 2021 Dec 23;12:264-266. doi: 10.5116/ijme.61ba.07c6. Int J Med Educ. 2021. PMID: 34942600 Free PMC article. No abstract available.
-
Face, Content, and Construct Validity of a Virtual Reality Otoscopy Simulator and Applicability to Medical Training.Otolaryngol Head Neck Surg. 2022 Apr;166(4):753-759. doi: 10.1177/01945998211032897. Epub 2021 Jul 27. Otolaryngol Head Neck Surg. 2022. PMID: 34313515 Free PMC article. Clinical Trial.
-
Undergraduate audiology students' perceived competence and confidence in conducting otoscopic examination following video otoscopic training.BMC Med Educ. 2021 Sep 27;21(1):510. doi: 10.1186/s12909-021-02924-0. BMC Med Educ. 2021. PMID: 34579717 Free PMC article.
-
Smartphone-Enabled versus Conventional Otoscopy in Detecting Middle Ear Disease: A Meta-Analysis.Diagnostics (Basel). 2022 Apr 13;12(4):972. doi: 10.3390/diagnostics12040972. Diagnostics (Basel). 2022. PMID: 35454020 Free PMC article.
References
-
- Jones WS (2006) Video otoscopy: bringing otoscopy out of the “black box”. Int J Pediatr Otorhinolaryngol 70:1875–1883. https://doi.org/10.1016/j.ijporl.2006.06.014 - DOI - PubMed
-
- Ringsted CV, Pallisgaard J, Falck G (2002) Physicians’ clinical skills after finishing internship. Ugeskr Læg 164:3211–3215 - PubMed
-
- Oyewumi M, Brandt MG, Carrillo B et al (2016) Objective evaluation of otoscopy skills among family and community medicine, pediatric, and otolaryngology residents. J Surg Educ 73:129–135. https://doi.org/10.1016/j.jsurg.2015.07.011 - DOI - PubMed
-
- Morris E, Kesser BW, Peirce-Cottler S, Keeley M (2012) Development and validation of a novel ear simulator to teach pneumatic otoscopy. Simul Healthc 7:22–26. https://doi.org/10.1097/SIH.0b013e31822eac39 - DOI - PubMed
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources