Structured viva validity, reliability, and acceptability as an assessment tool in health professions education: a systematic review and meta-analysis
- PMID: 37491301
- PMCID: PMC10369684
- DOI: 10.1186/s12909-023-04524-6
Structured viva validity, reliability, and acceptability as an assessment tool in health professions education: a systematic review and meta-analysis
Abstract
Background: The viva, or traditional oral examination, is a process where the examiners ask questions and the candidate answers them. While traditional viva has many disadvantages, including subjectivity, low validity, and low reliability, it is advantageous for assessing knowledge, clinical reasoning, and self-confidence, which cannot be assessed by written tests. In order to overcome these disadvantages, structured viva was invented and is claimed to be highly valid, reliable, and acceptable, but this was not confirmed by an overall systematic review or meta-analysis of the studies. The research aims to investigate the studies to reach an overall decision regarding the quality of structured viva as an assessment tool according to the agreed standards in medical education in terms of validity, reliability, and acceptability.
Methods: This systematic review was done following the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines. PubMed, Best Evidence Medical Education (BEME) website reviews, Google Scholars, and ScienceDirect databases were searched for any article addressing the research questions from inception to December 2022. Data analysis was done by the OpenMeta Analyst open-source app, version Windows 10.
Results: A total of 1385 studies were identified. Of them, 24 were included in the review. Three of the reviewed studies showed higher validity of structured viva by a positive linear correlation coefficient compared with MCQs, MCQs and Objective Structured Clinical Examination (OSCE), and structured theory exam. In the reviewed studies, the reliability of structured viva was high by Cronbach alpha α = 0.80 and α = 0.75 in two different settings, while it was low α = 0.50 for the traditional viva. In the meta-analysis, structured viva was found to be acceptable by overall acceptability of (79.8%, P < 0.001) out of all learners who participated in structured viva as examinees at different levels in health professions education using the available numeric data of 12 studies. The heterogeneity of the data was high (I^2 = 93.506, P < 0.001) thus the analysis was done using the binary random-effects model.
Conclusion: Structured viva or structured oral examination has high levels of validity, reliability, and acceptability as an assessment tool in health professions education compared to traditional viva.
Keywords: Acceptability; Health professions education; Reliability; Structured viva; Validity.
© 2023. The Author(s).
Conflict of interest statement
The authors declare that they have no competing interests.
Figures
Similar articles
-
Enhancing medical assessment strategies: a comparative study between structured, traditional and hybrid viva-voce assessment.BMC Med Educ. 2025 Jun 4;25(1):835. doi: 10.1186/s12909-025-07428-9. BMC Med Educ. 2025. PMID: 40468283 Free PMC article.
-
A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems.PLoS One. 2021 Aug 3;16(8):e0255696. doi: 10.1371/journal.pone.0255696. eCollection 2021. PLoS One. 2021. PMID: 34343213 Free PMC article.
-
The utility of mini-Clinical Evaluation Exercise in undergraduate and postgraduate medical education: A BEME review: BEME Guide No. 59.Med Teach. 2020 Feb;42(2):125-142. doi: 10.1080/0142159X.2019.1652732. Epub 2019 Sep 15. Med Teach. 2020. PMID: 31524016
-
Use of Video-Projected Structured Clinical Examination (ViPSCE) instead of the traditional oral (Viva) examination in the assessment of final year medical students.Educ Health (Abingdon). 2004 Mar;17(1):17-26. doi: 10.1080/13576280310001656123. Educ Health (Abingdon). 2004. PMID: 15203470
-
Evaluation of Reliability in Structured Viva Voce As a Formative Assessment of Dental Students.J Dent Educ. 2017 May;81(5):590-596. doi: 10.21815/JDE.016.017. J Dent Educ. 2017. PMID: 28461636
Cited by
-
Enhancing medical assessment strategies: a comparative study between structured, traditional and hybrid viva-voce assessment.BMC Med Educ. 2025 Jun 4;25(1):835. doi: 10.1186/s12909-025-07428-9. BMC Med Educ. 2025. PMID: 40468283 Free PMC article.
-
Impact of station number and duration time per station on the reliability of Objective Structured Clinical Examination (OSCE) scores: a systematic review and meta-analysis.BMC Med Educ. 2025 Jan 17;25(1):84. doi: 10.1186/s12909-025-06691-0. BMC Med Educ. 2025. PMID: 39825303 Free PMC article.
-
Prevalence of Dunning-Kruger effect in first semester medical students: a correlational study of self-assessment and actual academic performance.BMC Med Educ. 2024 Oct 24;24(1):1210. doi: 10.1186/s12909-024-06121-7. BMC Med Educ. 2024. PMID: 39449011 Free PMC article.
References
-
- Madhukumar, Suwarna MB, Pavithra NS, Amrita Conventional viva and structured viva—comparison and perception of students. Indian J Public Health Res Dev. 2022;13(2):167–72.
-
- Davis MH, KarunathilakeIJMt. The place of the oral examination in today’s assessment systems. 2005;27(4):294–7. - PubMed
-
- Oakley B, Hencken C. Oral examination assessment practices:effectiveness and change with a first year undergraduate cohort. J Hosp Leis Sport Tour Educ. 2005;4:3–14.
-
- Tutton PJM, Glasgow EF. Reliability and predictive capacity of examinations in anatomy and improvement in the reliability of viva voce (oral) examinations by the use of a structured rating system. Clin Anatomy: Official J Am Association Clin Anatomists Br Association Clin Anatomists. 1989;21:29–34. doi: 10.1002/ca.980020105. - DOI
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources