Development of a novel integrated educational relative-unit value system to assess dental students' clinical performance

Abstract

Purpose: The use of relative unit values (RUVs) to assess students' clinical productivity is common in dental education. However, there are large variations on how RUVs are defined, developed, validated, and reported across institutions. This study described the development of a novel educational RUV system.

Methods: A preparatory phase of literature review and methodological gap analysis, followed by initial conception, pilot testing, and a 2-round modified Delphi process were conducted. Panelists reviewed the procedure list, nomenclature, purpose of development, basis of calculation of RUVs, and the relative weights of different dental procedures. Also, their perception of the usefulness, fairness, and practicality of the system was assessed. Agreement was set at 80%.

Results: Eight published educational RUV systems were identified. These data guided the initial conception of the novel Integrated Educational RUVs (IERUVs). Five experts reviewed the system and it was piloted for a full educational cycle. Feedback from faculty and students was used to adjust over- or under-estimated RUVs, with deconstruction of multi-step procedures. Fifteen experts participated in the second Delphi round (71% response rate). Consensus was reached for 105 procedural RUVs. A total of 93% of the panelists agreed the system was useful, while 71% perceived it as fair and practical.

Conclusion(s): Content validity of the new educational RUV was established. The system provides a promising tool for assessing dental students' clinical performance, as it provides a unified base unit to assess clinical productivity, clinical competence, and comprehensive care cases. Longitudinal evaluations in different contexts are needed to confirm IERUVs validity.

Keywords: assessment; clinical assessment; clinical performance; clinical productivity; comprehensive care; dental education; point system; relative unit values.