Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2012 Oct 10:3:97-104.
doi: 10.2147/AMEP.S31720. Print 2012.

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia

Abdullah Alkhayal  1 , Shahla Aldhukair, Nahar Alselaim, Salah Aldekhayel, Sultan Alhabdan, Waleed Altaweel, Mohi Elden Magzoub, Mohammed Zamakhshary
Affiliations

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia

Abdullah Alkhayal et al. Adv Med Educ Pract. .

Abstract

Background: After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills.

Methods: This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated.

Results: Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65).

Conclusion: The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

Keywords: objective assessment; program directors; surgical residency; surgical skills.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Distribution of respondents by specialty. Abbreviations: GS, general surgery; OBGY, obstetrics and gynecology; ORL, otorhinolaryngology; OMF, oral maxillofacial surgery.
Figure 2
Figure 2
Distribution of evaluation technique by specialty. Abbreviations: GS, general surgery; OBGY, obstetrics and gynecology; ORL, otorhinolaryngology; OMF, oral maxillofacial surgery.
Figure 3
Figure 3
Program directors’ satisfaction regarding technical skills assessment.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. CanMEDs Framework [webpage on the Internet] Ottawa: Royal College of Physicians and Surgeons of Canada; c2012 [cited 2012 Jun 3]. Available from: http://www.royalcollege.ca/portal/page/portal/rc/canmeds/frameworkAccessed February 22, 2010
    1. Toolbox of Assessment Methods [webpage on the Internet] Chicago: Accreditation Council for Graduate Medical Education; c2000–2012 [cited 2012 Jun 3]. Available from: http://www.acgme.org/acgmeweb/Accessed March 15, 2010
    1. Reznick RK. Teaching and testing technical skills. Am J Surg. 1993;165(3):358–361. - PubMed
    1. Shumway JM, Harden RM, Association for Medical Education in Europe AMEE Guide No. 25:The assessment of learning outcomes for the competent and reflective physician. Med Teach. 2003;25(6):569–584. - PubMed
    1. Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ. 2003;327(7422):1032–1037. - PMC - PubMed