Emergency thoracotomy: comparison of medical student, resident, and faculty performances on written, computer, and animal-model assessments

Abstract

Objective: In clinical practice, thoracotomy and other critical emergency procedures are rarely required. Consequently, medical students and residents have difficulty acquiring procedural competency in these critical procedures. The authors developed objective written, computer, and animal-model assessments of thoracotomy procedural competency to permit comparison of the reliability and validity of these three procedural assessment modalities.

Methods: Thoracotomy procedural competency was evaluated for 18 persons at three levels of training (medical student, resident, faculty), using written, computer, and animal-model assessments. A prospective, sequential assessment design was used, with the examinees serving as their own controls. Procedural competency was defined in terms of performance time (animal time scale) and performance accuracy (written accuracy, computer accuracy, and animal accuracy scales) for three thoracotomy procedures (opening the chest, pericardiotomy, and aortic cross-clamping). Level of training was the independent variable, and procedural competency scores were the outcome measures. Confounding variables included previous thoracotomy and computer experience.

Results: Computer and animal-model assessments produced reliable results (Chronbach's alpha > 0.50). The animal time scale and computer accuracy scale best reflected the expected skill differences among levels of physician training, providing support for construct validity. In contrast, written and animal accuracy scale scores did not significantly differ by level of physician training. Moreover, previous thoracotomy experience (i.e., number of procedures previously performed) was not a significant predictor of procedural competency.

Conclusions: This study demonstrates that critical emergency medicine procedures can be evaluated reliably and validly using computer simulation and animal-model assessments. Neither previous thoracotomy experience nor knowledge of procedure content adequately predicts thoracotomy competency.