Surgical decision making. The reliability of clinical judgment

Abstract

Elective surgery second opinion programs are predicted on strict acceptance of the accuracy of the consultant's surgical judgment. The reliability and reproducibility of clinical judgment, therefore, become basic to the effectiveness of such programs. This aspect, however, has received little attention. We report a randomized and controlled survey of surgical specialists which defines agreement/disagreement patterns in surgical decision-making for seven elective surgical procedures. For each disease process, four case histories, including at least one control, were developed by specialty panels of physicians. The case summaries described fictional patients who were seeking professional consultation. The histories were mailed to a random sample of Board-certified specialists from the State of Maryland and the District of Columbia. The response rate was approximately 80% for all five specialties. The respondents were asked to indicate whether they would (Yes) or would not (No) perform the surgical procedure in question. Factual knowledge was not sought, but instead the application of that knowledge and experience to decide on the need for surgical intervention. By comparing the responses for each case history, the agreement/disagreement patterns of inter-observer surgical judgment were determined. Analysis of the data revealed a marked divergence of opinion concerning the need for surgery. The significant point of this study is that surgical judgment differs to a major degree from one surgeon to the next. In a second-opinion program the number of consultants needed to provide a reliable clinical decision probably exceeds the number who are logistically available and that the patient would be willing to visit. Surgical decision-making is a semi-exact scientific process, and it is unreasonable to expect exact answers to clinical problems.