Studies without internal controls

Abstract

Sometimes questions of clinical interest can be addressed only by investigations without concurrent controls that are under the supervision of the investigator (internal controls). Such studies nearly always make use of other types of comparisons (external controls), such as historical controls. In this paper we examine studies of clinical treatments that have weak internal controls or lack internal controls, as illustrated by recent examples from the Journal. These studies have a small but important and unique role in clinical investigation. Five interrelated features can add to the strength of such studies: (1) an intent by the investigator, expressed before the study, that the treatment will affect the outcomes reported; (2) planning of the analysis before the data are generated; (3) articulation of a plausible hypothesis before the results are observed; (4) a likelihood that the results would still have been of interest if they had been "opposite" in some sense; and (5) reasonable grounds for generalizing the results from the study subjects to a substantially broader group of patients. In spite of potential pitfalls, carefully selected and reported studies without internal controls can play a substantial part in the acquisition of scientific knowledge.