What kind of expert should a system be?

Abstract

Human experts are the source of knowledge required to develop computer systems that perform at an expert level. Human beings are not, however, able to reliably express what they know. As a result, experts often develop non-authentic accounts of their own expertise. These accounts, here termed reconstructed methods of reasoning, lead to computer systems that perform at a high level of proficiency but have the disadvantage that they often do not reflect the heuristics and processing constraints of a system user. Reconstructed methods of reasoning are compared with authentic methods derived from the study of expert human behavior. Tests are proposed to establish the authenticity of reasoning methods and examples from medical diagnosis are used to illustrate how authentic methods of reasoning can be incorporated into an expert computer system.