Beyond information retrieval--medical question answering

Abstract

Physicians have many questions when caring for patients, and frequently need to seek answers for their questions. Information retrieval systems (e.g., PubMed) typically return a list of documents in response to a user's query. Frequently the number of returned documents is large and makes physicians' information seeking "practical only 'after hours' and not in the clinical settings". Question answering techniques are based on automatically analyzing thousands of electronic documents to generate short-text answers in response to clinical questions that are posed by physicians. The authors address physicians' information needs and described the design, implementation, and evaluation of the medical question answering system (MedQA). Although our long term goal is to enable MedQA to answer all types of medical questions, currently, we implemented MedQA to integrate information retrieval, extraction, and summarization techniques to automatically generate paragraph-level text for definitional questions (i.e., "What is X?"). MedQA can be accessed at http://www.dbmi.columbia.edu/~yuh9001/research/MedQA.html.

Figure 1

MedQA system components.

Figure 2

MedQA’s output of the question “What is diabetic retinopathy?”. A physician has given this answer the best score (i.e., “5”) for Answerability. The parentheses provide links to the original documents from which the preceding sentences are extracted.

Figure 3

Evaluation Results