A software tool for increased efficiency in observer performance studies in radiology

Abstract

Observer performance studies are time-consuming tasks, both for the participating observers and for the scientists collecting and analysing the data. A possible way to optimise such studies is to perform them in a completely digital environment. A software tool-ViewDEX (Viewer for Digital Evaluation of X-ray images)-has been developed in Java, enabling it to function on almost any computer. ViewDEX is designed to handle several types of studies, such as visual grading analysis (VGA), image criteria scoring (ICS) and receiver operating characteristics (ROC). The results from each observer are saved in a log file, which can be exported for further analysis in, for example, a special software for analysing ROC results. By using ViewDEX for an ROC experiment, an evaluation rate of approximately 200 images per hour can be achieved, compared to approximately 25 images per hour using hard copy evaluation. The results are obtained within minutes of completion of the viewing. The risk of human errors in the process of data collection and analysis is also minimised. The viewer has been used in a major trial containing approximately 2700 images.