Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Sep;31(3):214-8.
doi: 10.5152/balkanmedj.2014.13218. Epub 2014 Sep 1.

Evaluation of diagnostic tests using information theory for multi-class diagnostic problems and its application for the detection of occlusal caries lesions

Umut Arslan  1 , Ergun Karaağaoğlu  1 , Gökhan Özkan  2 , Aydan Kanlı  3
Affiliations

Evaluation of diagnostic tests using information theory for multi-class diagnostic problems and its application for the detection of occlusal caries lesions

Umut Arslan et al. Balkan Med J. 2014 Sep.

Abstract

Background: Several methods are available to evaluate the performance of the tests when the purpose of the diagnostic test is to discriminate between two possible disease states. However multi-class diagnostic problems frequently appear in many areas of medical science. Hence, there is a need for methods which will enable us to characterize the accuracy of diagnostic tests when there are more than two possible disease states.

Aims: To show that two information theory measures, information content (IC) and proportional reduction in diagnostic uncertainty (PRDU), can be used for the evaluation of the performance of diagnostic tests for multi-class diagnostic problems that may appear in different areas of medical science.

Study design: Diagnostic accuracy study.

Methods: Sixty freshly extracted permanent human molar and pre-molar teeth suspected to have occlusal caries lesions were selected for the study and were assessed by two experienced examiners. Each examiner performed two evaluations. Histological examination was used as the gold standard. The scores of the histological examination were defined as sound (n=11), enamel caries (n=22) and dentin caries (n=27). Diagnostic performance of i) visual inspection, ii) radiography, iii) laser fluorescence (LF) and iv) micro-computed tomography (M-CT) caries detection methods was evaluated by calculating IC and PRDU.

Results: Micro-computed tomography examination was the best method among the diagnostic techniques for the diagnosis of occlusal caries in terms of both IC and PRDU. M-CT examination supplied the maximum diagnostic information about the diagnosis of occlusal caries in the first (IC: 1.056; p<0.05), (PRDU: 70.5%) and second evaluation (IC: 1.105; p<0.05), (PRDU: 73.8%) for the first examiner. M-CT examination was the best method among the diagnostic techniques for the second examiner in both the first (IC:1.105; p<0.05), (PRDU:73.8%) and second evaluation (IC:1.061; p<0.05), (PRDU:70.8%). IC and PRDU were lowest for visual inspection.

Conclusion: The present study demonstrates that IC and PRDU can be used to evaluate diagnostic test performance when multiple disease states are being evaluated.

Keywords: Diagnostic test; information content; occlusal caries; proportional reduction in diagnostic uncertainty.

PubMed Disclaimer

References

    1. Thomas JA. Elements of information theory. 2nd ed. New York: John Wiley & Sons; 2006.
    1. Asch DA, Patton PJ, Hershey JC. Knowing for the sake of knowing: The value of prognostic information. Med Decis Making. 1990;10:47–57. - PubMed
    1. Klir GJ. Uncertainty and information. New York: John Wiley & Sons; 2006.
    1. Benish WA. Mutual information as an index of diagnostic test performance. Methods Inf Med. 2003;42:260–4. - PubMed
    1. Metz CE, Goodenough DJ, Rossmann K. Evaluation of receiver operating characteristic curve data in terms of information theory with applications in radiography. Radiology. 1973;109:297–303. - PubMed

LinkOut - more resources