Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 1998:855-9.

An evaluation of natural language processing methodologies

Affiliations
Comparative Study

An evaluation of natural language processing methodologies

C Friedman et al. Proc AMIA Symp. 1998.

Abstract

Medical language processing (MLP) systems that codify information in textual patient reports have been developed to help solve the data entry problem. Some systems have been evaluated in order to assess performance, but there has been little evaluation of the underlying technology. Various methodologies are used by the different MLP systems but a comparison of the methods has not been performed although evaluations of MLP methodologies would be extremely beneficial to the field. This paper describes a study that evaluates different techniques. To accomplish this task an existing MLP system MedLEE was modified and results from a previous study were used. Based on confidence intervals and differences in sensitivity and specificity between each technique and all the others combined, the results showed that the two methods based on obtaining the largest well-formed segment within a sentence had significantly higher sensitivity than the others by 5% and 6%. The method based on recognizing a complete sentence had a significantly worse sensitivity than the others by 7% and a better specificity by .2%. None of the methods had significantly worse specificity.

PubMed Disclaimer

References

    1. Methods Inf Med. 1992 Jun;31(2):117-25 - PubMed
    1. Med Decis Making. 1991 Oct-Dec;11(4 Suppl):S65-8 - PubMed
    1. Radiology. 1990 Feb;174(2):543-8 - PubMed
    1. Ann Intern Med. 1995 May 1;122(9):681-8 - PubMed
    1. J Am Med Inform Assoc. 1994 Mar-Apr;1(2):142-60 - PubMed

Publication types

MeSH terms

LinkOut - more resources