Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2005:2005:565-9.

Evaluation of French and English MeSH indexing systems with a parallel corpus

Aurélie Névéol  1 , James G Mork, Alan R Aronson, Stéfan J Darmoni
Affiliations
Comparative Study

Evaluation of French and English MeSH indexing systems with a parallel corpus

Aurélie Névéol et al. AMIA Annu Symp Proc. 2005.

Abstract

Objective: This paper presents the evaluation of two MeSH indexing systems for French and English on a parallel corpus.

Material and methods: We describe two automatic MeSH in-dexing systems - MTI for English, and MAIF for French. The French version of the evaluation resources has been manually indexed with MeSH keyword/qualifier pairs. This professional indexing is used as our gold standard in the evaluation of both systems on keyword retrieval.

Results: The English system (MTI) obtains significantly better precision and recall (78% precision and 21% recall at rank 1, vs. 37%. precision and 6% recall for MAIF ). Moreover, the performance of both systems can be optimised by the break-age function used by the French system (MAIF), which selects an adaptive number of descriptors for each resource indexed.

Conclusion: MTI achieves better performance. However, both systems have features that can benefit each other.

PubMed Disclaimer

Figures

Figure 1
Figure 1
plot of F-Measure vs. fixed ranks for each indexing system.
See this image and copyright information in PMC

References

    1. Darmoni SJ, Leroy JP, Thirion B, Baudic F, Douyère M, Piot J. CISMeF: a structured Health resource guide. Meth Inf Med. 2000;39(1):30–5. - PubMed
    1. Humphrey SM, Miller NE. Knowledge-based indexing of the medical literature: The Indexing Aid Project. J Am Soc Inf Sci. 1987 May;38(3):184–96. - PubMed
    1. Aronson AR. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proc AMIA Symp. 2001:17–21. - PMC - PubMed
    1. Bodenreider O, Nelson SJ, Hole WT, Chang HF. Beyond synonymy: exploiting the UMLS semantics in mapping vocabularies. Proc AMIA Symp. 1998:815–9. - PMC - PubMed
    1. Kim W, Aronson AR, Wilbur WJ. Automatic MeSH term assignment and quality assessment. Proc AMIA Symp. 2001:319–23. - PMC - PubMed

LinkOut - more resources