Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2012 May 10:13:92.
doi: 10.1186/1471-2105-13-92.

A comparative evaluation of sequence classification programs

Adam L Bazinet  1 , Michael P Cummings
Affiliations
Comparative Study

A comparative evaluation of sequence classification programs

Adam L Bazinet et al. BMC Bioinformatics. .

Abstract

Background: A fundamental problem in modern genomics is to taxonomically or functionally classify DNA sequence fragments derived from environmental sampling (i.e., metagenomics). Several different methods have been proposed for doing this effectively and efficiently, and many have been implemented in software. In addition to varying their basic algorithmic approach to classification, some methods screen sequence reads for 'barcoding genes' like 16S rRNA, or various types of protein-coding genes. Due to the sheer number and complexity of methods, it can be difficult for a researcher to choose one that is well-suited for a particular analysis.

Results: We divided the very large number of programs that have been released in recent years for solving the sequence classification problem into three main categories based on the general algorithm they use to compare a query sequence against a database of sequences. We also evaluated the performance of the leading programs in each category on data sets whose taxonomic and functional composition is known.

Conclusions: We found significant variability in classification accuracy, precision, and resource consumption of sequence classification programs when used to analyze various metagenomics data sets. However, we observe some general trends and patterns that will be useful to researchers who use sequence classification programs.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Program clustering. A neighbor-joining tree that clusters the classification programs based on their similar attributes.
See this image and copyright information in PMC

References

    1. Benson DA, Karsch-Mizrachi I, Clark K, Lipman DJ, Ostell J, Sayers EW. GenBank. Nucleic Acids Res. 2012;40(Database issue):D48–53. - PMC - PubMed
    1. Finn RD, Mistry J, Tate J, Coggill P, Heger A, Pollington JE, Gavin OL, Gunasekaran P, Ceric G, Forslund K, Holm L, Sonnhammer ELL, Eddy SR, Bateman A. The Pfam protein families database. Nucleic Acids Res. 2010;38(suppl 1):D211–D222. - PMC - PubMed
    1. Kislyuk A, Bhatnagar S, Dushoff J, Weitz JS. Unsupervised statistical clustering of environmental shotgun sequences. BMC Bioinf. 2009;10:316. doi: 10.1186/1471-2105-10-316. - DOI - PMC - PubMed
    1. Chatterji S, Yamazaki I, Bai Z, Eisen J. Proceedings of the 12th annual international conference on Research in computational molecular biology, RECOMB’08. Springer-Verlag, Berlin, Heidelberg; 2008. CompostBin: A DNA composition-based algorithm for binning environmental shotgun reads; pp. 17–28.
    1. Kelley D, Salzberg S. Clustering metagenomic sequences with interpolated Markov models. BMC Bioinf. 2010;11:544. doi: 10.1186/1471-2105-11-544. - DOI - PMC - PubMed

Publication types