Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2018 Dec 12;10(471):eaao5333.
doi: 10.1126/scitranslmed.aao5333.

Big data and black-box medical algorithms

W Nicholson Price  1   2   3
Affiliations
Review

Big data and black-box medical algorithms

W Nicholson Price. Sci Transl Med. .

Abstract

New machine-learning techniques entering medicine present challenges in validation, regulation, and integration into practice.

PubMed Disclaimer

Conflict of interest statement

Competing interests: The author declares no competing interests.

Figures

Fig. 1.
Fig. 1.
Validation of black-box algorithms. Computational validation of black-box algorithms involves three related steps: 1) ensuring basic quality of training data and development procedures; 2) testing algorithm performance against independent test data; and 3) evaluating performance in ongoing use. Data from real-world use can be used to improve further iterations of the algorithm.
See this image and copyright information in PMC

References

    1. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S, Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115–118 (2017). - PMC - PubMed
    1. Liu NT, Holcomb JB, Wade CE, Batchinsky AI, Cancio LC, Darrah MI, Salinas J, Development and validation of a machine learning algorithm and hybrid system to predict the need for life-saving interventions in trauma patients. Med. Biol. Eng. Comput 52, 193–203 (2014). - PubMed
    1. Obermeyer Z, Emanuel EJ, Predicting the Future — Big Data, Machine Learning, and Clinical Medicine. N. Engl. J. Med 375, 1216–1219 (2016). - PMC - PubMed
    1. Liehr T, Acquarola N, Pyle K, St-Pierre S, Rinholm M, Bar O, Wilhelm K, Schreyer I, Next generation phenotyping in Emanuel and Pallister Killian Syndrome using computer-aided facial dysmorphology analysis of 2D photos. Clin. Genet 93, 378–381 (2017). - PubMed
    1. Price WN 2nd, Black-box Medicine. Harv J. L. & Tech 28, 419–467 (2015).

Publication types

LinkOut - more resources