Performance of Commercial Dermatoscopic Systems That Incorporate Artificial Intelligence for the Identification of Melanoma in General Practice: A Systematic Review
- PMID: 38611119
- PMCID: PMC11011068
- DOI: 10.3390/cancers16071443
Performance of Commercial Dermatoscopic Systems That Incorporate Artificial Intelligence for the Identification of Melanoma in General Practice: A Systematic Review
Abstract
Background: Cutaneous melanoma remains an increasing global public health burden, particularly in fair-skinned populations. Advancing technologies, particularly artificial intelligence (AI), may provide an additional tool for clinicians to help detect malignancies with a more accurate success rate. This systematic review aimed to report the performance metrics of commercially available convolutional neural networks (CNNs) tasked with detecting MM.
Methods: A systematic literature search was performed using CINAHL, Medline, Scopus, ScienceDirect and Web of Science databases.
Results: A total of 16 articles reporting MM were included in this review. The combined number of melanomas detected was 1160, and non-melanoma lesions were 33,010. The performance of market-approved technology and clinician performance for classifying melanoma was highly heterogeneous, with sensitivity ranging from 16.4 to 100.0%, specificity between 40.0 and 98.3% and accuracy between 44.0 and 92.0%. Less heterogeneity was observed when clinicians worked in unison with AI, with sensitivity ranging between 83.3 and 100.0%, specificity between 83.7 and 87.3%, and accuracy between 86.4 and 86.9%.
Conclusion: Instead of focusing on the performance of AI versus clinicians for classifying melanoma, more consistent performance has been obtained when clinicians' work is supported by AI, facilitating management decisions and improving health outcomes.
Keywords: computer-aided diagnosis; convolutional neural network; deep learning; dermatology; detection; diagnosis; epidemiology; machine learning; skin cancer; total body photography.
Conflict of interest statement
Professor Mike Climstein is a section editor for PeerJ (Sports Medicine and Rehabilitation). Adjunct Professor Michael Stapelberg is self-employed operating at John Flynn Hospital Specialist Centre. The Adjunct Professor Jeremy Hudson and Dr. Paul Coxon are employed at North Queensland Skin Centre. The authors declare no conflicts of interest.
Figures




Similar articles
-
The Role of Artificial Intelligence in the Diagnosis of Melanoma.Cureus. 2024 Sep 20;16(9):e69818. doi: 10.7759/cureus.69818. eCollection 2024 Sep. Cureus. 2024. PMID: 39308840 Free PMC article. Review.
-
Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review.JMIR Med Inform. 2019 Aug 16;7(3):e10010. doi: 10.2196/10010. JMIR Med Inform. 2019. PMID: 31420959 Free PMC article. Review.
-
Skin cancer classification via convolutional neural networks: systematic review of studies involving human experts.Eur J Cancer. 2021 Oct;156:202-216. doi: 10.1016/j.ejca.2021.06.049. Epub 2021 Sep 8. Eur J Cancer. 2021. PMID: 34509059
-
Artificial Intelligence and Its Effect on Dermatologists' Accuracy in Dermoscopic Melanoma Image Classification: Web-Based Survey Study.J Med Internet Res. 2020 Sep 11;22(9):e18091. doi: 10.2196/18091. J Med Internet Res. 2020. PMID: 32915161 Free PMC article.
-
Analysis of Artificial Intelligence-Based Approaches Applied to Non-Invasive Imaging for Early Detection of Melanoma: A Systematic Review.Cancers (Basel). 2023 Sep 23;15(19):4694. doi: 10.3390/cancers15194694. Cancers (Basel). 2023. PMID: 37835388 Free PMC article. Review.
Cited by
-
Enhancing skin lesion classification: a CNN approach with human baseline comparison.PeerJ Comput Sci. 2025 Apr 15;11:e2795. doi: 10.7717/peerj-cs.2795. eCollection 2025. PeerJ Comput Sci. 2025. PMID: 40567717 Free PMC article.
-
Artificial Intelligence Performance in Image-Based Cancer Identification: Umbrella Review of Systematic Reviews.J Med Internet Res. 2025 Apr 1;27:e53567. doi: 10.2196/53567. J Med Internet Res. 2025. PMID: 40167239 Free PMC article.
-
Deep Learning and Multidisciplinary Imaging in Pediatric Surgical Oncology: A Scoping Review.Cancer Med. 2025 Jan;14(2):e70574. doi: 10.1002/cam4.70574. Cancer Med. 2025. PMID: 39812075 Free PMC article.
References
Publication types
LinkOut - more resources
Full Text Sources