Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Dec 4;12(12):CD013192.
doi: 10.1002/14651858.CD013192.

Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma

Affiliations

Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma

Naomi Chuchu et al. Cochrane Database Syst Rev. .

Abstract

Background: Melanoma accounts for a small proportion of all skin cancer cases but is responsible for most skin cancer-related deaths. Early detection and treatment can improve survival. Smartphone applications are readily accessible and potentially offer an instant risk assessment of the likelihood of malignancy so that the right people seek further medical attention from a clinician for more detailed assessment of the lesion. There is, however, a risk that melanomas will be missed and treatment delayed if the application reassures the user that their lesion is low risk.

Objectives: To assess the diagnostic accuracy of smartphone applications to rule out cutaneous invasive melanoma and atypical intraepidermal melanocytic variants in adults with concerns about suspicious skin lesions.

Search methods: We undertook a comprehensive search of the following databases from inception to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles.

Selection criteria: Studies of any design evaluating smartphone applications intended for use by individuals in a community setting who have lesions that might be suspicious for melanoma or atypical intraepidermal melanocytic variants versus a reference standard of histological confirmation or clinical follow-up and expert opinion.

Data collection and analysis: Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). Due to scarcity of data and poor quality of studies, we did not perform a meta-analysis for this review. For illustrative purposes, we plotted estimates of sensitivity and specificity on coupled forest plots for each application under consideration.

Main results: This review reports on two cohorts of lesions published in two studies. Both studies were at high risk of bias from selective participant recruitment and high rates of non-evaluable images. Concerns about applicability of findings were high due to inclusion only of lesions already selected for excision in a dermatology clinic setting, and image acquisition by clinicians rather than by smartphone app users.We report data for five mobile phone applications and 332 suspicious skin lesions with 86 melanomas across the two studies. Across the four artificial intelligence-based applications that classified lesion images (photographs) as melanomas (one application) or as high risk or 'problematic' lesions (three applications) using a pre-programmed algorithm, sensitivities ranged from 7% (95% CI 2% to 16%) to 73% (95% CI 52% to 88%) and specificities from 37% (95% CI 29% to 46%) to 94% (95% CI 87% to 97%). The single application using store-and-forward review of lesion images by a dermatologist had a sensitivity of 98% (95% CI 90% to 100%) and specificity of 30% (95% CI 22% to 40%).The number of test failures (lesion images analysed by the applications but classed as 'unevaluable' and excluded by the study authors) ranged from 3 to 31 (or 2% to 18% of lesions analysed). The store-and-forward application had one of the highest rates of test failure (15%). At least one melanoma was classed as unevaluable in three of the four application evaluations.

Authors' conclusions: Smartphone applications using artificial intelligence-based analysis have not yet demonstrated sufficient promise in terms of accuracy, and they are associated with a high likelihood of missing melanomas. Applications based on store-and-forward images could have a potential role in the timely presentation of people with potentially malignant lesions by facilitating active self-management health practices and early engagement of those with suspicious skin lesions; however, they may incur a significant increase in resource and workload. Given the paucity of evidence and low methodological quality of existing studies, it is not possible to draw any implications for practice. Nevertheless, this is a rapidly advancing field, and new and better applications with robust reporting of studies could change these conclusions substantially.

PubMed Disclaimer

Conflict of interest statement

Naomi Chuchu: none known. Yemisi Takwoingi: none known. Jac Dinnes: none known. Rubeta N Matin: my institution received a grant for a Barco NV commercially sponsored study to evaluate digital dermoscopy in the skin cancer clinic. My institution also received Oxfordshire Health Services Research Charitable Funds for carrying out a study of feasibility of using the Skin Cancer Quality of Life Impact Tool (SCQOLIT) in non melanoma skin cancer. I have received royalties for the Oxford Handbook of Medical Dermatology (Oxford University Press) and payment from the UK Photopheresis Society for a lecture on cutaneous graft versus host disease (October 2017). I have no conflicts of interest to declare that directly relate to the publication of this work. Oliver Bassett: none known. Jacqueline F Moreau: I helped draft the paper and performed data analysis for an included study (Wolf 2013). Susan E Bayliss: none known. Clare Davenport: none known. Kathie Godfrey: none known. Susan O'Connell: none known. Abhilash Jain: none known. Fiona M Walter: none known. Jonathan J Deeks: none known. Hywel C Williams: I am director of the NIHR health technology assessment (HTA) Programme. HTA is part of the NIHR which also supports the NIHR systematic reviews programme from which this work is funded.

Clinical referee David de Berker: I am Principal investigator for a single site in a multicentre study for assessment of images in pigmented lesions. The sponsor is Skin Analytics. I receive no payment for this from Skin Analytics, although they pay the hospital for participation of our site.

Figures

1
1
Sample photographs of superficial spreading melanoma (left) and nodular melanoma (right). Copyright © 2010 Dr Rubeta Matin: reproduced with permission.
2
2
Example pathway for an individual using a smartphone application to examine a suspicious mole in resource settings with smartphones
3
3
Current clinical pathway for people with skin lesions.
4
4
PRISMA flow diagram.
5
5
Risk of bias and applicability concerns summary: review authors' judgements about each domain for each included study
6
6
Risk of bias and applicability concerns graph: review authors' judgements about each domain presented as percentages across included studies
7
7
Forest plot of tests: showing sensitivity and specificity of all the applications for the detection of cutaneous melanoma and atypical intraepidermal variants 1 App 1[problematic vs okay], 2 App 2 [mel vs not mel], 3 App 3(a) [high risk vs medium+low risk], 4 App 3(b) [high+medium risk vs low risk], 5 App 4 (remote diagnosis) [atypical vs typical], 6 SkinVision [high risk vs medium/low risk].
8
8
Forest plot of tests: SkinVision automated diagnosis compared to face to face clinical diagnosis by a dermatologist 6 SkinVision [high risk vs medium/low risk], 7 Face‐to‐face clinical diagnosis [high risk vs medium/low risk].
1
1. Test
App 1 [decision: problematic vs okay].
2
2. Test
App 2 [decision: melanoma vs not melanoma].
3
3. Test
App 3(a) [decision: high risk vs medium/low risk].
4
4. Test
App 3(b) [decision: high/medium risk vs low risk].
5
5. Test
App 4 (remote diagnosis) [decision: atypical vs typical].
6
6. Test
SkinVision [decision: high risk vs medium/low risk].
7
7. Test
Face‐to‐face dermatologist diagnosis [decision: melanoma vs not melanoma].

Similar articles

  • Teledermatology for diagnosing skin cancer in adults.
    Chuchu N, Dinnes J, Takwoingi Y, Matin RN, Bayliss SE, Davenport C, Moreau JF, Bassett O, Godfrey K, O'Sullivan C, Walter FM, Motley R, Deeks JJ, Williams HC; Cochrane Skin Cancer Diagnostic Test Accuracy Group. Chuchu N, et al. Cochrane Database Syst Rev. 2018 Dec 4;12(12):CD013193. doi: 10.1002/14651858.CD013193. Cochrane Database Syst Rev. 2018. PMID: 30521686 Free PMC article.
  • Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults.
    Dinnes J, Deeks JJ, Chuchu N, Ferrante di Ruffano L, Matin RN, Thomson DR, Wong KY, Aldridge RB, Abbott R, Fawzy M, Bayliss SE, Grainge MJ, Takwoingi Y, Davenport C, Godfrey K, Walter FM, Williams HC; Cochrane Skin Cancer Diagnostic Test Accuracy Group. Dinnes J, et al. Cochrane Database Syst Rev. 2018 Dec 4;12(12):CD011902. doi: 10.1002/14651858.CD011902.pub2. Cochrane Database Syst Rev. 2018. PMID: 30521682 Free PMC article.
  • Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults.
    Ferrante di Ruffano L, Takwoingi Y, Dinnes J, Chuchu N, Bayliss SE, Davenport C, Matin RN, Godfrey K, O'Sullivan C, Gulati A, Chan SA, Durack A, O'Connell S, Gardiner MD, Bamber J, Deeks JJ, Williams HC; Cochrane Skin Cancer Diagnostic Test Accuracy Group. Ferrante di Ruffano L, et al. Cochrane Database Syst Rev. 2018 Dec 4;12(12):CD013186. doi: 10.1002/14651858.CD013186. Cochrane Database Syst Rev. 2018. PMID: 30521691 Free PMC article.
  • Visual inspection for diagnosing cutaneous melanoma in adults.
    Dinnes J, Deeks JJ, Grainge MJ, Chuchu N, Ferrante di Ruffano L, Matin RN, Thomson DR, Wong KY, Aldridge RB, Abbott R, Fawzy M, Bayliss SE, Takwoingi Y, Davenport C, Godfrey K, Walter FM, Williams HC; Cochrane Skin Cancer Diagnostic Test Accuracy Group. Dinnes J, et al. Cochrane Database Syst Rev. 2018 Dec 4;12(12):CD013194. doi: 10.1002/14651858.CD013194. Cochrane Database Syst Rev. 2018. PMID: 30521684 Free PMC article.
  • High-frequency ultrasound for diagnosing skin cancer in adults.
    Dinnes J, Bamber J, Chuchu N, Bayliss SE, Takwoingi Y, Davenport C, Godfrey K, O'Sullivan C, Matin RN, Deeks JJ, Williams HC; Cochrane Skin Cancer Diagnostic Test Accuracy Group. Dinnes J, et al. Cochrane Database Syst Rev. 2018 Dec 4;12(12):CD013188. doi: 10.1002/14651858.CD013188. Cochrane Database Syst Rev. 2018. PMID: 30521683 Free PMC article.

Cited by

References

References to studies included in this review

Maier 2015 {published data only}
    1. Maier T, Kulichova D, Schotten K, Astrid R, Ruzicka T, Berking C, et al. Accuracy of a smartphone application using fractal image analysis of pigmented moles compared to clinical diagnosis and histological result. Journal of the European Academy of Dermatology and Venereology : JEADV 2015;29(4):663‐7. [ER4:25012308; PUBMED: 25087492] - PubMed
Wolf 2013 {published data only}
    1. Wolf JA, Moreau JF, Akilov O, Patton T, English JC 3rd, Ho J, et al. Diagnostic inaccuracy of smartphone applications for melanoma detection. JAMA Dermatology 2013;149(4):422‐6. [ER4:15466167; PUBMED: 23325302] - PMC - PubMed

References to studies excluded from this review

Braun 2015 {published data only}
    1. Braun RP, Marghoob A. High‐dynamic‐range dermoscopy imaging and diagnosis of hypopigmented skin cancers. JAMA Dermatology 2015;151(4):456‐7. [PUBMED: 25535875] - PubMed
Burki 2013 {published data only}
    1. Burki TK. Diagnostic accuracy of smartphone applications. Lancet Oncology 2013;14(3):e90. [PUBMED: 23580957] - PubMed
Diniz 2016 {published data only}
    1. Diniz LE, Ennser K. Melanoma detection using a mobile phone app. Proceedings of SPIE. March 7, 2016; Vol. 9699. [DOI: 10.1117/12.2212446] - DOI
Jahan‐Tigh 2016 {published data only}
    1. Jahan‐Tigh RR, Chinn GM, Rapini RP. A comparative study between smartphone‐based microscopy and conventional light microscopy in 1021 dermatopathology specimens. Archives of Pathology & Laboratory Medicine 2016;140(1):86‐90. [PUBMED: 26717060] - PubMed
Karargyris 2012 {published data only}
    1. Karargyris A, Karargyris O, Pantelopoulos A. DERMA/care: an advanced image‐processing mobile application for monitoring skin cancer. IEEE 24th International Conference on Tools with Artificial Intelligence; 2012 Nov 7‐9; Athens, Greece. 2012; Vol. 2:1‐7. [DOI: 10.1109/ICTAI.2012.180] - DOI
Lai 2015 {published data only}
    1. Lai I, Ko J, Pathipati A. DermLens: device for mobile teledermatology. Journal of the American Academy of Dermatology 2015;72(5, Suppl 1):AB88. [EMBASE: 71895108]
Massone 2007 {published data only}
    1. Massone C, Hofmann‐Wellenhof R, Ahlgrimm‐Siess V, Gabler G, Ebner C, Soyer HP. Melanoma screening with cellular phones. PLOS ONE 2007;2(5):e483. [PUBMED: 17534433] - PMC - PubMed
Ramlakhan 2011 {published data only}
    1. Ramlakhan K, Shang Y. A mobile automated skin lesion classification system. IEEE 23rd International Conference on Tools with Artificial Intelligence; 2011 Nov 7‐9; Boca Raton, FL, USA. 2011:138‐41. [DOI: 10.1109/ICTAI.2011.29] - DOI
Robson 2012 {published data only}
    1. Robson Y, Blackford S, Roberts D. Caution in melanoma risk analysis with smartphone application technology. British Journal of Dermatology 2012;167(3):703‐4. [PUBMED: 22762381] - PubMed
Varma 2011 {published data only}
    1. Varma S. Mobile teledermatology for skin tumour screening. British Journal of Dermatology 2011;164(5):939‐40. [PUBMED: 21518326] - PubMed
Von Braunmühl 2015 {published data only}
    1. Braunmühl T. Smartphone apps for skin cancer diagnosis? The Munich study [Smartphone Apps für die Hautkrebs‐Diagnose? – die Münchner Studie]. Kosmetische Medizin 2015;36(4):152‐7.
Wadhawan 2011 {published data only}
    1. Wadhawan T, Situ N, Rui H, Lancaster K, Yuan X, Zouridakis G. Implementation of the 7‐point checklist for melanoma detection on smart handheld devices. IEEE Engineering in Medicine and Biology Magazine ‐ Conference Proceedings 2011;2011:3180‐3. [PUBMED: 22255015] - PMC - PubMed
Yu 2011 {published data only}
    1. Yu LS, Joseph AONR, Lindsley EH, Farkas DL. Polarization‐sensitive digital dermoscopy for image processing‐assisted evaluation of atypical nevi: towards step‐wise detection of melanoma. Proceedings of SPIE; 2011 Feb 28; San Francisco, California, United States. 2011; Vol. 7902. [DOI: 10.1117/12.891083] - DOI
Zouridakis 2015 {published data only}
    1. Zouridakis G, Wadhawan T, Situ N, Hu R, Yuan X, Lancaster K, et al. Melanoma and other skin lesion detection using smart handheld devices. Methods in Molecular Biology 2015;1256:459‐96. [PUBMED: 25626557] - PubMed

Additional references

ACIM 2017
    1. Australian Cancer Database. Melanoma of the skin for Australia (ICD10 C43). Australian Institute of Health and Welfare (AIHW) 2017 Australian Cancer Incidence and Mortality (ACIM) books (www.aihw.gov.au/acim‐books/). Canberra: Australian Institute of Health and Welfare, 2017.
Altamura 2008
    1. Altamura D, Avramidis M, Menzies SW. Assessment of the optimal interval for and sensitivity of short‐term sequential digital dermoscopy monitoring for the diagnosis of melanoma. Archives of Dermatology 2008;144(4):502‐6. [PUBMED: 18427044] - PubMed
Apalla 2017
    1. Apalla Z, Lallas A, Sotiriou E, Lazaridou E, Ioannides D. Epidemiological trends in skin cancer. Dermatology Practical & Conceptual 2017;7(2):1. [DOI: 10.5826/dpc.0702a01] - DOI - PMC - PubMed
Armstrong 2017
    1. Armstrong BK, Cust AE. Sun exposure and skin cancer, and the puzzle of cutaneous melanoma: a perspective on Fears et al. Mathematical models of age and ultraviolet effects on the incidence of skin cancer among whites in the United States. American Journal of Epidemiology 1977; 105: 420‐7. Cancer Epidemiology 2017;48:147‐56. [PUBMED: 28478931] - PubMed
Arnold 2014
    1. Arnold M, Holterhues C, Hollestein LM, Coebergh JW, Nijsten T, Pukkala E, et al. Trends in incidence and predictions of cutaneous melanoma across Europe up to 2015. Journal of the European Academy of Dermatology and Venereology: JEADV 2014;28(9):1170‐8. [PUBMED: 23962170] - PubMed
BAD 2013
    1. British Association of Dermatology. Quality standards for Teledermatology using 'store and forward' images. www.bad.org.uk/shared/get‐file.ashx?itemtype=document&id=794. London: British Association of Dermatology, (accessed prior to 16 May 2018).
Balch 2001
    1. Balch CM, Soong SJ, Gershenwald JE, Thompson JF, Reintgen DS, Cascinelli N, et al. Prognostic factors analysis of 17,600 melanoma patients: validation of the American Joint Committee on Cancer melanoma staging system. Journal of Clinical Oncology 2001;19(16):3622‐34. [PUBMED: 11504744] - PubMed
Balch 2009
    1. Balch CM, Gershenwald JE, Soong SJ, Thompson JF, Atkins MB, Byrd DR, et al. Final Version of 2009 AJCC Melanoma Staging and Classification. Journal of Clinical Oncology 2009;27(36):6199‐206. [PUBMED: 19917835] - PMC - PubMed
Bashshur 2015
    1. Bashshur RL, Shannon GW, Tejasvi T, Kvedar JC, Gates M. The empirical foundations of teledermatology: a review of the research evidence. Telemedicine Journal and E‐Health 2015;21(12):953‐79. [PUBMED: 26394022] - PMC - PubMed
Belbasis 2016
    1. Belbasis L, Stefanaki I, Stratigos AJ, Evangelou E. Non‐genetic risk factors for cutaneous melanoma and keratinocyte skin cancers: an umbrella review of meta‐analyses. Journal of Dermatological Science 2016;84(3):330‐339. [PUBMED: 27663092] - PubMed
Boniol 2012
    1. Boniol M, Autier P, Boyle P, Gandini S. Cutaneous melanoma attributable to sunbed use: systematic review and meta‐analysis. BMJ 2012;345:e4757. [PUBMED: 22833605] - PMC - PubMed
Boring 1994
    1. Boring CC, Squires TS, Tong T, Montgomery S. Cancer statistics, 1994. CA: a Cancer Journal for Clinicians 1994;44(1):7‐26. [PUBMED: 8281473] - PubMed
Bossuyt 2015
    1. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015;351:h5527. [DOI: 10.1136/bmj.h5527; PUBMED: 26511519] - DOI - PMC - PubMed
Cancer Research UK 2017a
    1. Cancer Research UK. Skin cancer statistics. www.cancerresearchuk.org/health‐professional/cancer‐statistics/statistic.... (accessed prior to 21 July 2017).
Cancer Research UK 2017b
    1. Skin cancer incidence statistics. www.cancerresearchuk.org/health‐professional/cancer‐statistics/statistic... (accessed prior to 30 May 2018).
Chao 2013
    1. Chao D, London Cancer (North and East). Guidelines for cutaneous malignant melanoma management August 2013. www.londoncancer.org/media/76373/london‐cancer‐melanoma‐guidelines‐2013‐.... London: London Cancer North and East Alliance, (accessed 25 February 2015).
Cho 2014
    1. Cho H, Mariotto AB, Schwartz LM, Luo J, Woloshin S. When do changes in cancer survival mean progress? The insight from population incidence and mortality. Journal of the National Cancer Institute. Monographs 2014;2014(49):187‐97. [PUBMED: 25417232] - PMC - PubMed
Chuchu 2018
    1. Chuchu N, Dinnes J, Takwoingi Y, Matin RN, Bayliss SE, Davenport C, et al. Teledermatology for diagnosing skin cancer in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013193] - DOI - PMC - PubMed
Deeks 2005
    1. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology 2005;58(9):882‐93. [PUBMED: 16085191] - PubMed
DePry 2011
    1. DePry JL, Reed KB, Cook‐Norris RH, Brewer JD. Iatrogenic immunosuppression and cutaneous malignancy [Review]. Clinics in Dermatology 2011;29(6):602‐13. [PUBMED: 22014982] - PubMed
Dinnes 2018a
    1. Dinnes J, Deeks JJ, Grainge MJ, Chuchu N, Ferrante di Ruffano L, Matin RN, et al. Visual inspection for diagnosing cutaneous melanoma in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013194] - DOI - PMC - PubMed
Dinnes 2018b
    1. Dinnes J, Deeks JJ, Chuchu N, Ferrante di Ruffano L, Matin RN, Thomson DR, et al. Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD011902.pub2] - DOI - PMC - PubMed
Dinnes 2018c
    1. Dinnes J, Deeks JJ, Saleh D, Chuchu N, Bayliss SE, Patel L, et al. Reflectance confocal microscopy for diagnosing cutaneous melanoma in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013190] - DOI - PMC - PubMed
Dinnes 2018d
    1. Dinnes J, Bamber J, Chuchu N, Bayliss SE, Takwoingi Y, Davenport C, et al. High‐frequency ultrasound for diagnosing skin cancer in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013188] - DOI - PMC - PubMed
Dong 2000
    1. Dong XD, Tyler D, Johnson JL, DeMatos P, Seigler JF. Analysis of prognosis and disease progression after local recurrence of melanoma. Cancer 2000;88(5):1063‐71. [DOI: 10.1002/(SICI)1097-0142(20000301)88:5%3C1063::AID-CNCR17%3E3.0.CO;2-E; PUBMED: 10699896] - DOI - PubMed
Efron 1983
    1. Efron B. Estimating the error rate of a prediction rule: improvement on cross‐validation. Journal of the American Statistical Association 1983;78(382):316‐31. [DOI: 10.1080/01621459.1983.10477973] - DOI
Erdmann 2013
    1. Erdmann F, Lortet‐Tieulent J, Schuz J, Zeeb H, Greinert R, Breitbart EW, et al. International trends in the incidence of malignant melanoma 1953‐2008‐‐are recent generations at higher or lower risk?. International Journal of Cancer 2013;132(2):385‐400. [PUBMED: 22532371] - PubMed
EUCAN 2012
    1. EUCAN, International Agency for Research on Cancer. Malignant melanoma of skin: estimated incidence, mortality & prevalence for both sexes, 2012. eco.iarc.fr/eucan/Cancer.aspx?Cancer=20. International Agency for Research on Cancer, (accessed 29 July 2015).
Ferlay 2015
    1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, et al. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. International Journal of Cancer 2015;136(5):E359‐86. [PUBMED: 25220842] - PubMed
Ferrante di Ruffano 2018a
    1. Ferrante di Ruffano L, Dinnes J, Deeks JJ, Chuchu N, Bayliss SE, Davenport C, et al. Optical coherence tomography for diagnosing skin cancer in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013189] - DOI - PMC - PubMed
Ferrante di Ruffano 2018b
    1. Ferrante di Ruffano L, Takwoingi Y, Dinnes J, Chuchu N, Bayliss SE, Davenport C, et al. Computer‐assisted diagnosis techniques (dermoscopy and spectroscopy‐based) for diagnosing skin cancer in adults. Cochrane Database of Systematic Reviews 2018, Issue 12. [DOI: 10.1002/14651858.CD013186] - DOI - PMC - PubMed
Flaten 2018
    1. Flaten HK, Claire C, Schlager E, Dunnick CA, Dellavalle RP. Growth of mobile applications in dermatology ‐ 2017 update. escholarship.org/uc/item/3hs7n9z6 (accessed prior to 15 November 2018). [PUBMED: 29630159] - PubMed
Friedman 1985
    1. Friedman RJ, Rigel DS, Kopf AW. Early detection of malignant melanoma: the role of physician examination and self‐examination of the skin. CA: a Cancer Journal for Clinicians 1985;35(3):130‐51. [PUBMED: 3921200] - PubMed
Gandini 2005a
    1. Gandini S, Sera F, Cattaruzza MS, Pasquini P, Abeni D, Boyle P, et al. Meta‐analysis of risk factors for cutaneous melanoma: I. Common and atypical naevi. European Journal of Cancer 2005;41(1):28‐44. [PUBMED: 15617989] - PubMed
Gandini 2005b
    1. Gandini S, Sera F, Cattaruzza MS, Pasquini P, Picconi O, Boyle P, et al. Meta‐analysis of risk factors for cutaneous melanoma: II. Sun exposure. European Journal of Cancer 2005;41(1):45‐60. [PUBMED: 15617990] - PubMed
Garbe 2016
    1. Garbe C, Peris K, Hauschild A, Saiag P, Middleton M, Bastholt L, et al. Diagnosis and treatment of melanoma. European consensus‐based interdisciplinary guideline ‐ Update 2016. European Journal of Cancer 2016;63:201‐17. [PUBMED: 27367293] - PubMed
Geller 2002
    1. Geller AC, Miller DR, Annas GD, Demierre MF, Gilchrest BA, Koh HK. Melanoma incidence and mortality among US whites, 1969‐1999. JAMA 2002;288(14):1719‐20. [PUBMED: 12365954] - PubMed
HPA and MelNet NZ 2014
    1. Health Promotion Agency and the Melanoma Network of New Zealand (MelNet). New Zealand Skin Cancer Primary Prevention and Early Detection Strategy 2014 to 2017. www.sunsmart.org.nz//sites/default/files/documents/NZ%20Skin%20Cancer%20.... Cancer Society of New Zealand, (accessed 29 May 2018).
Kasprzak 2015
    1. Kasprzak JM, Xu YG. Diagnosis and management of lentigo maligna: a review. Drugs in Context 2015;4:212281. [PUBMED: 26082796] - PMC - PubMed
Kassianos 2015
    1. Kassianos AP, Emery JD, Murchie P, Walter FM. Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review. British Journal of Dermatology 2015;172(6):1507–18. [PUBMED: 25600815] - PubMed
Kjome 2016
    1. Kjome RL, Wright DJ, Bjaaen AB, Garstad KW, Valeur M. Dermatological cancer screening: Evaluation of a new community pharmacy service. Research in Social and Administrative Pharmacy 2016;16:30581‐2. [DOI: 10.1016/j.sapharm.2016.12.001; PUBMED: 27964893] - DOI - PubMed
Korn 2008
    1. Korn EL, Liu PY, Lee SJ, Chapman JA, Niedzwiecki D, Suman VJ, et al. Meta‐analysis of phase II cooperative group trials in metastatic stage IV melanoma to determine progression‐free and overall survival benchmarks for future phase II trials. Journal of Clinical Oncology 2008;26(4):527‐34. [PUBMED: 18235113] - PubMed
Landini 2011
    1. Landini G. Fractals in microscopy. Journal of Microscopy 2011;241(1):1‐8. [PUBMED: 21118245] - PubMed
Leff 2008
    1. Leff B, Finucane TE. Gizmo idolatry. JAMA 2008;299(15):1830‐2. [PUBMED: 18413879] - PubMed
Lehmann 2011
    1. Lehmann AR, McGibbon D, Stefanini M. Xeroderma pigmentosum. Orphanet Journal Of Rare Diseases 2011;6:70. [PUBMED: 22044607] - PMC - PubMed
Linos 2009
    1. Linos E, Swetter SM, Cockburn MG, Colditz GA, Clarke CA. Increasing burden of melanoma in the United States. Journal of Investigative Dermatology 2009;129(7):1666‐74. [PUBMED: 19131946] - PMC - PubMed
MacKie 1990
    1. MacKie RM. Clinical recognition of early invasive malignant melanoma. BMJ 1990;301(6759):1005‐6. [PUBMED: 2249043] - PMC - PubMed
Mahar 2016
    1. Mahar AL, Compton C, Halabi S, Hess KR, Gershenwald JE, Scolyer RA, et al. Critical assessment of clinical prognostic tools in melanoma. Annals of Surgical Oncology 2016;23(9):2753‐61. [PUBMED: 27052645] - PubMed
Marsden 2010
    1. Marsden JR, Newton‐Bishop JA, Burrows L, Cook M, Corrie PG, Cox NH, et al. BAD Guidelines: revised UK guidelines for the management of cutaneous melanoma 2010. British Journal of Dermatology 2010;163(2):238‐56. [PUBMED: 20608932] - PubMed
McLaughlin 2005
    1. McLaughlin CC, Wu XC, Jemal A, Martin HJ, Roche LM, Chen VW. Incidence of noncutaneous melanomas in the U.S. Cancer 2005;103(5):1000‐7. [PUBMED: 15651058] - PubMed
Mistry 2011
    1. Mistry M, Parkin DM, Ahmad AS, Sasieni P. Cancer incidence in the United Kingdom: projections to the year 2030. British Journal of Cancer 2011;105(11):1795‐803. [DOI: 10.1038/bjc.2011.430; PUBMED: 22033277] - DOI - PMC - PubMed
Moreau 2013
    1. Moreau JF, Weissfeld JL, Ferris LK. Characteristics and survival of patients with invasive amelanotic melanoma in the USA. Melanoma Research 2013; Vol. 23, issue 5:408‐13. [PUBMED: 23883947] - PubMed
Murchie 2017
    1. Murchie P, Amalraj Raja E, Brewster DH, Iversen L, Lee AJ. Is initial excision of cutaneous melanoma by General Practitioners (GPs) dangerous? Comparing patient outcomes following excision of melanoma by GPs or in hospital using national datasets and meta‐analysis. European Journal of Cancer 2017;86:373‐84. [PUBMED: 29100192] - PubMed
Ndegwa 2010
    1. Ndegwa S, Prichett‐Pejic W, McGill S, Murphy G, Severn M. Teledermatology services: rapid review of diagnostic, clinical management, and economic outcomes. Ottawa: Canadian Agency for Drugs and Technologies in Health (CADTH), 2010.
NICE 2015
    1. National Institute for Health and Care Excellence. Melanoma: assessment and management. www.nice.org.uk/guidance/ng14 (accessed prior to 21 July 2017).
Pasquali 2018
    1. Pasquali S, Hadjinicolaou AV, Chiarion Sileni V, Rossi CR, Mocellin S. Systemic treatments for metastatic cutaneous melanoma. Cochrane Database of Systematic Reviews 2018, Issue 2. [DOI: 10.1002/14651858.CD011123.pub2] - DOI - PMC - PubMed
Raguso 2010
    1. Raguso G, Ancona A, Chieppa L, L'Abbate S, Pepe ML, Mangieri F, et al. Application of fractal analysis to mammography. Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE. 2010:3182‐5. [PUBMED: 21096599] - PubMed
Rangayyan 2007
    1. Rangayyan RM, Nguyen TM. Fractal analysis of contours of breast masses in mammograms. Journal of Digital Imaging 2007;20(3):223‐37. [PUBMED: 17021926] - PMC - PubMed
Reyes‐Ortiz 2006
    1. Reyes‐Ortiz CA, Goodwin JS, Freeman JL, Kuo YF. Socioeconomic status and survival in older patients with melanoma. Journal of the American Geriatrics Society 2006;54(11):1758‐64. [PUBMED: 17087705] - PMC - PubMed
Robertson 2014
    1. Robertson N, Polonsky M, McQuilken L. Are my symptoms serious Dr Google? A resource‐based typology of value co‐destruction in online self‐diagnosis. Australasian Marketing Journal 2014;22(3):246‐56. [DOI: 10.1016/j.ausmj.2014.08.009] - DOI
Rutjes 2005
    1. Rutjes AW, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PM. Case‐control and two‐gate designs in diagnostic accuracy studies. Clinical Chemistry 2005;51(8):1335‐41. [PUBMED: 15961549] - PubMed
Rutjes 2006
    1. Rutjes AW, Reitsma JB, Nisio M, Smidt N, Rijn JC, Bossuyt PM. Evidence of bias and variation in diagnostic accuracy studies. CMAJ 2006;174(4):469‐76. [PUBMED: 16477057] - PMC - PubMed
SEER 2007
    1. SEER. Cutaneous melanoma equivalent terms, definitions and illustrations. C440‐C449 with histology 8720‐8780. seer.cancer.gov/tools/mphrules/2007/melanoma/terms_defs.pdf (accessed 28 February 2018).
Shaikh 2012
    1. Shaikh WR, Xiong M, Weinstock MA. The contribution of nodular subtype to melanoma mortality in the United States, 1978 to 2007. Archives of Dermatology 2012;148(1):30‐6. [PUBMED: 21931016] - PubMed
Siegel 2015
    1. Siegel R, Miller K, Jemal A. Cancer statistics, 2015. CA: a Cancer Journal for Clinicians 2015;65(1):5‐29. [PUBMED: 25559415] - PubMed
SIGN 2017
    1. Scottish Intercollegiate Guidelines Network. Cutaneous Melanoma. www.sign.ac.uk/sign‐146‐melanoma.html (accessed prior to 21 July 2017).
Sladden 2009
    1. Sladden MJ, Balch C, Barzilai DA, Berg D, Freiman A, Handiside T, et al. Surgical excision margins for primary cutaneous melanoma. Cochrane Database of Systematic Reviews 2009, Issue 10. [DOI: 10.1002/14651858.CD004835.pub2] - DOI - PubMed
Slater 2014
    1. Slater D, Walsh M. Standards and datasets for reporting cancers: Dataset for the histological reporting of primary cutaneous malignant melanoma and regional lymph nodes, May 2014. www.rcpath.org/Resources/RCPath/Migrated%20Resources/Documents/G/G125_Da.... London: Royal College of Pathologists, (accessed 29 July 2015).
Swerdlow 1995
    1. Swerdlow AJ, English JS, Qiao Z. The risk of melanoma in patients with congenital nevi: a cohort study. Journal of the American Academy of Dermatology 1995;32(4):595‐9. [PUBMED: 7896948] - PubMed
Thompson 2003
    1. Thompson JF, Morton DL, Kroon BBR. Textbook of Melanoma: Pathology, Diagnosis and Management. CRC Press, 2003. [ISBN 9781901865653]
Tucker 1985
    1. Tucker MA, Boice JD Jr, Hoffman DA. Second cancer following cutaneous melanoma and cancers of the brain, thyroid, connective tissue, bone, and eye in Connecticut, 1935‐82. National Cancer Institute Monographs 1985;68:161‐89. [PUBMED: 4088297] - PubMed
Tyagi 2012
    1. Tyagi A, Miller K, Cockburn M. e‐Health tools for targeting and improving melanoma screening: a review. Journal of Skin Cancer 2012;2012:437502. [DOI: 10.1155/2012/437502; PUBMED: 23304515] - DOI - PMC - PubMed
Warshaw 2010
    1. Warshaw EM, Gravely AA, Nelson DB. Accuracy of teledermatology/teledermoscopy and clinic‐based dermatology for specific categories of skin neoplasms. Journal of the American Academy of Dermatology 2010;63(2):348‐52. [PUBMED: 20633809] - PubMed
Wheatley 2016
    1. Wheatley K, Wilson JS, Gaunt P, Marsden JR. Surgical excision margins in primary cutaneous melanoma: A meta‐analysis and Bayesian probability evaluation. Cancer Treatment Reviews 2016;42:73‐81. [PUBMED: 26563920] - PubMed
Whiting 2011
    1. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS‐2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine 2011;155(8):529‐36. [PUBMED: 22007046] - PubMed
Zemelman 2014
    1. Zemelman VB, Valenzuela CY, Sazunic I, Araya I. Malignant melanoma in Chile: different site distribution between private and state patients. Biological Research 2014;47(1):34. [PUBMED: 25204018] - PMC - PubMed

References to other published versions of this review

Dinnes 2015a
    1. Dinnes J, Matin RN, Moreau JF, Patel L, Chan SA, Wong KY, et al. Tests to assist in the diagnosis of cutaneous melanoma in adults: a generic protocol. Cochrane Database of Systematic Reviews 2015, Issue 10. [DOI: 10.1002/14651858.CD011902] - DOI
Dinnes 2015b
    1. Dinnes J, Wong KY, Gulati A, Chuchu N, Leonardi‐Bee J, Bayliss SE, Takwoingi Y, Davenport C, Matin RN, Bath‐Hextall FJ, Jain A, Lear JT, Motley R, O'Sullivan C, Deeks JJ, Williams HC. Tests to assist in the diagnosis of keratinocyte skin cancers in adults: a generic protocol. Cochrane Database of Systematic Reviews 2015, Issue 10. [DOI: 10.1002/14651858.CD011901] - DOI

Publication types