Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jun;212(11):514-519.
doi: 10.5694/mja2.50600. Epub 2020 May 11.

The quality of diagnosis and triage advice provided by free online symptom checkers and apps in Australia

Michella G Hill  1 , Moira Sim  1 , Brennen Mills  1
Affiliations

The quality of diagnosis and triage advice provided by free online symptom checkers and apps in Australia

Michella G Hill et al. Med J Aust. 2020 Jun.

Abstract

Objectives: To investigate the quality of diagnostic and triage advice provided by free website and mobile application symptom checkers (SCs) accessible in Australia.

Design: 36 SCs providing medical diagnosis or triage advice were tested with 48 medical condition vignettes (1170 diagnosis vignette tests, 688 triage vignette tests).

Main outcome measures: Correct diagnosis advice (provided in first, the top three or top ten diagnosis results); correct triage advice (appropriate triage category recommended).

Results: The 27 diagnostic SCs listed the correct diagnosis first in 421 of 1170 SC vignette tests (36%; 95% CI, 31-42%), among the top three results in 606 tests (52%; 95% CI, 47-59%), and among the top ten results in 681 tests (58%; 95% CI, 53-65%). SCs using artificial intelligence algorithms listed the correct diagnosis first in 46% of tests (95% CI, 40-57%), compared with 32% (95% CI, 26-38%) for other SCs. The mean rate of first correct results for individual SCs ranged between 12% and 61%. The 19 triage SCs provided correct advice for 338 of 688 vignette tests (49%; 95% CI, 44-54%). Appropriate triage advice was more frequent for emergency care (63%; 95% CI, 52-71%) and urgent care vignette tests (56%; 95% CI, 52-75%) than for non-urgent care (30%; 95% CI, 11-39%) and self-care tests (40%; 95% CI, 26-49%).

Conclusion: The quality of diagnostic advice varied between SCs, and triage advice was generally risk-averse, often recommending more urgent care than appropriate.

Keywords: Diagnosis; Internet; Mobile applications; Signs and symptoms; eHealth.

PubMed Disclaimer

Comment in

References

    1. Australian Bureau of Statistics. 8146.0. Household use of information technology, Australia, 2016-17. Mar 2018. http://www.abs.gov.au/ausstats/abs@.nsf/mf/8146.0 (viewed Apr 2018).
    1. Deloitte Australia. Mobile consumer survey 2018: the Australian cut. http://images.content.deloitte.com.au/Web/DELOITTEAUSTRALIA/%7B51598b8c-... (viewed Apr 2019).
    1. Lupton D, Jutel A. “It's like having a physician in your pocket!” A critical analysis of self-diagnosis smartphone apps. Soc Sci Med 2015; 133: 128-135.
    1. Cheng C, Dunn M. Health literacy and the Internet: a study on the readability of Australian online health information. Aust N Z J Public Health 2015; 39: 309-314.
    1. Healthdirect Australia. About healthdirect symptom checker. Updated Apr 2016. https://www.healthdirect.gov.au/about-healthdirect-symptom-checker (viewed Apr 2018).

LinkOut - more resources