Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2018 Mar 28;13(3):e0194811.
doi: 10.1371/journal.pone.0194811. eCollection 2018.

Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice

Matt Boyd  1 , Nick Wilson  2
Affiliations
Comparative Study

Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice

Matt Boyd et al. PLoS One. .

Abstract

Objective: To compare voice-activated internet searches by smartphone (two digital assistants) with laptop ones for information and advice related to smoking cessation.

Design: Responses to 80 questions on a range of topics related to smoking cessation (including the FAQ from a NHS website), compared for quality.

Setting: Smartphone and internet searches as performed in New Zealand.

Main outcome measures: Ranked responses to the questions.

Results: Google laptop internet searches came first (or first equal) for best quality smoking cessation advice for 83% (66/80) of the responses. Voiced questions to Google Assistant ("OK Google") came first/first equal 76% of the time vs Siri (Apple) at 28%. Google and Google Assistant were statistically significantly better than Siri searches (odds ratio 12.4 and 8.5 respectively, p<0.0001 in each comparison). When asked FAQs from the National Health Service website, or to find information the Centers for Disease Control has made videos on, the best search results used expert sources 59% (31/52) of the time, "some expertise" (eg, Wikipedia) 18% of the time, but also magazines and other low quality sources 19% of the time. Using all three methods failed to find relevant information 8% (6/80) of the time, with Siri having the most failed responses (53% of the time).

Conclusion: Google internet searches and Google Assistant were found to be significantly superior to the Siri digital assistant for smoking cessation information. While expert content was returned over half the time, there is still substantial room for improvement in how these software systems deliver smoking cessation advice.

PubMed Disclaimer

Conflict of interest statement

Competing Interests: All authors have completed the Unified Competing Interest form (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work. MB is the owner and sole employee of Adapt Research Ltd, this does not alter our adherence to PLOS ONE policies on sharing data and materials.

References

    1. Ofcom. Adults’ media use and attitudes Report 2017. London: Ofcom, 2017. https://www.ofcom.org.uk/__data/assets/pdf_file/0020/102755/adults-media....
    1. Higgins O, Sixsmith J, Barry M, Domegan C. A literature review on health information seeking behaviour on the web: a health consumer and health professional perspective Stockholm: ECDC; 2011.
    1. Gibbs S. Google to put health information directly into search results. The Guardian 2015(10 February). https://www.theguardian.com/technology/2015/feb/10/Google-health-informa....
    1. Stevens L. NHS England working with internet giants to promote digital tools. Digital Health 2017(9 March). https://www.digitalhealth.net/2017/03/nhs-england-working-with-us-intern....
    1. Dunn J. We put Siri, Alexa, Google Assistant, and Cortana through a marathon of tests to see who's winning the virtual assistant race—here's what we found. Business Insider 2016(7 November). https://www.businessinsider.com.au/siri-vs-Google-assistant-cortana-alex....

Publication types

MeSH terms