Can emergency medicine residents reliably use the internet to answer clinical questions?
- PMID: 22224135
- PMCID: PMC3236170
- DOI: 10.5811/westjem.2010.9.1895
Can emergency medicine residents reliably use the internet to answer clinical questions?
Abstract
Introduction: The study objective was to determine the accuracy of answers to clinical questions by emergency medicine (EM) residents conducting Internet searches by using Google. Emergency physicians commonly turn to outside resources to answer clinical questions that arise in the emergency department (ED). Internet access in the ED has supplanted textbooks for references because it is perceived as being more up to date. Although Google is the most widely used general Internet search engine, it is not medically oriented and merely provides links to other sources. Users must judge the reliability of the information obtained on the links. We frequently observed EM faculty and residents using Google rather than medicine-specific databases to seek answers to clinical questions.
Methods: Two EM faculties developed a clinically oriented test for residents to take without the use of any outside aid. They were instructed to answer each question only if they were confident enough of their answer to implement it in a patient-care situation. Questions marked as unsure or answered incorrectly were used to construct a second test for each subject. On the second test, they were instructed to use Google as a resource to find links that contained answers.
Results: Thirty-three residents participated. The means for the initial test were 32% correct, 28% incorrect, and 40% unsure. On the Google test, the mean for correct answers was 59%; 33% of answers were incorrect and 8% were unsure.
Conclusion: EM residents' ability to answer clinical questions correctly by using Web sites from Google searches was poor. More concerning was that unsure answers decreased, whereas incorrect answers increased. The Internet appears to have given the residents a false sense of security in their answers. Innovations, such as Internet access in the ED, should be studied carefully before being accepted as reliable tools for teaching clinical decision making.
Conflict of interest statement
Figures
Similar articles
-
Decision making in family medicine: randomized trial of the effects of the InfoClinique and Trip database search engines.Can Fam Physician. 2013 Oct;59(10):1084-94. Can Fam Physician. 2013. PMID: 24130286 Free PMC article. Clinical Trial.
-
Impact of web searching and social feedback on consumer decision making: a prospective online experiment.J Med Internet Res. 2008 Jan 22;10(1):e2. doi: 10.2196/jmir.963. J Med Internet Res. 2008. PMID: 18244893 Free PMC article.
-
Residents' clinical questions: how are they answered and are the answers helpful?Can Fam Physician. 2012 Jun;58(6):e344-51. Can Fam Physician. 2012. PMID: 22700742 Free PMC article.
-
Comparing the use of an online expert health network against common information sources to answer health questions.J Med Internet Res. 2012 Feb 2;14(1):e9. doi: 10.2196/jmir.1886. J Med Internet Res. 2012. PMID: 22356848 Free PMC article. Review.
-
An Improved Forensic Science Information Search.Forensic Sci Rev. 2015 Jan;27(1):41-52. Forensic Sci Rev. 2015. PMID: 26227137 Review.
Cited by
-
A mixed methods study on medicines information needs and challenges in New Zealand general practice.BMC Fam Pract. 2021 Jul 10;22(1):150. doi: 10.1186/s12875-021-01451-7. BMC Fam Pract. 2021. PMID: 34246231 Free PMC article.
-
Does googling for preconception care result in information consistent with international guidelines: a comparison of information found by Italian women of childbearing age and health professionals.BMC Med Inform Decis Mak. 2013 Jan 25;13:14. doi: 10.1186/1472-6947-13-14. BMC Med Inform Decis Mak. 2013. PMID: 23347453 Free PMC article.
-
The Influence of Medical Expertise and Information Search Skills on Medical Information Searching: Comparative Analysis From a Free Data Set.JMIR Form Res. 2025 Apr 17;9:e62754. doi: 10.2196/62754. JMIR Form Res. 2025. PMID: 40245399 Free PMC article.
-
An evidence-based method for assessing the value of a search tool: a pilot study.J Med Libr Assoc. 2018 Oct;106(4):471-476. doi: 10.5195/jmla.2018.287. Epub 2018 Oct 1. J Med Libr Assoc. 2018. PMID: 30271288 Free PMC article.
-
Net improvement of correct answers to therapy questions after pubmed searches: pre/post comparison.J Med Internet Res. 2013 Nov 8;15(11):e243. doi: 10.2196/jmir.2572. J Med Internet Res. 2013. PMID: 24217329 Free PMC article.
References
-
- Search Engine Watch. Estimated Internet pages. Search Engine Watch Web site. Available at: www.searchenginewatch.com. Accessed February 2008.
-
- Burns E. US core search rankings. Feb, 2008. Search Engine Watch Web site. Available at: http://searchenginewatch.com/3628837. Accessed March 20, 2008.
-
- Dawes J. Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales. Int J Market Res. 2008;;50:61–78.
-
- Likert R. A technique for the measurement of attitudes. Arch Psychology. 1932;140:1–55.
-
- Graber MA, Randles BD, Ely JW, et al. Answering clinical questions in the ED. Am J Emerg Med. 2008;;26:144–147. - PubMed