Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Dec;46(2):2402075.
doi: 10.1080/0886022X.2024.2402075. Epub 2024 Sep 11.

Identification of kidney-related medications using AI from self-captured pill images

Mohammad S Sheikh  1 , Benjamin Dreesman  2 , Erin F Barreto  2 , Charat Thongprayoon  1 , Jing Miao  1 , Supawadee Suppadungsuk  1   3 , Michael A Mao  4 , Fawad Qureshi  1 , Justin H Pham  1 , Iasmina M Craici  1 , Kianoush B Kashani  1   5 , Wisit Cheungpasitporn  1
Affiliations

Identification of kidney-related medications using AI from self-captured pill images

Mohammad S Sheikh et al. Ren Fail. 2024 Dec.

Abstract

Introduction: ChatGPT, a state-of-the-art large language model, has shown potential in analyzing images and providing accurate information. This study aimed to explore ChatGPT-4 as a tool for identifying commonly prescribed nephrology medications across different versions and testing dates.

Methods: 25 nephrology medications were obtained from an institutional pharmacy. High-quality images of each medication were captured using an iPhone 13 Pro Max and uploaded to ChatGPT-4 with the query, 'What is this medication?' The accuracy of ChatGPT-4's responses was assessed for medication name, dosage, and imprint. The process was repeated after 2 weeks to evaluate consistency across different versions, including GPT-4, GPT-4 Legacy, and GPT-4.Ø.

Results: ChatGPT-4 correctly identified 22 out of 25 (88%) medications across all versions. However, it misidentified Hydrochlorothiazide, Nifedipine, and Spironolactone due to misreading imprints. For instance, Nifedipine ER 90 mg was mistaken for Metformin Hydrochloride ER 500 mg because 'NF 06' was misread as 'NF 05'. Hydrochlorothiazide 50 mg was confused with the 25 mg version due to imprint errors, and Spironolactone 25 mg was misidentified as Naproxen Sodium or Diclofenac Sodium. Despite these errors, ChatGPT-4 showed 100% consistency when retested, correcting misidentifications after receiving feedback on the correct imprints.

Conclusion: ChatGPT-4 shows strong potential in identifying nephrology medications from self-captured images, though challenges with difficult-to-read imprints remain. Providing feedback improved accuracy, suggesting ChatGPT-4 could be a valuable tool in digital health for medication identification. Future research should enhance the model's ability to distinguish similar imprints and explore broader integration into digital health platforms.

Keywords: AI; digital health; kidney; medication identification; nephrology; pill image analysis.

PubMed Disclaimer

Conflict of interest statement

No potential conflict of interest was reported by the author(s).

Figures

Figure 1.
Figure 1.
ChatGPT’s interpretation of the image depicting nifedipine extended-release 90 mg, incorrectly identified as metformin hydrochloride ER 500 mg.
Figure 2.
Figure 2.
ChatGPT’s interpretation of the image depicting hydrochlorothiazide 50 mg, incorrectly identified as hydrochlorothiazide 25 mg.
Figure 3.
Figure 3.
ChatGPT’s interpretation of the image depicting spironolactone 25 mg, incorrectly identified as naproxen sodium 550 mg.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Wang X, Liu K, Shirai K, et al. . Prevalence and trends of polypharmacy in U.S. adults, 1999–2018. Glob Health Res Policy. 2023;8(1):25. doi: 10.1186/s41256-023-00311-4. - DOI - PMC - PubMed
    1. Guthrie B, Makubate B, Hernandez-Santiago V, et al. . The rising tide of polypharmacy and drug-drug interactions: population database analysis 1995–2010. BMC Med. 2015;13(1):74. doi: 10.1186/s12916-015-0322-7. - DOI - PMC - PubMed
    1. Kantor ED, Rehm CD, Haas JS, et al. . Trends in prescription drug use among adults in the United States from 1999–2012. JAMA. 2015;314(17):1818–1831. doi: 10.1001/jama.2015.13766. - DOI - PMC - PubMed
    1. Wastesson JW, Morin L, Tan EC, et al. . An update on the clinical consequences of polypharmacy in older adults: a narrative review. Expert Opin Drug Saf. 2018;17(12):1185–1196. doi: 10.1080/14740338.2018.1546841. - DOI - PubMed
    1. Leelakanok N, Holcombe AL, Lund BC, et al. . Association between polypharmacy and death: a systematic review and meta-analysis. J Am Pharm Assoc (2003). 2017;57(6):729–738.e10. doi: 10.1016/j.japh.2017.06.002. - DOI - PubMed

LinkOut - more resources