Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Dec;37(17):3530-3533.
doi: 10.1038/s41433-023-02563-3. Epub 2023 May 9.

Comparative analysis of large language models in the Royal College of Ophthalmologists fellowship exams

Raffaele Raimondi  1 , Nikolaos Tzoumas  2   3 , Thomas Salisbury  4 , Sandro Di Simplicio  5 , Mario R Romano  6 ; North East Trainee Research in Ophthalmology Network (NETRiON)
Collaborators, Affiliations

Comparative analysis of large language models in the Royal College of Ophthalmologists fellowship exams

Raffaele Raimondi et al. Eye (Lond). 2023 Dec.
No abstract available

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing interests.

Figures

Fig. 1
Fig. 1. Performance of LLM-chatbots on FRCOphth examinations.
The chart displays the average scores obtained by the LLM-chatbots on Part 1 (left) and Part 2 (right) FRCOphth written examinations. The x-axis denotes the name of the LLM-chatbots, while the y-axis represents the average scores.
See this image and copyright information in PMC

References

    1. Jiang X, Xie M, Ma L, Dong L, Li D. International publication trends in the application of artificial intelligence in ophthalmology research: An updated bibliometric analysis. Ann Transl Med. 2023;11:219. doi: 10.21037/atm-22-3773. - DOI - PMC - PubMed
    1. Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature. 2023;616:259–65. doi: 10.1038/s41586-023-05881-4. - DOI - PubMed
    1. OpenAI ChatGPT (Mar 13 version) [Large language model] Available at: https://openai.com/blog/chatgpt. [Accessed April 13, 2023].
    1. Bard, an experiment by Google (Mar 21 version). Available at: https://bard.google.com/. [Accessed April 13, 2023].
    1. Microsoft Bing Chat (Feb 7 version). Available at: https://www.bing.com/new. [Accessed April 13, 2023].