Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Observational Study
. 2025 Mar;31(3):310-315.
doi: 10.14744/tjtes.2025.07724.

Can ChatGPT pass the Turkish Orthopedics and Traumatology Board Examination? Turkish orthopedic surgeons versus artificial intelligence

Çağdaş Pamuk  1 , Abdullah Faruk Uyanık  2 , Ersin Kuyucu  1 , Meriç Uğurlar  3
Affiliations
Observational Study

Can ChatGPT pass the Turkish Orthopedics and Traumatology Board Examination? Turkish orthopedic surgeons versus artificial intelligence

Çağdaş Pamuk et al. Ulus Travma Acil Cerrahi Derg. 2025 Mar.

Abstract

Background: Artificial intelligence has been shown to achieve successful outcomes in various orthopedic qualification examinations worldwide. This study aims to assess the performance of ChatGPT in the written section of the Turkish Orthopedics and Traumatology Board Examination, compare its results with those of candidates who took the exam, and determine whether ChatGPT is sufficient to achieve a passing score.

Methods: This retrospective observational study evaluated whether ChatGPT achieved a passing grade on 400 publicly available questions from the Turkish orthopedics qualification exam over the past four years. ChatGPT's performance was compared with the mean scores of the candidates who took the exam.

Results: A total of 627 candidates participated in the four exams included in the study, of whom 292 (46.5%) passed. ChatGPT received higher scores than 619 (98.7%) of the candidates. In all exams conducted between 2020 and 2023, ChatGPT achieved significantly higher scores than the mean exam success rate (p=0.012, p=0.012, p=0.002, p=0.005, respectively). Of the 400 questions analyzed, 36 (9%) included figures.

Conclusion: This is the first study to evaluate the performance of ChatGPT in the Turkish orthopedics proficiency exam. Our findings indicate that ChatGPT demonstrated high success in the Turkish Orthopedics and Traumatology Board Examination (TOTBE) written exam, achieving higher scores than the vast majority of candidates taking the exam (98.7%). ChatGPT performed well in the first part of the proficiency exam, where only theoretical knowledge is assessed. However, the human factor, which synthesizes both theoretical and practical knowledge, remains essential in daily medical practice.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest: The authors have no conflicts of interest to declare.

Figures

Figure 1
Figure 1
Distribution of candidates based on their exam success.
Figure 2
Figure 2
Distribution of candidates’ exam scores in the 2023 Turkish Orthopedic and Traumatology Board Examination (TOTBE).
See this image and copyright information in PMC

References

    1. Reis F, Lenz C, Gossen M, Volk HD, Drzeniek NM. Practical Applications of Large Language Models for Health Care Professionals and Scientists. JMIR Med Inform. 2024;12:e58478. - PMC - PubMed
    1. Wilson T, Lee KKW. How I Do It:Using ChatGPT to Create Clinical Scenarios for Surgical Learning and Oral Boards Preparation. J Surg Educ. 2024;81:1623–31. - PubMed
    1. Atik OŞ. Artificial intelligence:Who must have autonomy the machine or the human?Jt Dis Relat Surg. 2024;35:1–2. - PMC - PubMed
    1. Оdri GА, Ji Yun Yооn D. Detecting generative artificial intelligence in scientific articles:Evasion techniques and implications for scientific integrity. Orthop Traumatol Surg Res. 2023;109:103706. - PubMed
    1. Atik OŞ. Artificial intelligence, machine learning, and deep learning in orthopedic surgery. Jt Dis Relat Surg. 2022;33:484–5. - PMC - PubMed

Publication types

LinkOut - more resources