Assessing the diagnostic performance of large language models with European Diploma in Musculoskeletal Radiology (EDiMSK) examination sample questions

Affiliations

¹ Department of Radiology, Kirikkale Yuksek Ihtisas Hospital, Bağlarbaşı, Ahmet Ay Caddesi, Merkez, 71300, Kırıkkale, Turkey. gunesyasincelal@gmail.com.
² Department of Radiology, Mamak State Hospital, Ankara, Turkey.

Yasin Celal Gunes et al. Jpn J Radiol. 2024 Jun.

. 2024 Jun;42(6):673-674.

doi: 10.1007/s11604-024-01548-w. Epub 2024 Feb 26.

¹ Department of Radiology, Kirikkale Yuksek Ihtisas Hospital, Bağlarbaşı, Ahmet Ay Caddesi, Merkez, 71300, Kırıkkale, Turkey. gunesyasincelal@gmail.com.
² Department of Radiology, Mamak State Hospital, Ankara, Turkey.

No abstract available

Cited by

Can a large language model create acceptable dental board-style examination questions? A cross-sectional prospective study.
Kim HS, Kim GT. Kim HS, et al. J Dent Sci. 2025 Apr;20(2):895-900. doi: 10.1016/j.jds.2024.08.020. Epub 2024 Sep 11. J Dent Sci. 2025. PMID: 40224064 Free PMC article.
Reply to "Assessing the diagnostic performance of large language models with European Diploma in Musculoskeletal Radiology (EDiMSK) examination sample questions".
Harigai A, Toyama Y, Takase K. Harigai A, et al. Jpn J Radiol. 2024 Jun;42(6):675-676. doi: 10.1007/s11604-024-01556-w. Epub 2024 Mar 15. Jpn J Radiol. 2024. PMID: 38485880 No abstract available.
Optimizing Diagnostic Performance of ChatGPT: The Impact of Prompt Engineering on Thoracic Radiology Cases.
Cesur T, Güneş YC. Cesur T, et al. Cureus. 2024 May 9;16(5):e60009. doi: 10.7759/cureus.60009. eCollection 2024 May. Cureus. 2024. PMID: 38854352 Free PMC article.

1. Toyama Y, Harigai A, Abe M, Nagano M, Kawabata M, Seki Y, Takase K. Performance evaluation of ChatGPT, GPT-4, and Bard on the official board examination of the Japan Radiology Society. Jpn J Radiol. 2023;4:1–7.
1. Almeida LC, Farina EJM, Kuriki PE, Abdala N, Kitamura FC. Performance of ChatGPT on the Brazilian Radiology and diagnostic ımaging and mammography board examinations. Radiol Artif Intell. 2023;6:e230103. - DOI - PMC
1. Patil NS, Huang R, Caterine S, Varma V, Mammen T, Stubbs E. Comparison of artificial intelligence chatbots for musculoskeletal radiology procedure patient education. J Vasc Interv Radiol JVIR. 2023;26:S1051–443.
1. Bosbach WA, Senge JF, Nemeth B, Omar SH, Mitrakovic M, Beisbart C, Horváth A, Heverhagen J, Daneshvar K. Ability of ChatGPT to generate competent radiology reports for distal radius fracture by use of RSNA template items and integrated AO classifier. Curr Probl Diagn Radiol. 2023;53:102. - DOI - PubMed
1. Yang F, Yan D, Wang Z. Large-scale assessment of ChatGPT’s performance in benign and malignant bone tumors imaging report diagnosis and its potential for clinical applications. J Bone Oncol. 2024;22: 100525. - DOI