Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2024 Feb;22(1):146-151.
doi: 10.1007/s11914-023-00855-x. Epub 2024 Jan 13.

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health

Olatundun D Awosanya  1 , Alexander Harris  1 , Amy Creecy  1 , Xian Qiao  2   3   4 , Angela J Toepp  4   5 , Thomas McCune  4   6 , Melissa A Kacena  7   8 , Marie V Ozanne  9
Affiliations
Review

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health

Olatundun D Awosanya et al. Curr Osteoporos Rep. 2024 Feb.

Abstract

Purpose of review: There were two primary purposes to our reviews. First, to provide an update to the scientific community about the impacts of COVID-19 on musculoskeletal health. Second, was to determine the value of using a large language model, ChatGPT 4.0, in the process of writing a scientific review article. To accomplish these objectives, we originally set out to write three review articles on the topic using different methods to produce the initial drafts of the review articles. The first review article was written in the traditional manner by humans, the second was to be written exclusively using ChatGPT (AI-only or AIO), and the third approach was to input the outline and references selected by humans from approach 1 into ChatGPT, using the AI to assist in completing the writing (AI-assisted or AIA). All review articles were extensively fact-checked and edited by all co-authors leading to the final drafts of the manuscripts, which were significantly different from the initial drafts.

Recent findings: Unfortunately, during this process, it became clear that approach 2 was not feasible for a very recent topic like COVID-19 as at the time, ChatGPT 4.0 had a cutoff date of September 2021 and all articles published after this date had to be provided to ChatGPT, making approaches 2 and 3 virtually identical. Therefore, only two approaches and two review articles were written (human and AI-assisted). Here we found that the human-only approach took less time to complete than the AI-assisted approach. This was largely due to the number of hours required to fact-check and edit the AI-assisted manuscript. Of note, the AI-assisted approach resulted in inaccurate attributions of references (about 20%) and had a higher similarity index suggesting an increased risk of plagiarism. The main aim of this project was to determine whether the use of AI could improve the process of writing a scientific review article. Based on our experience, with the current state of technology, it would not be advised to solely use AI to write a scientific review article, especially on a recent topic.

Keywords: AI; Bone Loss; COVID-19; ChatGPT; Fracture; Osteoporosis; Query; SARS-CoV-2; Scientific review article.

PubMed Disclaimer

Conflict of interest statement

Melissa Kacena is the Editor-in-Chief for Current Osteoporosis Reports.

References

    1. Khan RA, Jawaid M, Khan AR, et al. ChatGPT - reshaping medical education and clinical management. Pak J Med Sci. 2023;39(2):605–607. doi: 10.12669/pjms.39.2.7653. - DOI - PMC - PubMed
    1. Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel). 2023;11(6):887. doi: 10.3390/healthcare11060887. - DOI - PMC - PubMed
    1. Neumeistera L. Lawyers blame ChatGPT for tricking them into citing bogus case law. Article. Associated Press DBA Press Association; 2023. https://apnews.com/article/artificial-intelligence-chatgpt-courts-e15023.... Accessed 19 Sept 2023.
    1. Creecy A, Awosanya OD, Harris A, et al. COVID-19 and bone loss: a review of risk factors, mechanisms, and future directions. Curr Osteoporos Rep. 2024 doi: 10.1007/s11914-023-00842-2. - DOI - PMC - PubMed
    1. Harris A, Creecy A, Awosanya OD, et al. SARS-CoV-2 and its multifaceted impact on bone health: mechanisms and clinical evidence. Curr Osteoporos Rep. 2024 doi: 10.1007/s11914-023-00843-1. - DOI - PMC - PubMed

Publication types