Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Sep 5:9:e48254.
doi: 10.2196/48254.

Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study

Malik Sallam  1   2 , Nesreen A Salim  3   4 , Muna Barakat  5   6 , Kholoud Al-Mahzoum  1 , Ala'a B Al-Tammemi  7 , Diana Malaeb  8 , Rabih Hallit  9   10   11 , Souheil Hallit  9   12
Affiliations

Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study

Malik Sallam et al. JMIR Med Educ. .

Abstract

Background: ChatGPT is a conversational large language model that has the potential to revolutionize knowledge acquisition. However, the impact of this technology on the quality of education is still unknown considering the risks and concerns surrounding ChatGPT use. Therefore, it is necessary to assess the usability and acceptability of this promising tool. As an innovative technology, the intention to use ChatGPT can be studied in the context of the technology acceptance model (TAM).

Objective: This study aimed to develop and validate a TAM-based survey instrument called TAME-ChatGPT (Technology Acceptance Model Edited to Assess ChatGPT Adoption) that could be employed to examine the successful integration and use of ChatGPT in health care education.

Methods: The survey tool was created based on the TAM framework. It comprised 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT. Using a convenient sampling approach, the survey link was circulated electronically among university students between February and March 2023. Exploratory factor analysis (EFA) was used to assess the construct validity of the survey instrument.

Results: The final sample comprised 458 respondents, the majority among them undergraduate students (n=442, 96.5%). Only 109 (23.8%) respondents had heard of ChatGPT prior to participation and only 55 (11.3%) self-reported ChatGPT use before the study. EFA analysis on the attitude and usage scales showed significant Bartlett tests of sphericity scores (P<.001) and adequate Kaiser-Meyer-Olkin measures (0.823 for the attitude scale and 0.702 for the usage scale), confirming the factorability of the correlation matrices. The EFA showed that 3 constructs explained a cumulative total of 69.3% variance in the attitude scale, and these subscales represented perceived risks, attitude to technology/social influence, and anxiety. For the ChatGPT usage scale, EFA showed that 4 constructs explained a cumulative total of 72% variance in the data and comprised the perceived usefulness, perceived risks, perceived ease of use, and behavior/cognitive factors. All the ChatGPT attitude and usage subscales showed good reliability with Cronbach α values >.78 for all the deduced subscales.

Conclusions: The TAME-ChatGPT demonstrated good reliability, validity, and usefulness in assessing health care students' attitudes toward ChatGPT. The findings highlighted the importance of considering risk perceptions, usefulness, ease of use, attitudes toward technology, and behavioral factors when adopting ChatGPT as a tool in health care education. This information can aid the stakeholders in creating strategies to support the optimal and ethical use of ChatGPT and to identify the potential challenges hindering its successful implementation. Future research is recommended to guide the effective adoption of ChatGPT in health care education.

Keywords: KAP; artificial intelligence; education; healthcare; knowledge; machine learning; opinion; practices; survey; technology.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

References

    1. de Divitiis E, Cappabianca P, de Divitiis O. The "schola medica salernitana": the forerunner of the modern university medical schools. Neurosurgery. 2004 Oct;55(4):722–44; discussion 744. doi: 10.1227/01.neu.0000139458.36781.31. - DOI - PubMed
    1. Dornan T. Osler, Flexner, apprenticeship and 'the new medical education'. J R Soc Med. 2005 Mar;98(3):91–5. doi: 10.1177/014107680509800302. https://europepmc.org/abstract/MED/15738549 98/3/91 - DOI - PMC - PubMed
    1. Arnone JM, Fitzsimons V. Plato, nightingale, and nursing: can you hear me now? Int J Nurs Knowl. 2015 Oct;26(4):156–62. doi: 10.1111/2047-3095.12059. - DOI - PubMed
    1. Hildebrandt S. Lessons to be learned from the history of anatomical teaching in the United States: the example of the University of Michigan. Anat Sci Educ. 2010;3(4):202–12. doi: 10.1002/ase.166. http://hdl.handle.net/2027.42/77525 - DOI - PubMed
    1. Custers E, Cate O. The History of Medical Education in Europe and the United States, with respect to time and proficiency. Acad Med. 2018 Mar;93(3S Competency-Based, Time-Variable Education in the Health Professions):S49–S54. doi: 10.1097/ACM.0000000000002079.00001888-201803001-00010 - DOI - PubMed