Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 May 11;7(5):e07014.
doi: 10.1016/j.heliyon.2021.e07014. eCollection 2021 May.

Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial

Nabi Nazari  1 , Muhammad Salman Shabbir  2 , Roy Setiawan  3
Affiliations

Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial

Nabi Nazari et al. Heliyon. .

Abstract

A major challenge in educational technology integration is to engage students with different affective characteristics. Also, how technology shapes attitude and learning behavior is still lacking. Findings from educational psychology and learning sciences have gained less traction in research. The present study was conducted to examine the efficacy of a group format of an Artificial Intelligence (AI) powered writing tool for English second postgraduate students in the English academic writing context. In the present study, (N = 120) students were randomly allocated to either the equipped AI (n = 60) or non-equipped AI (NEAI). The results of the parametric test of analyzing of covariance revealed that at post-intervention, students who participated in the AI intervention group demonstrated statistically significant improvement in the scores, of the behavioral engagement (Cohen's d = .75, 95% CI [0.38, 1.12]), of the emotional engagement Cohen's d = .82, 95% CI [0.45, 1.25], of the cognitive engagement, Cohen's d = .39,95% CI [0.04, .76], of the self-efficacy for writing, Cohen's d = .54, 95% CI [0.18, 0.91], of the positive emotions Cohen's d = . 44, 95% CI [0.08, 0.80], and of the negative emotions, Cohen's d = -.98, 95% CI [-1.36, -0.60], compared with NEAI. The results suggest that AI-powered writing tools could be an efficient tool to promote learning behavior and attitudinal technology acceptance through formative feedback and assessment for non-native postgraduate students in English academic writing.

Keywords: Artificial Intelligence; Automated writing evaluation; ESL; Feedback; Formative assessment; L2 writing; Pedagogy.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
The participants flow chart diagram.
See this image and copyright information in PMC

References

    1. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol. Rev. 1977;84(2):191. - PubMed
    1. Bandura A. On deconstructing commentaries regarding alternative theories of self-regulation. J. Manag. 2015;41(4):1025–1044.
    1. Bernacki M.L., Greene J.A., Crompton H. Mobile technology, learning, and achievement: advances in understanding and measuring the role of mobile technology in education. Contemp. Educ. Psychol. 2020;60 November 2019.
    1. Boud D. Sustainable assessment for long term learning. Stud. Cont. Educ. 2000;22(2):151–167.
    1. Boud D., Soler R. Sustainable assessment revisited. Assess Eval. High Educ. 2016;41(3):400–413.