Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022;27(7):9877-9911.
doi: 10.1007/s10639-022-10986-w. Epub 2022 Apr 6.

Comprehensive evaluation of the use of technology in education - validation with a cohort of global open online learners

Jennifer W M Lai  1 , John De Nobile  1 , Matt Bower  1 , Yvonne Breyer  2
Affiliations

Comprehensive evaluation of the use of technology in education - validation with a cohort of global open online learners

Jennifer W M Lai et al. Educ Inf Technol (Dordr). 2022.

Abstract

Although a large variety of methodologies, contexts and perspectives have been used to examine educational application of technology, there is a paucity of instruments that are designed to comprehensively evaluate the use of technology in education. This paper presents a Confirmatory Factor Analysis (CFA) of an instrument that incorporates eight key dimensions: learning, affective, behavioral, technology, design, pedagogy, presence/community, and institutional environment. These dimensions were derived from rigorous systematic literature review and field specialist validation processes. The model was then refined and empirically confirmed in this study by 1,352 participants undertaking a Coursera open online course. The results of applying the instrument, as well as qualitative feedback from participants, are shared to illustrate its breadth and utility. The final 28 item "Comprehensive Evaluation of Use of Technology in Education" instrument is provided in full to support consistent, holistic and robust evaluation and comparison of technology use across educational contexts.

Keywords: Applications in subject areas; Confirmatory factor analysis; Distance education and online learning; Evaluation methodologies; Interactive learning environment; MOOCs.

PubMed Disclaimer

Conflict of interest statement

Declarations of interestThis research was approved by the Macquarie University Human Research Ethics Committee (approval ref.: 52019594312243). There are no conflicts of interest to declare with this research.

Figures

Fig. 1
Fig. 1
Hypothesized eight-factor structure model
Fig. 2
Fig. 2
Standardized loading factor coefficients of the eight-factor structure model
Fig. 3
Fig. 3
Participant factor ratings of the Coursera Excel factor scores for the Comprehensive Evaluation of the Use of Technology in Education model
See this image and copyright information in PMC

References

    1. Afthanorhan W, Ahmad S, Mamat I. Pooled Confirmatory Factor Analysis (PCFA) using structural equation modeling on volunteerism program: A step by step approach. International Journal of Asian Social Science. 2014;4(5):642–653.
    1. Al-Adwan, A. S. (2020). Investigating the drivers and barriers to MOOCs adoption: The perspective of TAM. Education and Information Technologies, 1–25.
    1. Albelbisi NA. Development and validation of the MOOC success scale (MOOC-SS) Education and Information Technologies. 2020;25(5):4535–4555. doi: 10.1007/s10639-020-10186-4. - DOI
    1. Almasseri M, AlHojailan MI. How flipped learning based on the cognitive theory of multimedia learning affects students' academic achievements. Journal of Computer Assisted Learning. 2019;35(6):769–781. doi: 10.1111/jcal.12386. - DOI
    1. Alonso-Mencía, M. E., Alario-Hoyos, C., Estévez-Ayres, I., & Delgado Kloos, C. (2021). Analysing self-regulated learning strategies of MOOC learners through self-reported data. Australasian Journal of Educational Technology, 56–70. 10.14742/ajet.6150

LinkOut - more resources