Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Aug 17:14:1126106.
doi: 10.3389/fpsyg.2023.1126106. eCollection 2023.

Cognitive diagnostic assessment of EFL learners' listening barriers through incorrect responses

Yaru Meng  1 , Ya Wang  1 , Ningning Zhao  2
Affiliations

Cognitive diagnostic assessment of EFL learners' listening barriers through incorrect responses

Yaru Meng et al. Front Psychol. .

Abstract

English as Foreign Language (EFL) learners' cognitive processes have been a research focus in listening assessment. Most studies use correct responses as data, but undervalue the rich information of the incorrect answers or options (in the case of multiple choice questions, MCQ). However, the MCQ distractors are often intentionally designed to reveal learners' problems or barriers. In order to diagnose the EFL learners' listening barriers through incorrect responses, Cognitive Diagnostic Models (CDMs) for bugs were adopted, hence the name Bug-CDMs. First, five EFL listening barrier attributes were identified and two Bug Q-matrices were developed to comparatively analyze the learner's responses with different Bug-CDMs. The results revealed that Bug-GDINA was the optimal model, and the most prevalent barriers were semantic understanding and vocabulary recognition. These barriers confirmed both compensatory and non-compensatory relationships in causing listening comprehension failures. The study proved the feasibility of Bug-GDINA in diagnosing listening barriers from the incorrect responses. Limitations and suggestions for further research were also proposed.

Keywords: Bug-GDINA; EFL listening barriers; cognitive diagnostic assessment; cognitive diagnostic model; incorrect responses.

PubMed Disclaimer

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Figures

Figure 1
Figure 1
Attribute prevalence.
Figure 2
Figure 2
Different person parameter estimation of learners with the same total score.
See this image and copyright information in PMC

References

    1. Alharbi M. A., Al-Ahdal A. A. M. H. (2022). Communication barriers in the EFL classroom: is poor listening the culprit that obstructs learning? Interact. Learn. Environ., 1–15. doi: 10.1080/10494820.2022.2098776 - DOI
    1. Anderson J. R. (1995). Cognitive psychology and its implications. New York, NY: Worth.
    1. Andrade H. L., Heritage M. (2017). Using formative assessment to enhance learning, achievement, and academic self-regulation Routledge.
    1. Aryadoust V. (2017). Teaching and assessing reading comprehension to improve literacy: an integrated model and its application. Keynote speech presented at English literacy pedagogy in 21st century: striving for multiple literacies in classroom practices, Indonesia.
    1. Aryadoust V. (2018). A cognitive diagnostic assessment study of the listening test of the Singapore–Cambridge general certificate of education O-level: application of DINA, DINO, G-DINA, HO-DINA, and RRUM. Int. J. Listen. 35, 1–24. doi: 10.1080/10904018.2018.1500915 - DOI

LinkOut - more resources