Measuring visual ability in linguistically diverse populations

Abstract

Measurement of object recognition (OR) ability could predict learning and success in real-world settings, and there is hope that it may reduce bias often observed in cognitive tests. Although the measurement of visual OR is not expected to be influenced by the language of participants or the language of instructions, these assumptions remain largely untested. Here, we address the challenges of measuring OR abilities across linguistically diverse populations. In Study 1, we find that English-Spanish bilinguals, when randomly assigned to the English or Spanish version of the novel object memory test (NOMT), exhibit a highly similar overall performance. Study 2 extends this by assessing psychometric equivalence using an approach grounded in item response theory (IRT). We examined whether groups fluent in English or Spanish differed in (a) latent OR ability as assessed by a three-parameter logistic IRT model, and (2) the mapping of observed item responses on the latent OR construct, as assessed by differential item functioning (DIF) analyses. Spanish speakers performed better than English speakers, a difference we suggest is due to motivational differences between groups of vastly different size on the Prolific platform. That we found no substantial DIF between the groups tested in English or Spanish on the NOMT indicates measurement invariance. The feasibility of increasing diversity by combining groups tested in different languages remains unexplored. Adopting this approach could enable visual scientists to enhance diversity, equity, and inclusion in their research, and potentially in the broader application of their work in society.

Keywords: English; High-level vision; Individual differences; Measurement; Object recognition; Spanish.

Fig. 1

Objects for the three NOMTs used in Experiment 1 structure of trials for the learning and test phases, with Spanish instructions

Fig. 2

Item score functions of item 6 (left) and item 91 (right) by group. Note. DIF significant after B–H adjustment is bolded

Fig. 3

Expected NOMT scores as a function of latent trait levels of English- and Spanish-speaking participants with 95% confidence intervals

Fig. 4

Test information as a function of latent trait levels of English- and Spanish-speaking participants