Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Sep 5;19(1):185.
doi: 10.1186/s12874-019-0828-3.

Explaining differential item functioning focusing on the crucial role of external information - an example from the measurement of adolescent mental health

Curt Hagquist  1
Affiliations

Explaining differential item functioning focusing on the crucial role of external information - an example from the measurement of adolescent mental health

Curt Hagquist. BMC Med Res Methodol. .

Abstract

Background: An overarching objective in research comparing different sample groups is to ensure that the reported differences in outcomes are not affected by differences between groups in the functioning of the measurement instruments, i.e. the items have to work in the same way for the different sample groups to be compared. Lack of invariance across sample groups are commonly called Differential Item Functioning (DIF). There is a sense in which the DIF of an item can be taken account of by resolving (splitting) the item into group specific items, rather than deleting the item. Resolving improves fit, retains the reliability and content provided by the item, and compensates for the DIF in estimation of person parameters on the scale of the instrument. However, it destroys invariance of the item's parameter value among the groups. Whether or not a DIF item should be resolved depends on whether the source of the DIF is relevant or irrelevant for the content of the variable. The present paper shows how external information can be used to investigate if the gender DIF found in the item "Stomach ache" in a psychosomatic symptoms scale used among adolescents may reflect abdominal pain because of a biological factor, the girls' menstrual periods.

Methods: Swedish data from the international Health Behaviour in School-aged Children study (HBSC) collected in 2005/06, 2009/10 and 2013/14 were used, comprising a total of 18,983 students in grades 5, 7 and 9. A composite measure of eight items of psychosomatic problems was analysed for DIF with respect to gender and menstrual periods using the Rasch model.

Results: The results support the hypothesis that the source of the gender DIF for the item "Stomach ache" is a gender specific biological factor. In that case the DIF should be resolved if the psychosomatic measure is not intended to tap information about abdominal pain caused by a gender specific biological factor. In contrast, if the measure is intended to tap such information, the DIF should not be resolved.

Conclusions: The conceptualisation of the measure governs whether the item showing DIF should be resolved or not.

Keywords: Differential item functioning (DIF); Psychosomatic problems; Rasch model; Resolving for DIF; Source of DIF; Validity and reliability, HBSC.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Item Stomach ache showing period DIF, in a set where item Felt low is resolved for period-DIF
Fig. 2
Fig. 2
Item Stomach ache resolved for period-DIF, in a set where first item Felt low is resolved for period DIF
See this image and copyright information in PMC

References

    1. Olsen J, IEA European Questionnaire Group Epidemiology deserves better questionnaires. Int J Epidemiol. 1998;27(6):935. doi: 10.1093/ije/27.6.935. - DOI - PubMed
    1. Thurstone LL. Attitudes can be measured. Am J Sociol. 1928;33(4):529–554. doi: 10.1086/214483. - DOI
    1. Guttman LA. The basis for scalogram analysis. In: Stouffer SA, editor. Measurement and prediction. New York: John Wiley; 1950. pp. 60–90.
    1. Rasch G. Probabilistic models for some intelligence and attainment tests. Expanded ed. Chicago, IL: University of Chicago Press; 1980.
    1. Ironson, G. H. (1983). Using item response theory to measure bias. In R Hambleton (Ed.),Applications of item response theory. Vancouver, Canada: Education Research Institute, British Columbia.

Publication types