Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Sep;34(6):410-423.
doi: 10.1177/0146621609349802. Epub 2009 Dec 16.

A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons With Misfitting Responses

Barth B Riley  1 , Michael L Dennis  1 , Kendon J Conrad  2
Affiliations

A Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons With Misfitting Responses

Barth B Riley et al. Appl Psychol Meas. 2010 Sep.

Abstract

This simulation study sought to compare four different computerized adaptive testing (CAT) content balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification; validity of clinical diagnostic recommendations; and sensitivity to atypical responding. The four content balancing procedures were: (1) no content balancing, (2) Screener-based, (3) Mixed (Screener plus content balancing), and (4) Full content balancing. In Full content balancing and in Mixed content balancing following administration of the screener items, item selection was based on: (1) whether the target number of items for the item's subscale was reached, and (2) the item's information function. Mixed and Full content balancing provided the best representation of items from each of the main IMDS subscales. These procedures also resulted in higher CAT-to-full-scale correlations for the Trauma and Homicidal/Suicidal Thought subscales, and improved detection of atypical responding.

Keywords: Global Appraisal of Individual Needs (GAIN); Rasch measurement; atypical responding; classification; computerized adaptive testing; content balancing; diagnostic classification; multidimensional assessment; substance use disorder.

PubMed Disclaimer

References

    1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-IV-TR) 4th. Washington D.C: American Psychiatric Association; 2000.
    1. Bond TG, Fox CM. Applying the Rasch model: Fundamental measurement in the human sciences. 2nd. Mahwah, N.J.: Lawrence Erlbaum; 2007.
    1. Briggs DC, Wilson M. An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement. 2003;4(1):87–100. - PubMed
    1. Conrad KJ, Bezruczko N, Park H, Chan YF, Riley BB, Diamond G, et al. Atypical suicide risk using Rasch person fit statistics to improve screening and understanding. 2008 Manuscript in prepartion.
    1. Conrad KJ, Conrad KM, Dennis ML, Riley BB. GAIN working papers: Rasch analysis of the Internal Mental Distress Scale. 2008 Retrieved 10/22/2008 from http://www.chestnut.org/li/gain/psychometric_reports/gain_working_papers....

LinkOut - more resources