The application of generalizability theory to reliability assessment: an illustration using isometric force measurements

Abstract

Background and purpose: The objective of this study was to examine the potential use of the generalizability theory for assessing reliability of muscle force measurements in clinical applications. Reliability is expressed in terms of standard error of measurement (SEM) and the indexes derived from the SEM. Using generalizability theory, potential sources of measurement error can be recognized and estimated.

Subjects: Ten healthy women, aged 23 to 47 years (means = 29.5, SD = 7.1), participated in the study.

Methods: The method is illustrated by presenting a pilot study. Repeated measurements of maximal isometric knee extension force were carried out by two therapists. The time interval between measurement occasions was 1 week. A functional prototype of a hand-held dynamometer was used, and measurements were carried out according to standardized test protocols.

Results: Relatively important sources of measurement error were associated with interaction effects between subject and therapist as well as with interactions including the factor occasion. The SEM of the net knee moment was estimated for various hypothetical applications of the dynamometer.

Conclusion and discussion: It is concluded that the SEM, the corresponding confidence interval, and the smallest detectable difference are practical measures for expressing reliability of measurements on an individual. Generalizability theory is a powerful tool for estimating the magnitude of multiple sources of measurement error and for assessing the reliability of measurements tailored to specific clinical applications.