Case-mix adjustment of the National CAHPS benchmarking data 1.0: a violation of model assumptions?

Abstract

Objective: To compare models for the case-mix adjustment of consumer reports and ratings of health care.

Data sources: The study used the Consumer Assessment of Health Plans (CAHPS) survey 1.0 National CAHPS Benchmarking Database data from 54 commercial and 31 Medicaid health plans from across the United States: 19,541 adults (age > or = 18 years) in commercial plans and 8,813 adults in Medicaid plans responded regarding their own health care, and 9,871 Medicaid adults responded regarding the health care of their minor children.

Study design: Four case-mix models (no adjustment; self-rated health and age; health, age, and education; and health, age, education, and plan interactions) were compared on 21 ratings and reports regarding health care for three populations (adults in commercial plans, adults in Medicaid plans, and children in Medicaid plans). The magnitude of case-mix adjustments, the effects of adjustments on plan rankings, and the homogeneity of these effects across plans were examined.

Data extraction: All ratings and reports were linearly transformed to a possible range of 0 to 100 for comparability.

Principal findings: Case-mix adjusters, especially self-rated health, have substantial effects, but these effects vary substantially from plan to plan, a violation of standard case-mix assumptions.

Conclusion: Case-mix adjustment of CAHPS data needs to be re-examined, perhaps by using demographically stratified reporting or by developing better measures of response bias.