Evaluating performance and change in mental health systems serving children and youth: an interorganizational network approach

Abstract

Planning for the delivery of community mental health services has evolved from models of services within individual agencies to community-wide systems of care, but development of methodologies for assessing system performance has lagged behind. This article presents one approach to system-level assessment by viewing children's mental health systems as an interorganizational network. Data are presented on two county-based child mental health systems in North Carolina that participated in the Robert Wood Johnson Foundation Mental Health Services Program for Youth. Site-specific data on client referrals, fund exchanges, and information flows were collected at two time points (1991 and 1993) to measure the cohesiveness and concentration of the service system using network k-core analyses. In addition, stakeholder ratings of service adequacy, quality, availability, coordination, and overall demonstration project goal attainment were obtained at both time periods. Findings indicate that the rural system was outperforming the urban system at the time of the first survey, but the urban system caught up over the study interval. There was high agreement between the network and stakeholder ratings of system performance at both time periods. The method of data collection and analysis used in this study provides tools that can be used in a variety of settings to assess service system growth and development.