Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2016 May;43(3):410-25.
doi: 10.1007/s10488-015-0647-8.

Implementing a Measurement Feedback System: A Tale of Two Sites

Leonard Bickman  1 , Susan R Douglas  2 , Ana Regina Vides De Andrade  2 , Michele Tomlinson  3 , Alissa Gleacher  4 , Serene Olin  4 , Kimberly Hoagwood  4
Affiliations
Randomized Controlled Trial

Implementing a Measurement Feedback System: A Tale of Two Sites

Leonard Bickman et al. Adm Policy Ment Health. 2016 May.

Abstract

A randomized experiment was conducted in two outpatient clinics evaluating a measurement feedback system called contextualized feedback systems. The clinicians of 257 Youth 11-18 received feedback on progress in mental health symptoms and functioning either every 6 months or as soon as the youth's, clinician's or caregiver's data were entered into the system. The ITT analysis showed that only one of the two participating clinics (Clinic R) had an enhanced outcome because of feedback, and only for the clinicians' ratings of youth symptom severity on the SFSS. A dose-response effect was found only for Clinic R for both the client and clinician ratings. Implementation analyses showed that Clinic R had better implementation of the feedback intervention. Clinicians' questionnaire completion rate and feedback viewing at Clinic R were 50 % higher than clinicians at Clinic U. The discussion focused on the differences in implementation at each site and how these differences may have contributed to the different outcomes of the experiment.

Keywords: Contextualized feedback systems (CFS); Implementation analysis; Measurement feedback system (MFS); Peabody treatment progress battery (PTPB); Routine outcome measurement (ROM); Symptoms and functioning severity scale (SFSS); Youth mental health services outcomes.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Distribution of Youth’s implementation index in Clinic U (left panel) and Clinic R (right panel)
See this image and copyright information in PMC

References

    1. American Psychological Association (APA) Presidential Task Force on Evidence-Based Practice. Evidence-based practice in psychology. American Psychologist. 2006;61(4):271–285. - PubMed
    1. Arco L. Improving program outcome with process-based feedback. Journal of Organizational Behavior Management. 1997;17(1):37–64.
    1. Arco L. Feedback for improving staff training and performance in behavioral treatment programs. Behavioral Interventions. 2008;23(1):39–64.
    1. Athay MM, Riemer M, Bickman L. The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Differences of Youth, Caregiver, and Clinician Ratings over Time. Administration and Policy in Mental Health and Mental Health Services Research. 2012;39(1–2):13–29. - PMC - PubMed
    1. Baumberger BK. Understanding and promoting treatment integrity. In: Hagermoser Sanetti LM, Kratochwill TR, editors. Treatment integrity: A foundation for evidence-based practice in applied psychology. Washington, DC: American Psychological Association; 2014. pp. 35–54.

Publication types