Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Mar;39(1):7-18.
doi: 10.1037/fsh0000590.

Implementation methodology from a social systems informatics and engineering perspective applied to a parenting training program

Carlos G Gallo  1 , Cady Berkel  2 , Anne Mauricio  3 , Irwin Sandler  3 , Sharlene Wolchik  3 , Juan A Villamar  1 , Sanjay Mehrotra  4 , C Hendricks Brown  1
Affiliations

Implementation methodology from a social systems informatics and engineering perspective applied to a parenting training program

Carlos G Gallo et al. Fam Syst Health. 2021 Mar.

Abstract

Objective: For implementation of an evidence-based program to be effective, efficient, and equitable across diverse populations, we propose that researchers adopt a systems approach that is often absent in efficacy studies. To this end, we describe how a computer-based monitoring system can support the delivery of the New Beginnings Program (NBP), a parent-focused evidence-based prevention program for divorcing parents.

Method: We present NBP from a novel systems approach that incorporates social system informatics and engineering, both necessary when utilizing feedback loops, ubiquitous in implementation research and practice. Examples of two methodological challenges are presented: how to monitor implementation, and how to provide feedback by evaluating system-level changes due to implementation.

Results: We introduce and relate systems concepts to these two methodologic issues that are at the center of implementation methods. We explore how these system-level feedback loops address effectiveness, efficiency, and equity principles. These key principles are provided for designing an automated, low-burden, low-intrusive measurement system to aid fidelity monitoring and feedback that can be used in practice.

Discussion: As the COVID-19 pandemic now demands fewer face-to-face delivery systems, their replacement with more virtual systems for parent training interventions requires constructing new implementation measurement systems based on social system informatics approaches. These approaches include the automatic monitoring of quality and fidelity in parent training interventions. Finally, we present parallels of producing generalizable and local knowledge bridging systems science and engineering method. This comparison improves our understanding of system-level changes, facilitates a program's implementation, and produces knowledge for the field. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

PubMed Disclaimer

Figures

Figure 1.
Figure 1.
Four Feedback Mechanisms involving Inputs, Processes, Outputs, and Outcomes
Figure 2.
Figure 2.
Conceptual model on how a machine rater can monitor program delivery
Figure 3.
Figure 3.
Dynamic Implementation Monitoring and Feedback System Using Empirically Supported Indicators of Implementation
Figure 4.
Figure 4.
Comparison between the scientific and engineering problem solving
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Aarons GA, Sklar M, Mustanski B, Benbow N, & Brown CH (2017, Sep 6). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems [journal article]. Implementation Science, 12(1), 111. 10.1186/s13012-017-0640-6 - DOI - PMC - PubMed
    1. Atkins DC, Steyvers M, Imel ZE, & Smyth P. (2014). Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implementation Science, 9, 49. 10.1186/1748-5908-9-49 - DOI - PMC - PubMed
    1. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, & Stroup DF (1996, Aug 28). Improving the quality of reporting of randomized controlled trials: the CONSORT statement. Jama, 276(8), 637–639. 10.1001/jama.1996.03540080059030 - DOI - PubMed
    1. Berkel C, Gallo CG, Sandler IN, Brown CH, Wolchik S, & Mauricio AM (2015, December 15, 2015). Identifying indicators of implementation quality for computer-based ratings 8th Annual Conference on the Science of Dissemination and Implementation, Washington, DC. https://academyhealth.confex.com/academyhealth/2015di/meetingapp.cgi/Pap...
    1. Berkel C, Gallo CG, Sandler IN, Mauricio AM, Smith JD, & Brown CH (2019, Feb). Redesigning Implementation Measurement for Monitoring and Quality Improvement in Community Delivery Settings. Journal of Primary Prevention, 40(1), 111–127. 10.1007/s10935-018-00534-z - DOI - PMC - PubMed

Publication types