Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Apr 1;45(2):89-100.
doi: 10.1097/CEH.0000000000000572. Epub 2024 Aug 14.

Project Extension for Community Healthcare Outcomes Intervention Evaluations: A Scoping Review of Research Methods

Jennifer Maizel  1 , Stephanie L Filipp, Gaia Zori, Sandhya Yadav, Kishan Avaiya, Lauren Figg, Melanie Hechavarria, Xanadu Roque, Claudia Anez-Zabala, Rayhan Lal, Ananta Addala, Michael J Haller, David M Maahs, Ashby F Walker
Affiliations

Project Extension for Community Healthcare Outcomes Intervention Evaluations: A Scoping Review of Research Methods

Jennifer Maizel et al. J Contin Educ Health Prof. .

Abstract

Introduction: Since its inception in 2003, the Project Extension for Community Healthcare Outcomes (ECHO) tele-education model has reached and improved outcomes for patients, providers, and health centers through interventions in >180 countries. Utilization of this model has recently increased due to the COVID-19 pandemic and a higher demand for remote education. However, limited research has examined the methodologies used to evaluate Project ECHO interventions.

Methods: We conducted a scoping review to determine the extent and types of research methods used to evaluate outcomes and implementation success of Project ECHO interventions and to identify gaps and opportunities for future investigation. Using Arksey and O'Malley's scoping review framework and the PRISMA-ScR checklist, we reviewed study designs, temporality, analysis methods, data sources, and levels and types of data in 121 articles evaluating Project ECHO interventions.

Results: Most interventions addressed substance use disorders (24.8%, n = 30), infectious diseases (24%, n = 29), psychiatric and behavioral health conditions (21.5%, n = 26), and chronic diseases (19%, n = 23). The most frequently reported evaluation methods included cohort studies (86.8%, n = 105), longitudinal designs (74.4%, n = 90), mixed methods analysis (52.1%, n = 63), surveys (61.2%, n = 74), process evaluation measures (98.3%, n = 119), and provider-level outcome measures (84.3%, n = 102). Few evaluations used experimental designs (1.7%, n = 2), randomization (5.8%, n = 7), or comparison groups (14%, n = 17), indicating limited rigor.

Discussion: This scoping review demonstrates the need for more rigorous evaluation methods to test the effectiveness of the Project ECHO model at improving outcomes and standardized reporting guidelines to enhance the dissemination of evaluation data from future Project ECHO interventions.

Keywords: continuing education; digital health; health education; medical education; telehealth.

PubMed Disclaimer

Conflict of interest statement

Disclosures: The authors declare no conflict of interest.

References

    1. Health Resources & Services Adminstration. What is Telehealth? 2022. Available at: https://www.hrsa.gov/telehealth/what-is-telehealth . Accessed June 11, 2024.
    1. Centers for Disease Control and Prevention National Center for Health Statistics. Telemedicine Use Among Adults: United States; 2021. NCHS Data Brief 2022. Available at: https://www.cdc.gov/nchs/products/databriefs/db445.htm . Accessed January 24, 2024.
    1. Curran VR. Tele-education. J Telemed Telecare. 2006;12:57–63.
    1. Franciosi EB, Tan AJ, Kassamali B, et al. The impact of telehealth implementation on underserved populations and no-show rates by medical specialty during the COVID-19 pandemic. Telemed J E Health. 2021;27:874–880.
    1. Schulte TL, Gröning T, Ramsauer B, et al. Impact of COVID-19 on continuing medical education-results of an online survey among users of a non-profit multi-specialty live online education platform. Front Med (Lausanne). 2021;8:773806.

Publication types

LinkOut - more resources