Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Aug 4:3:26334895221116065.
doi: 10.1177/26334895221116065. eCollection 2022 Jan-Dec.

Construct validity of the school-implementation climate scale

Andrew J Thayer  1 , Clayton R Cook  2 , Chayna Davis  3 , Eric C Brown  4 , Jill Locke  3 , Mark G Ehrhart  5 , Gregory A Aarons  6 , Elissa Picozzi  3 , Aaron R Lyon  3
Affiliations

Construct validity of the school-implementation climate scale

Andrew J Thayer et al. Implement Res Pract. .

Abstract

Background: Implementation climate is an organizational construct theorized to facilitate the adoption and delivery of evidence-based practices. Within schools, teachers often are tasked with implementing universal prevention programs. Therefore, they are ideal informants when assessing school implementation climate for initial and continuous implementation improvement efforts. The purpose of this study was to examine the construct validity (i.e., factor structure and convergent/divergent validity) of a school-adapted measure of strategic implementation climate called the School Implementation Climate Scale (SICS).

Methods: Confirmatory factor analyses of SICS data, collected from 441 teachers in 52 schools, were used to compare uncorrelated and correlated first-order factor models and a second-order hierarchical model. Correlations with other school measures were examined to assess SICS convergent and divergent validities.

Results: Results demonstrated acceptable internal consistency for each SICS subscale (αs > 0.80 for all subscales) and construct validity of the hypothesized factor structure of the SICS with three new scales. The hierarchical second-order factor structure with eight first-order factors was found to best model the SICS data. Correlations with other school measures were in the expected direction and magnitude.

Conclusions: Results from this study provide psychometric evidence that supports the use of the SICS to inform the implementation research and practice in schools.

Plain language summary: Schools are busy trying to implement various universal programs and systems to help support kids in their growth. Beginning and sustaining these efforts is quite challenging, and there is need for tools and ideas to help those implementation efforts. One concept is implementation climate, which is broadly the school staff's perception of the implementation support for a given practice. However, no measure currently exists to help schools assess their implementation climate. The goal of our study was to adapt a measure of implementation climate used in other settings to the school environment. We used feedback from educational experts to make changes and used various analyses to determine if the newly adapted measure was psychometrically sound. Findings suggest the new measure is usable to guide implementation efforts in schools.

Keywords: evidence-based practices; implementation climate; organizational climate; schools.

PubMed Disclaimer

Conflict of interest statement

The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr. Aaron Lyon is an Associate Editor of Implementation Research and Practice, and thus Dr. Lyon was not involved in any aspect of the peer review process for this manuscript.

Figures

Figure 1.
Figure 1.
Factor loadings and fit statistics of the final first-order factor only measurement model.
Figure 2.
Figure 2.
Factor loadings and fit statistics of the final second-order composite factor measurement model.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Aarons G. A. (2017). Preliminary cohort 1 findings for the leadership and organizational change for implementation (LOCI) strategy. Addiction health services research conference (AHSR).
    1. Aarons G. A., Hurlburt M., Horwitz S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. 10.1007/s10488-010-0327-7 - DOI - PMC - PubMed
    1. Act E. S. S. (2015). Every student succeeds act (ESSA). Pub. L, 114–95.
    1. Bevans K., Bradshaw C., Miech R., Leaf P. (2007). Staff- and school-level predictors of school organizational health: A multilevel analysis. Journal of School Health, 77(6), 294–302. 10.1111/j.1746-1561.2007.00210.x - DOI - PubMed
    1. Bollen K. A., Long J. S. (eds.). (1993). Testing structural equation models. Sage Publications.