Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)
- PMID: 35854385
- PMCID: PMC9295535
- DOI: 10.1186/s13012-022-01222-7
Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)
Abstract
Background: Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. Implementation leadership behaviors may vary significantly across contexts, necessitating studies that examine the validity of established measurement tools in novel health service delivery sectors. The education sector is the most common site for delivering mental health services to children and adolescents in the USA, but research focused on implementation leadership in schools is in the early phases, and there is a need for adaptation and expansion of instruments in order to tailor to the school context. The current study adapted and validated the School Implementation Leadership Scale (SILS) (based on the Implementation Leadership Scale) in a sample of elementary school personnel from six school districts who were implementing one of two well-established prevention programs for supporting children's mental health.
Methods: Participants were 441 public school teachers from 52 elementary schools in the Midwest and West Coast of the USA. Participants completed a survey that contained: (1) an adapted and expanded version of the SILS with additional items generated for four existing subscales as well as three new subscales (communication, vision/mission, and availability), and (2) additional tools to evaluate convergent and divergent validity (i.e., measures of general/molar leadership and teaching attitudes). Data underwent (1) examination of item characteristic curves to reduce items and ensure a pragmatic instrument, (2) confirmatory factor analyses to establish structural validity, and (3) evaluation of convergent and divergent validity.
Results: Item reduction analyses resulted in seven subscales of three items each. Results indicated acceptable fit for a seven-factor structural model (CFI = .995, TLI = .99, RMSEA = .07, SRMR = 0.02). Second-order factor loadings were high (λ = .89 to .96), suggesting that the SILS subscales comprise a higher-order implementation leadership factor. All subscales demonstrated good inter-item reliability (α = .91-.96). Convergent and divergent validity results were generally as hypothesized, with moderate to high correlations between SILS subscales and general leadership, moderate correlations with teaching attitudes, and low correlations with school demographics.
Conclusions: Overall, results provided strong structural, convergent, and divergent validity evidence for the 21-item, 7-factor SILS instrument. Implications for the measurement of implementation leadership in schools are discussed, as well as strategies to support leaders to enhance their strategic behaviors related to the implementation of mental health prevention programs (e.g., adaptation of existing leadership-focused implementation strategies).
Keywords: Education; Implementation leadership; Measurement; Mental health; Prevention.
© 2022. The Author(s).
Conflict of interest statement
GAA is an Associate Editor of Implementation Science. All decisions on this paper were made by another editor. The authors declare that they have no competing interests.
Figures
Similar articles
-
"Going above and beyond" for implementation in the education sector: extension and validation of the School Implementation Citizenship Behavior Scale (SICBS).Implement Sci Commun. 2025 May 26;6(1):64. doi: 10.1186/s43058-025-00748-3. Implement Sci Commun. 2025. PMID: 40420241 Free PMC article.
-
Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship.Implement Sci. 2018 Jan 8;13(1):5. doi: 10.1186/s13012-017-0705-6. Implement Sci. 2018. PMID: 29310673 Free PMC article.
-
Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants.Implement Sci. 2018 Aug 22;13(1):116. doi: 10.1186/s13012-018-0804-z. Implement Sci. 2018. PMID: 30134943 Free PMC article.
-
[Psychometric characteristics of questionnaires designed to assess the knowledge, perceptions and practices of health care professionals with regards to alcoholic patients].Encephale. 2004 Sep-Oct;30(5):437-46. doi: 10.1016/s0013-7006(04)95458-9. Encephale. 2004. PMID: 15627048 Review. French.
-
Validity evaluation of the Health Information Preferences Questionnaire among college students.Front Public Health. 2024 Mar 27;12:1249621. doi: 10.3389/fpubh.2024.1249621. eCollection 2024. Front Public Health. 2024. PMID: 38601501 Free PMC article. Review.
Cited by
-
Effective School Leadership for Supporting Students' Mental Health: Findings from a Narrative Literature Review.Behav Sci (Basel). 2025 Jan 1;15(1):36. doi: 10.3390/bs15010036. Behav Sci (Basel). 2025. PMID: 39851840 Free PMC article. Review.
-
Protocol for a hybrid type 3 effectiveness-implementation trial of a pragmatic individual-level implementation strategy for supporting school-based prevention programming.Implement Sci. 2024 Jan 2;19(1):2. doi: 10.1186/s13012-023-01330-y. Implement Sci. 2024. PMID: 38167046 Free PMC article.
-
"On an island by myself": implications for the inclusion of autistic students in self-contained classrooms in public elementary schools.Front Psychiatry. 2023 Sep 26;14:1241892. doi: 10.3389/fpsyt.2023.1241892. eCollection 2023. Front Psychiatry. 2023. PMID: 37829762 Free PMC article.
-
Not getting better but not getting worse: A cluster randomized controlled pilot trial of a leadership implementation strategy.Implement Res Pract. 2025 Jan 29;6:26334895241312405. doi: 10.1177/26334895241312405. eCollection 2025 Jan-Dec. Implement Res Pract. 2025. PMID: 39881952 Free PMC article.
-
Individual and organizational factors as predictors of early evidence-based practice adoption in Michigan high schools: Baseline data from an implementation trial.Implement Res Pract. 2023 Mar 27;4:26334895231159429. doi: 10.1177/26334895231159429. eCollection 2023 Jan-Dec. Implement Res Pract. 2023. PMID: 37091540 Free PMC article.
References
-
- Duong MT, Bruns EJ, Lee K, Cox S, Coifman J, Mayworm A, et al. Rates of mental health service utilization by children and adolescents in schools and other common service settings: a systematic review and meta-analysis. Admin Pol Ment Health. 2021;48(3):420–439. doi: 10.1007/s10488-020-01080-9. - DOI - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Miscellaneous