Evaluating the Wellness School Assessment Tool for use in public health practice to improve school nutrition and physical education policies in New York

Abstract

Background: Addressing the limitations of existing Local Wellness Policies (LWPs) and promoting their implementation remain priorities for health and education agencies. One gap has been the absence of a standard assessment to support LWP revision. During planning for an initiative to improve school nutrition and physical education policy, the Wellness School Assessment Tool (WellSAT) was evaluated.

Methods: Five public health practitioners used WellSAT to assess 50 LWPs. A randomized, counterbalanced design ensured each LWP was coded twice by separate raters. Models evaluated the extent to which WellSAT ratings reflected differences in the LWPs and order, familiarity and rater effects. During field testing, 18 public health practitioners used WellSAT as part of a statewide public health initiative.

Results: In pilot testing the majority of the variability in WellSAT scores (median = 88%; range = 76% to 100%) was attributable to differences between policies. Correlations between independent raters' strength and comprehensiveness scores were strong, r = .88 and r = .77, respectively. During field testing, WellSAT was well accepted by public health practitioners and members of the school community.

Conclusions: WellSAT represents a reliable and feasible tool for health and education agencies to use in improving LWPs and aligning them with recognized standards.

Keywords: evaluation; health policy; public health.