A detailed examination of reporting procedural fidelity in the Journal of Applied Behavior Analysis
- PMID: 37572025
- DOI: 10.1002/jaba.1015
A detailed examination of reporting procedural fidelity in the Journal of Applied Behavior Analysis
Abstract
Few reviews on procedural fidelity-the degree to which procedures are implemented as designed-provide details to gauge the quality of fidelity reporting in behavior-analytic research. This review focused on experiments in the Journal of Applied Behavior Analysis (2006-2021) with "integrity" or "fidelity" in the abstract or body. When fidelity data were collected, the coders characterized measurement details (e.g., description of calculation, report of single or multiple values, frequency of fidelity checks, checklist use). The researchers found increasing trends in describing the calculation(s), reporting multiple values, and stating the frequency of measurement. Few studies described using a checklist. Most studies reported fidelity as a percentage, with high obtained values (M = 97%). When not collecting fidelity data was stated as a limitation, authors were unlikely to provide a rationale for the omission. We discuss recommendations for reporting procedural fidelity to increase the quality of and transparency in behavior-analytic research.
Keywords: adherence; fidelity; integrity; procedural integrity; treatment integrity.
© 2023 Society for the Experimental Analysis of Behavior (SEAB).
References
REFERENCES
-
- Bachman, J. E., & Fuqua, R. W. (1983). Management of inappropriate behaviors of trainable mentally impaired students using antecedent exercise. Journal of Applied Behavior Analysis, 16(4), 477-484. https://doi.org/10.1901/jaba.1983.16-477
-
- Barnett, D., Hawkins, R., McCoy, D., Wahl, E., Shier, A., Denune, H., & Kimener, L. (2014). Methods used to document procedural fidelity in school-based intervention research. Journal of Behavioral Education, 23(1), 89-107. https://doi.org/10.1007/s10864-013-9188-y
-
- Bergmann, S., Niland, H. S., Gavidia, V. L., Strum, M. D., & Harman, M. J. (2023). Comparing multiple methods to measure procedural fidelity of discrete-trial instruction. Education and Treatment of Children. Advance online publication. https://doi.org/10.1007/s43494-023-00094-w
-
- Brand, D., Elliffe, D., & DiGennaro Reed, F. D. (2018). Using sequential analysis to assess component integrity of discrete-trial teaching programs. European Journal of Behavior Analysis, 19(1), 30-47. https://doi.org/10.1080/15021149.2017.1404392
-
- Breeman, S., Vladescu, J. C., DeBar, R. M., Grow, L. L., & Marano, K. E. (2020). The effects of procedural integrity errors during auditory-visual conditional discrimination training: A preliminary investigation. Behavioral Interventions, 35(2), 203-216. https://doi.org/10.1002/bin.1710
LinkOut - more resources
Full Text Sources