Response to Toshihide Tsuda, Yumiko Miyano and Eiji Yamamoto [1]

Abstract

Background: In August 2021, we published in Environmental Health a Toolkit for detecting misused epidemiological methods with the goal of providing an organizational framework for transparently evaluating epidemiological studies, a body of evidence, and resultant conclusions. Tsuda et al., the first group to utilize the Toolkit in a systematic fashion, have offered suggestions for its modification.

Main body: Among the suggested modifications made by Tsuda et al., we agree that rearrangement of Part A of the Toolkit to reflect the sequence of the epidemiological study process would facilitate its usefulness. Expansion or adaptation of the Toolkit to other disciplines would be valuable but would require the input of discipline-specific expertise. We caution against using the sections of the Toolkit to produce a tally or cumulative score, because none of the items are weighted as to importance or impact. Rather, we suggest a visual representation of how a study meets the Toolkit items, such as the heat maps used to present risk of bias criteria for studies included in Cochrane reviews. We suggest that the Toolkit be incorporated in the sub-specialty known as "forensic epidemiology," as well as in graduate training curricula, continuing education programs, and conferences, with the recognition that it is an extension of widely accepted ethics guidelines for epidemiological research.

Conclusion: We welcome feedback from the research community about ways to strengthen the Toolkit as it is applied to a broader assemblage of research studies and disciplines, contributing to its value as a living tool/instrument. The application of the Toolkit by Tsuda et al. exemplifies the usefulness of this framework for transparently evaluating, in a systematic way, epidemiological research, conclusions relating to causation, and policy decisions.

Postscript: We note that our Toolkit has, most recently, inspired authors with discipline-specific expertise in the field of Conservation Biology to adapt it for use in the Biological Sciences.

Keywords: Biological sciences; Epidemiological methods; Ethics guidelines; Evaluation; Forensic epidemiology; Misuse; Risk of bias; Systematic framework; Toolkit; Transparency.