Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jul;47(7):395-400.
doi: 10.1136/rapm-2021-103331. Epub 2022 Apr 1.

Why science is less scientific than we think (and what to do about it): The 2022 Gaston Labat Award Lecture

Affiliations

Why science is less scientific than we think (and what to do about it): The 2022 Gaston Labat Award Lecture

Brian M Ilfeld. Reg Anesth Pain Med. 2022 Jul.
No abstract available

Keywords: health care; methods; outcome assessment; pain measurement; pain perception; treatment outcome.

PubMed Disclaimer

Conflict of interest statement

Competing interests: The University of California has received funding and product for Dr. Ilfeld’s research from Epimed International (Farmers Branch, TX); Avanos (Irvine, CA); Infutronics (Natick, MA); and SPR Therapeutics (Cleveland, OH).

Figures

Figure 1
Figure 1
An example of a torpedo fish which can produce electrical current of up to 220 volts.
Figure 2
Figure 2
An example of an ‘anchor-based’ method to determine the smallest improvement in analgesia that individual patients consider relevant or important.
Figure 3
Figure 3
An example of the problem extrapolating the smallest change that is important to individual patients to the evaluation of group differences. This example is simplified to convey the general concept—reality is (unfortunately) more complex.
Figure 4
Figure 4
]Visual representation of joint hypothesis testing and a parallel gatekeeping procedure. Gatekeeping permits statistical comparisons of many variables while retaining a study-wide type I error at a 0.05, increasing confidence in all comparisons and aiding interpretation and generalization of the results. In this example, the study outcomes are prospectively prioritized into three ordered sets. On study conclusion, statistical testing proceeds through each ‘gate’ to the next set if and only if at least one outcome in the current set reached significance. The significance level for each set will be 0.05 times a cumulative penalty for non-significant results in previous sets (ie, a ‘rejection gain factor’ equal to the cumulative product of the proportion of significant tests across the preceding sets). Within a set, a multiple comparison procedure (Bonferroni correction) is used to control the type I error at the appropriate level, if needed. Adapted from a grant proposal coauthored with Edward Mascha, PhD (Departments of Quantitative Health Sciences and Outcomes Research, Cleveland Clinic, Cleveland, Ohio, USA).
Figure 5
Figure 5
Examples of various presentation formats of the same dataset. Study participants included adult patients with postamputation phantom limb pain who all received a single-injection peripheral nerve block with ropivacaine and a perineural catheter(s). Participants were randomized to receive 6 days of either perineural ropivacaine or normal saline, and the primary outcome measure was the improvement in the average pain score queried 4 weeks following infusion initiation as measured using a 0–10 Numeric Rating Scale. Note that the combination of information improves interpretation of the results, and different formats may be valuable to differing stakeholders such as clinicians, patients, administrators, and other researchers. Adapted from Ilfeld et al. Some results are preliminary and should be used for demonstration purposes only (final analysis currently in preparation).

References

    1. Anstie FE. Stimulants and narcotics. Philadelphia: Lindsay and Blakiston, 1865.
    1. Stillings D. A survey of the history of electrical stimulation for pain to 1900. Med Instrum 1975;9:255–9. - PubMed
    1. Dworkin RH, Turk DC, Wyrwich KW, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain 2008;9:105–21. 10.1016/j.jpain.2007.09.005 - DOI - PubMed
    1. Cella D, Bullinger M, Scott C, et al. Group vs individual approaches to understanding the clinical significance of differences or changes in quality of life. Mayo Clin Proc 2002;77:384–92. 10.4065/77.4.384 - DOI - PubMed
    1. Chin KJ. Erector spinae plane and paravertebral blocks have similar opioid-sparing effects following breast surgery. Reg Anesth Pain Med 2020:rapm-2020-101365:940–1. 10.1136/rapm-2020-101365 - DOI - PubMed

LinkOut - more resources