Consensus design of a calibration experiment for human fear conditioning

Dominik R Bach¹, Juliana Sporrer², Rany Abend³, Tom Beckers⁴, Joseph E Dunsmoor⁵, Miquel A Fullana⁶, Matthias Gamer⁷, Dylan G Gee⁸, Alfons Hamm⁹, Catherine A Hartley¹⁰, Ryan J Herringa¹¹, Tanja Jovanovic¹², Raffael Kalisch¹³, David C Knight¹⁴, Shmuel Lissek¹⁵, Tina B Lonsdorf¹⁶, Christian J Merz¹⁷, Mohammed Milad¹⁸, Jayne Morriss¹⁹, Elizabeth A Phelps²⁰, Daniel S Pine³, Andreas Olsson²¹, Carien M van Reekum¹⁹, Daniela Schiller²²

Affiliations

¹ Wellcome Centre for Human Neuroimaging and Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, United Kingdom; Hertz Chair for Artificial Intelligence and Neuroscience, Transdisciplinary Research Area "Life & Health", University of Bonn, Germany. Electronic address: d.bach@uni-bonn.de.
² Wellcome Centre for Human Neuroimaging and Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, United Kingdom.
³ National Institute of Mental Health Intramural Research Program, Bethesda, MD, USA.
⁴ KU Leuven, Faculty of Psychology and Educational Sciences/Leuven Brain Institute, Leuven, Belgium.
⁵ Department of Psychiatry and Behavioral Sciences, University of Texas at Austin, USA.
⁶ Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), CIBERSAM, & Adult Psychiatry and Psychology Department, Institute of Neurosciences, Hospital Clínic, Barcelona, Spain.
⁷ Julius-Maximilians-University of Würzburg, Department of Psychology, Würzburg, Germany.
⁸ Yale University, Department of Psychology, New Haven, CT, USA.
⁹ Department of Psychology, University of Greifswald, Germany.
¹⁰ New York University, Department of Psychology, New York, NY, USA.
¹¹ Department of Psychiatry, University of Wisconsin School of Medicine & Public Health, USA.
¹² Department of Psychiatry and Behavioral Neurosciences, Wayne State University, Detroit, MI, USA.
¹³ Neuroimaging Center (NIC), Focus Program Translational Neuroscience (FTN), Johannes Gutenberg University Medical Center, Mainz, Germany; and Leibniz Institute for Resilience Research (LIR), Mainz, Germany.
¹⁴ University of Alabama at Birmingham, Department of Psychology, Birmingham, AL, USA.
¹⁵ Clinical Science and Psychopathology Research Program, Department of Psychology, University of Minnesota, Minneapolis, MN, USA.
¹⁶ University Medical Center Hamburg-Eppendorf, Institute of Systems Neuroscience, Hamburg, Germany.
¹⁷ Ruhr University Bochum, Faculty of Psychology, Institute of Cognitive Neuroscience, Department of Cognitive Psychology, Bochum, Germany.
¹⁸ Department of Psychiatry and Neuroscience Institute, NYU Grossman School of Medicine, New York, NY, USA; The Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, USA.
¹⁹ School of Psychology and Clinical Language Sciences, University of Reading, United Kingdom.
²⁰ Department of Psychology, Harvard University, 52 Oxford St., Cambridge, MA, USA.
²¹ Karolinska Institutet, Department of Clinical Neuroscience, Division of Psychology, Stockholm, Sweden.
²² Friedman Brain Institute, Department of Neuroscience, Department of Psychiatry, Icahn School of Medicine at Mt. Sinai, New York, NY, USA.

PMID: 36990370
PMCID: PMC10618407
DOI: 10.1016/j.neubiorev.2023.105146

Review

Consensus design of a calibration experiment for human fear conditioning

Dominik R Bach et al. Neurosci Biobehav Rev. 2023 May.

. 2023 May:148:105146.

doi: 10.1016/j.neubiorev.2023.105146. Epub 2023 Mar 27.

Authors

Affiliations

¹ Wellcome Centre for Human Neuroimaging and Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, United Kingdom; Hertz Chair for Artificial Intelligence and Neuroscience, Transdisciplinary Research Area "Life & Health", University of Bonn, Germany. Electronic address: d.bach@uni-bonn.de.
² Wellcome Centre for Human Neuroimaging and Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, United Kingdom.
³ National Institute of Mental Health Intramural Research Program, Bethesda, MD, USA.
⁴ KU Leuven, Faculty of Psychology and Educational Sciences/Leuven Brain Institute, Leuven, Belgium.
⁵ Department of Psychiatry and Behavioral Sciences, University of Texas at Austin, USA.
⁶ Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), CIBERSAM, & Adult Psychiatry and Psychology Department, Institute of Neurosciences, Hospital Clínic, Barcelona, Spain.
⁷ Julius-Maximilians-University of Würzburg, Department of Psychology, Würzburg, Germany.
⁸ Yale University, Department of Psychology, New Haven, CT, USA.
⁹ Department of Psychology, University of Greifswald, Germany.
¹⁰ New York University, Department of Psychology, New York, NY, USA.
¹¹ Department of Psychiatry, University of Wisconsin School of Medicine & Public Health, USA.
¹² Department of Psychiatry and Behavioral Neurosciences, Wayne State University, Detroit, MI, USA.
¹³ Neuroimaging Center (NIC), Focus Program Translational Neuroscience (FTN), Johannes Gutenberg University Medical Center, Mainz, Germany; and Leibniz Institute for Resilience Research (LIR), Mainz, Germany.
¹⁴ University of Alabama at Birmingham, Department of Psychology, Birmingham, AL, USA.
¹⁵ Clinical Science and Psychopathology Research Program, Department of Psychology, University of Minnesota, Minneapolis, MN, USA.
¹⁶ University Medical Center Hamburg-Eppendorf, Institute of Systems Neuroscience, Hamburg, Germany.
¹⁷ Ruhr University Bochum, Faculty of Psychology, Institute of Cognitive Neuroscience, Department of Cognitive Psychology, Bochum, Germany.
¹⁸ Department of Psychiatry and Neuroscience Institute, NYU Grossman School of Medicine, New York, NY, USA; The Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, USA.
¹⁹ School of Psychology and Clinical Language Sciences, University of Reading, United Kingdom.
²⁰ Department of Psychology, Harvard University, 52 Oxford St., Cambridge, MA, USA.
²¹ Karolinska Institutet, Department of Clinical Neuroscience, Division of Psychology, Stockholm, Sweden.
²² Friedman Brain Institute, Department of Neuroscience, Department of Psychiatry, Icahn School of Medicine at Mt. Sinai, New York, NY, USA.

PMID: 36990370
PMCID: PMC10618407
DOI: 10.1016/j.neubiorev.2023.105146

Abstract

Fear conditioning is a widely used laboratory model to investigate learning, memory, and psychopathology across species. The quantification of learning in this paradigm is heterogeneous in humans and psychometric properties of different quantification methods can be difficult to establish. To overcome this obstacle, calibration is a standard metrological procedure in which well-defined values of a latent variable are generated in an established experimental paradigm. These intended values then serve as validity criterion to rank methods. Here, we develop a calibration protocol for human fear conditioning. Based on a literature review, series of workshops, and survey of N = 96 experts, we propose a calibration experiment and settings for 25 design variables to calibrate the measurement of fear conditioning. Design variables were chosen to be as theory-free as possible and allow wide applicability in different experimental contexts. Besides establishing a specific calibration procedure, the general calibration process we outline may serve as a blueprint for calibration efforts in other subfields of behavioral neuroscience that need measurement refinement.

Keywords: Calibration design; Experiment-based calibration; Experimental design; Human fear conditioning; Measurement theory; Metrology; Multi-laboratory consensus.

PubMed Disclaimer

Figures

**Fig. 1**
Illustration of the calibration approach. An established experimental procedure is used to generate true values of a latent attribute, which are measured with some measurement error. Ranking measurements by their retrodictive validity corresponds to their ranking by measurement error.

**Fig. 2**
Illustration of the consensus process. Fundamental questions and survey options were decided in a steering committee, and then the wider expert community was surveyed about the validity conditions and other design variables. The calibration design was finalized by the steering committee.

**Fig. 3**
Illustration of the proposed calibration experiment.

**Fig. 4**
Preferred type of instructions (left) and reinforcement rate (right) was heterogeneous in the surveyed expert community.

See this image and copyright information in PMC

References

1. AERA (Joint Committee on the Standards for Educational and Psychological Testing of the American Educational Research Association, t. A. P. A., and the National Council on Measurement in Education). (2014). The Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association.
1. Alexander D.M., Trengove C., Johnston P., Cooper T., August J.P., Gordon E. Separating individual skin conductance responses in a short interstimulus-interval paradigm. J. Neurosci. Methods. 2005;146(1):116–123. doi: 10.1016/j.jneumeth.2005.02.001. - DOI - PubMed
1. Alonso E., Schmajuk N. Special issue on computational models of classical conditioning guest editors' introduction. Learn. Behav. 2012;40(3):231–240. doi: 10.3758/s13420-012-0081-7. - DOI - PubMed
1. Atlas L.Y., Sandman C.F., Phelps E.A. Rating expectations can slow aversive reversal learning. Psychophysiology. 2021 doi: 10.1111/psyp.13979. - DOI - PMC - PubMed
1. Bach D.R. Calibration in experimental psychology: designing optimal calibration experiments. Pre-Print. 2021 doi: 10.31234/osf.io/xa8mv. - DOI

Publication types

Actions
Actions
Actions
Actions

MeSH terms

Actions
Actions
Actions
Actions

Grants and funding

LinkOut - more resources

Full Text Sources

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Consensus design of a calibration experiment for human fear conditioning

Affiliations

Consensus design of a calibration experiment for human fear conditioning

Authors

Affiliations

Abstract

Figures

References

Publication types

MeSH terms

Grants and funding

LinkOut - more resources

Full Text Sources