Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Dec;44(6):701-708.
doi: 10.1007/s40596-020-01234-9. Epub 2020 May 22.

Assessing Residents' Skills in Psychiatric Reasoning: the Tufts Test of Formulation and Treatment Planning

Edward K Silberman  1 , Saradha Ramesh  2 , David Adler  2 , John Sargent  2 , Timothy Moore  3 , Maria Blanco  2
Affiliations

Assessing Residents' Skills in Psychiatric Reasoning: the Tufts Test of Formulation and Treatment Planning

Edward K Silberman et al. Acad Psychiatry. 2020 Dec.

Abstract

Objective: The authors aimed to develop an easily administered and scored written test of clinical reasoning for psychiatry residents and to explore its internal reliability and correlation with parameters of training.

Methods: The authors developed a case-based, multiple-choice test comprising 83 questions related to data gathering and interpretation, diagnosis, hypothesis generation and testing, and treatment planning. Postgraduate years 1-4 residents at 18 diverse residency programs, along with their Program Directors and/or Associate Program Directors, took the test. Outcome measures included internal reliability statistics, performance across levels of training, performance in different test categories, performance in programs with high vs. low emphasis on integrative case formulation, and performance in native English speakers vs. others.

Results: A total of 359 residents and 23 faculty members participated. The KR-20 statistic of 0.78 indicated that the test was internally reliable. Faculty performed better than residents, who began to approach faculty level only in their fourth year. Residents in programs with high emphasis on formulation and treatment planning tended to score better than those from low emphasis programs on hypothesis generation and testing, but not other categories of question. There was no evidence that non-native English speakers were at a disadvantage on the test.

Conclusions: A novel test of formulation and treatment planning has met criteria for internal reliability and provided preliminary data about development of reasoning skills in residents. The authors hope that taking and discussing it will also be useful as a training exercise in integrative case formulation.

Keywords: Assessment; Clinical reasoning; Residents; Training.

PubMed Disclaimer

References

    1. McClain T, O’Sullivan PS, Clardy J. Biopsychosocial formulation: educational shortcomings. Acad Psychiatry. 2004;28(2):88–94. - DOI
    1. Miresco MJ, Kirmayer LJ. The persistence of mind-brain dualism in psychiatric reasoning about clinical scenarios. Am J Psychiatry. 2006;163(5):913–8. - DOI
    1. Mirowsky J, Ross C. Psychiatric diagnosis as reified measurement. J Health & Social Behavior. 1989;30:11–25. - DOI
    1. Larsen DP, Butler AC, Lawson AL, Roediger HL. The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledge. Adv in Health Sci Educ. 2012;18:409–25. https://doi.org/10.1007/s10459-012-9379-7 . - DOI
    1. Fitzhenry-Coor I, Nurcombe B. Assessing clinical reasoning: the development of a new test in psychiatric education. J Psychiatric Educ. 1983;7:183–96.

LinkOut - more resources