Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Nov 15:389:119684.
doi: 10.1016/j.jad.2025.119684. Epub 2025 Jun 11.

Automatic quantification of hand gestures in current and remitted Major Depressive Disorder during oral expression

Juliette Lozano-Goupil  1 , Stewart A Shankman  2 , Sebastian Walther  3 , Florian Wuethrich  4 , Riley E Maher  5 , Lauren N Grzelak  5 , Vijay A Mittal  6
Affiliations

Automatic quantification of hand gestures in current and remitted Major Depressive Disorder during oral expression

Juliette Lozano-Goupil et al. J Affect Disord. .

Abstract

Nonverbal behavior plays a crucial role in social interactions and may provide insights into Major Depressive Disorder (MDD). While previous research suggests that hand gesture deficits are linked to depression, it remains unclear whether these deficits are state-dependent or persist beyond active illness. This study utilized an automated, video-based tool to quantify spontaneous hand gestures in individuals with current (cMDD) and remitted (rMDD) MDD during oral expression. A total of 145 participants (97 rMDD and 49 cMDD) completed a recorded gesture-elicitation task, and hand movement trajectories were extracted using video-based body tracking. Results revealed that individuals with current MDD exhibited significantly fewer gestures per minute compared to remitted individuals (p = .016, d = 0.38). Furthermore, gesture frequency negatively correlated with depressive symptom severity (r = -0.17, p = .046) and observational measures of psychomotor retardation (r = -0.23, p = .012). These findings suggest that gesture deficits are more strongly tied to the active state of depression rather than serving as a marker of vulnerability or a scar from previous depressive episodes. Automated gesture analysis provides an objective and scalable method for assessing nonverbal behavior in MDD. Future research should explore its clinical utility as a biomarker for symptom severity and treatment response.

Keywords: Automatic detection; Hand gesture; MDD; Nonverbal behavior; Psychomotor retardation.

PubMed Disclaimer

Conflict of interest statement

Declaration of competing interest The authors declare no competing interests.

References

    1. Alghowinem S, Goecke R, Wagner M, Parkerx G, & Breakspear M (2013). Head Pose and Movement Analysis as an Indicator of Depression. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, 283–288. 10.1109/ACII.2013.53 - DOI
    1. Annen S, Roser P, & Brüne M (2012). Nonverbal Behavior During Clinical Interviews: Similarities and Dissimilarities Among Schizophrenia, Mania, and Depression. The Journal of Nervous and Mental Disease, 200(1), 26. 10.1097/NMD.0b013e31823e653b - DOI - PubMed
    1. Bazarevsky V, Grishchenko I, Raveendran K, Zhu T, Zhang F, & Grundmann M (2020). BlazePose: On-device Real-time Body Pose tracking (No. arXiv:2006.10204). arXiv. 10.48550/arXiv.2006.10204 - DOI
    1. Bouhuys AL, & van den Hoofdakker RH (1991). The interrelatedness of observed behavior of depressed patients and of a psychiatrist: An ethological study on mutual influence. Journal of Affective Disorders, 23(2), 63–74. 10.1016/0165-0327(91)90093-8 - DOI - PubMed
    1. Cantisani A, Koenig T, Horn H, Müller T, Strik W, & Walther S (2015). Psychomotor retardation is linked to frontal alpha asymmetry in major depression. Journal of Affective Disorders, 188, 167–172. 10.1016/j.jad.2015.08.018 - DOI - PubMed

LinkOut - more resources