Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Sep 3;4(1):129.
doi: 10.1038/s41746-021-00502-8.

Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online

Mohammad Rafayet Ali  1 , Taylor Myers  2 , Ellen Wagner  2 , Harshil Ratnu  3 , E Ray Dorsey  2 , Ehsan Hoque  3
Affiliations

Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online

Mohammad Rafayet Ali et al. NPJ Digit Med. .

Retraction in

Abstract

A prevalent symptom of Parkinson's disease (PD) is hypomimia - reduced facial expressions. In this paper, we present a method for diagnosing PD that utilizes the study of micro-expressions. We analyzed the facial action units (AU) from 1812 videos of 604 individuals (61 with PD and 543 without PD, with a mean age 63.9 y/o, sd. 7.8) collected online through a web-based tool ( www.parktest.net ). In these videos, participants were asked to make three facial expressions (a smiling, disgusted, and surprised face) followed by a neutral face. Using techniques from computer vision and machine learning, we objectively measured the variance of the facial muscle movements and used it to distinguish between individuals with and without PD. The prediction accuracy using the facial micro-expressions was comparable to methodologies that utilize motor symptoms. Logistic regression analysis revealed that participants with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals. An automated classifier using Support Vector Machine was trained on the variances and achieved 95.6% accuracy. Using facial expressions as a future digital biomarker for PD could be potentially transformative for patients in need of remote diagnoses due to physical separation (e.g., due to COVID) or immobility.

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing interests.

Figures

Fig. 1
Fig. 1. Logistic regression weights of the features while predicting PD.
The green color represents the features with p < 0.05.
Fig. 2
Fig. 2. A two-dimensional visualization of the nine action units (AUs) after applying the principal component analysis (PCA).
The dots on the surface represents each participant. The participants are clustered into three groups using K-means represented by three colors. The bold round dots represents the cluster center of the three clusters. The proportion of individuals with Parkinson’s disease in each group differed with 75.7% of individuals in the red cluster having Parkinson’s disease.
Fig. 3
Fig. 3. Sample frames from the data set.
All participants made three facial expressions followed by a neutral face.
See this image and copyright information in PMC

References

    1. Stoker, T. B. & Greenland, J.C. Parkinson’s Disease: Pathogenesis and Clinical Aspects. Parkinson’s Disease: Pathogenesis and Clinical Aspects (exon publications, 2018). - PubMed
    1. Rinn, W. E. The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychol. Bull. 10.1037/0033-2909.95.1.52 (1984). - PubMed
    1. Novellino, F. & Salsone, M. A Tool for Evaluating Facial Expression for Early Diagnosis of Parkinson’s Disease. (The Michael J. Fox Foundation, 2018).
    1. Vinokurov, N., D. Arkadir, E. Linetsky, H. Bergman, & D. Weinshall. “Quantifying hypomimia in parkinson patients using a depth camera.” In International Symposium on Pervasive Computing Paradigms for Mental Health, pp. 63–71 (Springer, 2015).
    1. Simons G, Pasqualini MCS, Reddy V, Wood J. Emotional and nonemotional facial expressions in people with Parkinson’s disease. J. Int. Neuropsychol. Soc. 2004;10:521. doi: 10.1017/S135561770410413X. - DOI - PubMed

Publication types