Interrater reliability of motor severity scales for hemifacial spasm

Ha Yeon Lee¹, Ingyun Park¹, Minnie P Luu¹, Jerry Zhao¹, Jeanne P Vu¹, Elizabeth Cisneros¹, Brian D Berman², H A Jinnah^{3

4}, Han-Joon Kim⁵, Catherine Y Liu^{6

7

8}, Joel S Perlmutter^{9

10}, Sarah Pirio Richardson^{11

12}, Anne Weissbach^{13

14}, Glenn T Stebbins¹⁵, David A Peterson^{16

17}

Affiliations

¹ Institute for Neural Computation, University of California, San Diego, La Jolla, CA, USA.
² Department of Neurology, Virginia Commonwealth University, Richmond, VA, USA.
³ Department of Neurology, Emory University School of Medicine, Atlanta, GA, USA.
⁴ Department of Human Genetics, Emory University School of Medicine, Atlanta, GA, USA.
⁵ Department of Neurology and Movement Disorders Centre, Seoul National University Hospital, Seoul, South Korea.
⁶ Viterbi Family Department of Ophthalmology, University of California, San Diego, La Jolla, USA.
⁷ Department of Ophthalmology, Rady Children's Hospital, San Diego, CA, USA.
⁸ Division of Oculofacial Plastic and Reconstructive Surgery, Shiley Eye Institute, University of California, San Diego, La Jolla, USA.
⁹ Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA.
¹⁰ Departments of Radiology, Neuroscience, Physical Therapy, and Occupational Therapy, Washington University School of Medicine, St. Louis, MO, USA.
¹¹ Department of Neurology, University of New Mexico Health Sciences Center, Albuquerque, NM, USA.
¹² Neurology Service, New Mexico Veterans Affairs Health Care System, Albuquerque, NM, USA.
¹³ Institute of Systems Motor Science, University of Luebeck, Luebeck, Germany.
¹⁴ Institute of Neurogenetics, University of Luebeck, Luebeck, Germany.
¹⁵ Department of Neurological Sciences, Rush University Medical Center, Chicago, IL, USA.
¹⁶ Institute for Neural Computation, University of California, San Diego, La Jolla, CA, USA. dap@salk.edu.
¹⁷ Computational Neurobiology Laboratory, Salk Institute for Biological Studies, 10010 N. Torrey Pines Rd, La Jolla, CA, 92037, USA. dap@salk.edu.

PMID: 37466750
PMCID: PMC10480239
DOI: 10.1007/s00702-023-02667-w

Interrater reliability of motor severity scales for hemifacial spasm

Ha Yeon Lee et al. J Neural Transm (Vienna). 2023 Oct.

. 2023 Oct;130(10):1269-1279.

doi: 10.1007/s00702-023-02667-w. Epub 2023 Jul 19.

Authors

Affiliations

¹ Institute for Neural Computation, University of California, San Diego, La Jolla, CA, USA.
² Department of Neurology, Virginia Commonwealth University, Richmond, VA, USA.
³ Department of Neurology, Emory University School of Medicine, Atlanta, GA, USA.
⁴ Department of Human Genetics, Emory University School of Medicine, Atlanta, GA, USA.
⁵ Department of Neurology and Movement Disorders Centre, Seoul National University Hospital, Seoul, South Korea.
⁶ Viterbi Family Department of Ophthalmology, University of California, San Diego, La Jolla, USA.
⁷ Department of Ophthalmology, Rady Children's Hospital, San Diego, CA, USA.
⁸ Division of Oculofacial Plastic and Reconstructive Surgery, Shiley Eye Institute, University of California, San Diego, La Jolla, USA.
⁹ Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA.
¹⁰ Departments of Radiology, Neuroscience, Physical Therapy, and Occupational Therapy, Washington University School of Medicine, St. Louis, MO, USA.
¹¹ Department of Neurology, University of New Mexico Health Sciences Center, Albuquerque, NM, USA.
¹² Neurology Service, New Mexico Veterans Affairs Health Care System, Albuquerque, NM, USA.
¹³ Institute of Systems Motor Science, University of Luebeck, Luebeck, Germany.
¹⁴ Institute of Neurogenetics, University of Luebeck, Luebeck, Germany.
¹⁵ Department of Neurological Sciences, Rush University Medical Center, Chicago, IL, USA.
¹⁶ Institute for Neural Computation, University of California, San Diego, La Jolla, CA, USA. dap@salk.edu.
¹⁷ Computational Neurobiology Laboratory, Salk Institute for Biological Studies, 10010 N. Torrey Pines Rd, La Jolla, CA, 92037, USA. dap@salk.edu.

PMID: 37466750
PMCID: PMC10480239
DOI: 10.1007/s00702-023-02667-w

Abstract

To compare the inter-rater reliability (IRR) of five clinical rating scales for video-based assessment of hemifacial spasm (HFS) motor severity. We evaluated the video recordings of 45 HFS participants recruited through the Dystonia Coalition. In Round 1, six clinicians with expertise in HFS assessed the participants' motor severity with five scales used to measure motor severity of HFS: the Jankovic rating scale (JRS), Hemifacial Spasm Grading Scale (HSGS), Samsung Medical Center (SMC) grading system for severity of HFS spasms (Lee's scale), clinical grading of spasm intensity (Chen's scale), and a modified version of the Abnormal Involuntary Movement Scale (Tunc's scale). In Round 2, clinicians rated the same cohort with simplified scale wording after consensus training. For each round, we evaluated the IRR using the intraclass correlation coefficient [ICC (2,1) single-rater, absolute-agreement, 2-way random model]. The scales exhibited IRR that ranged from "poor" to "moderate"; the mean ICCs were 0.41, 0.43, 0.47, 0.43, and 0.65 for the JRS, HSGS, Lee's, Chen's, and Tunc's scales, respectively, for Round 1. In Round 2, the corresponding IRRs increased to 0.63, 0.60, 0.59, 0.53, and 0.71. In both rounds, Tunc's scale exhibited the highest IRR. For clinical assessments of HFS motor severity based on video observations, we recommend using Tunc's scale because of its comparative reliability and because clinicians interpret the scale easily without modifications or the need for consensus training.

Keywords: Hemifacial spasm; Interrater reliability; Severity rating scale.

PubMed Disclaimer

Figures

**Fig. 1**
Interrater reliability for HFS rating scales. Intraclass Correlation Coefficient (ICC) values from Round 1 and Round 2. Whiskers indicate 95% confidence interval. Dashed lines delineate conventional thresholds for interpreting reliability associated with ICC values (poor < 0.5, moderate 0.5–0.75, good 0.75–0.9, and excellent > 0.9) (Koo and Li 2016). See Table 1 for scale abbreviations

See this image and copyright information in PMC

References

1. Auger RG, Whisnant JP. Hemifacial spasm in Rochester and Olmsted County, Minnesota, 1960 to 1984. Arch Neurol. 1990;47:1233–1234. doi: 10.1001/ARCHNEUR.1990.00530110095023. - DOI - PubMed
1. Barry MJ, VanSwearingen JM, Albright AL. Reliability and responsiveness of the Barry-Albright Dystonia Scale. Dev Med Child Neurol. 1999;41:S0012162299000870. doi: 10.1017/S0012162299000870. - DOI - PubMed
1. Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review. Arch Orofac Sci. 2017;12:1–11.
1. Charles PD, Adler CH, Stacy M, et al (2014) Cervical dystonia and pain: characteristics and treatment patterns from CD PROBE (Cervical Dystonia Patient Registry for Observation of OnabotulinumtoxinA Efficacy). J Neurol 261:1309–1319. 10.1007/s00415-014-7343-6 - PMC - PubMed
1. Chen RS, Lu CS, Tsai CH (1996) Botulinum toxin A injection in the treatment of hemifacial spasm. Acta Neurol Scand 94:207–211. 10.1111/J.1600-0404.1996.TB07053.X - PubMed

Publication types

Actions
Actions
Actions

MeSH terms

Actions
Actions
Actions
Actions

Grants and funding

LinkOut - more resources

Full Text Sources
Medical
- MedlinePlus Health Information

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Interrater reliability of motor severity scales for hemifacial spasm

Affiliations

Interrater reliability of motor severity scales for hemifacial spasm

Authors

Affiliations

Abstract

Figures

References

Publication types

MeSH terms

Grants and funding

LinkOut - more resources

Full Text Sources

Medical