Multicenter Study

. 2018;5(4):509-521.

doi: 10.3233/JND-180327.

Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study

Kristin J Krosschell^{1

2}, Michael Bosch³, Leslie Nelson⁴, Tina Duong⁵, Linda P Lowes⁶, Lindsay N Alfano⁶, Danielle Benjamin⁷, Terri B Carry⁸, Ginger Devine⁹, Carolyn Kelley⁸, Rebecca Gadekan¹⁰, Elizabeth C Malkus¹¹, Amy Pasternak^{12

13}, Stephanie Provance-Orr¹⁴, Lynne Roemeiser-Logan¹⁵, Alina Nicorici¹⁶, Donata Trussell¹⁷, Sally Dunaway Young¹⁸, Jennifer R Fetterman¹⁵, Jacqueline Montes¹⁸, Penny J Powers⁹, Rebecca Quinones¹⁹, Janet Quigley^{12

13}, Christopher S Coffey³, Jon W Yankey³, Amy Bartlett²⁰, John T Kissel²⁰, Stephen J Kolb^{20

21}; NeuroNEXT Clinical Trial Network and on behalf of the NN101 SMA Biomarker Investigators

Affiliations

¹ Department of Physical Therapy and Human Movement Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
² Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
³ Department of Biostatistics, NeuroNEXT Data Coordinating Center, University of Iowa, Iowa City, IA, USA.
⁴ Physical Therapy, UT Southwestern Medical Center, Dallas, TX, USA.
⁵ Department of Neurology, Stanford University, Palo Alto, CA, USA.
⁶ Neurology, Nationwide Children's Hospital, Columbus, OH, USA.
⁷ Physical Therapy, Oregon Health and Science University, Portland, OR, USA.
⁸ Physical Therapy, Children's Hospital Colorado, Aurora, CO, USA.
⁹ Pi Beta Phi Rehabilitation Institute, Vanderbilt University Medical Center, Nashville, TN, USA.
¹⁰ Neuromuscular Division, Washington University School of Medicine, St. Louis, MO, USA.
¹¹ Ultragenyx, Novato, CA, USA.
¹² The Department of Physical Therapy and Occupational Therapy Services, Boston Children's Hospital, Boston, MA, USA.
¹³ The Department of Neurology, Boston Children's Hospital, Boston, MA, USA.
¹⁴ Physical and Occupational Therapy, Children's Mercy Hospital, Kansas City, MO, USA.
¹⁵ SUNY Upstate Medical University, Syracuse, NY, USA.
¹⁶ Physical Medicine and Rehabilitation, University of California - Davis, Davis, CA, USA.
¹⁷ University of Utah, Salt Lake City, UT, USA.
¹⁸ Departments of Neurology and Rehabilitation and Regenerative Medicine, Columbia University Medical Center, New York, NY, USA.
¹⁹ Physical and Occupational Therapy, Duke Health, Durham, NC, USA.
²⁰ Department of Neurology, The Ohio State University Wexner Medical Center, Columbus, OH, USA.
²¹ Department of Biological Chemistry and Pharmacology, The Ohio State University Wexner Medical Center, Columbus, OH, USA.

PMID: 30223401
PMCID: PMC8112280
DOI: 10.3233/JND-180327

Multicenter Study

Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study

Kristin J Krosschell et al. J Neuromuscul Dis. 2018.

. 2018;5(4):509-521.

doi: 10.3233/JND-180327.

Authors

Affiliations

¹ Department of Physical Therapy and Human Movement Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
² Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
³ Department of Biostatistics, NeuroNEXT Data Coordinating Center, University of Iowa, Iowa City, IA, USA.
⁴ Physical Therapy, UT Southwestern Medical Center, Dallas, TX, USA.
⁵ Department of Neurology, Stanford University, Palo Alto, CA, USA.
⁶ Neurology, Nationwide Children's Hospital, Columbus, OH, USA.
⁷ Physical Therapy, Oregon Health and Science University, Portland, OR, USA.
⁸ Physical Therapy, Children's Hospital Colorado, Aurora, CO, USA.
⁹ Pi Beta Phi Rehabilitation Institute, Vanderbilt University Medical Center, Nashville, TN, USA.
¹⁰ Neuromuscular Division, Washington University School of Medicine, St. Louis, MO, USA.
¹¹ Ultragenyx, Novato, CA, USA.
¹² The Department of Physical Therapy and Occupational Therapy Services, Boston Children's Hospital, Boston, MA, USA.
¹³ The Department of Neurology, Boston Children's Hospital, Boston, MA, USA.
¹⁴ Physical and Occupational Therapy, Children's Mercy Hospital, Kansas City, MO, USA.
¹⁵ SUNY Upstate Medical University, Syracuse, NY, USA.
¹⁶ Physical Medicine and Rehabilitation, University of California - Davis, Davis, CA, USA.
¹⁷ University of Utah, Salt Lake City, UT, USA.
¹⁸ Departments of Neurology and Rehabilitation and Regenerative Medicine, Columbia University Medical Center, New York, NY, USA.
¹⁹ Physical and Occupational Therapy, Duke Health, Durham, NC, USA.
²⁰ Department of Neurology, The Ohio State University Wexner Medical Center, Columbus, OH, USA.
²¹ Department of Biological Chemistry and Pharmacology, The Ohio State University Wexner Medical Center, Columbus, OH, USA.

PMID: 30223401
PMCID: PMC8112280
DOI: 10.3233/JND-180327

Abstract

Background: The NeuroNEXT SMA Infant Biomarker Study, a two year, longitudinal, multi-center study of infants with SMA type 1 and healthy infants, presented a unique opportunity to assess multi-site rater reliability on three infant motor function tests (MFTs) commonly used to assess infants with SMA type 1.

Objective: To determine the effect of prospective MFT rater training and the effect of rater experience on inter-rater and intra-rater reliability for the Test of Infant Motor Performance Screening Items (TIMPSI), the Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP-INTEND) and the Alberta Infant Motor Scale (AIMS).

Methods: Training was conducted utilizing a novel set of motor function test (MFT) videos to optimize accurate MFT administration and reliability for the study duration. Inter- and intra-rater reliability of scoring for the TIMPSI and inter-rater reliability of scoring for the CHOP INTEND and the AIMS was assessed using intraclass correlation coefficients (ICC). Effect of rater experience on reliability was examined using ICC. Agreement with 'expert' consensus scores was examined using Pearson's correlation coefficients.

Results: Inter-rater reliability on all MFTs was good to excellent. Intra-rater reliability for the primary MFT, the TIMPSI, was excellent for the study duration. Agreement with 'expert' consensus was within predetermined limits (≥85%) after training. Evaluator experience with SMA and MFTs did not affect reliability.

Conclusions: Reliability of scores across evaluators was demonstrated for all three study MFTs and scores were reproducible on repeated administration. Evaluator experience had no effect on reliability.

Keywords: AIMS; CHOP-INTEND; NeuroNEXT; Spinal muscular atrophy; TIMPSI; clinical evaluator; motor function testing; neuromuscular diseases; outcome measures; reliability.

PubMed Disclaimer

Conflict of interest statement

CONFLICT OF INTEREST

The authors have no conflicts of interest to report.

Figures

**Fig. 1.**
Rater training process for TIMPSI. Legend: MFT- motor function test; TIMPSI- Test of Infant Motor Performance Screening Items.

**Fig. 2.**
Rater training process for CHOP INTEND and AIMS. Legend: MFT- motor function test; CHOP- Children’s Hospital of Philadelphia Infant Test of Neuromuscular Dysfunction; AIMS- Alberta Infant Motor Scales.

See this image and copyright information in PMC

References

1. Prior TW. Spinal muscular atrophy diagnostics. J Child Neurol. 2007;22(8):952–6. - PubMed
1. Kolb SJ, Kissel JT. Spinal Muscular Atrophy. Neurologic Clinics. 2015;33(4):831–46. - PMC - PubMed
1. Wang CH, Finkel RS, Bertini ES, Schroth M, Simonds A, Wong B, et al. Consensus statement for standard of care in spinal muscular atrophy. J Child Neurol. 2007;22(8): 1027–49. - PubMed
1. Finkel RS, Mercuri E, Darras BT, Connolly AM, Kuntz NL, Kirschner J, et al. Nusinersen versus Sham Control in Infantile-Onset Spinal Muscular Atrophy. N Engl J Med. 2017;377(18):1723–32. - PubMed
1. Mendell JR, Al-Zaidy S, Shell R, Arnold WD, Rodino-Klapac LR, Prior TW, et al. Single-Dose Gene-Replacement Therapy for Spinal Muscular Atrophy. N Engl J Med. 2017;377(18):1713–22. - PubMed

Publication types

Actions

MeSH terms

Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions
Actions

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study

Affiliations

Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study

Authors

Affiliations

Abstract

Conflict of interest statement

Figures

References

Publication types

MeSH terms

Substances

Grants and funding

LinkOut - more resources

Full Text Sources

Other Literature Sources

Research Materials