Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jan;91(1):75-81.
doi: 10.1136/jnnp-2019-321138. Epub 2019 Sep 26.

Development and assessment of the inter-rater and intra-rater reproducibility of a self-administration version of the ALSFRS-R

Leonhard A Bakker  1   2 , Carin D Schröder  2   3 , Harold H G Tan  1 , Simone M A G Vugts  1 , Ruben P A van Eijk  1   4 , Michael A van Es  1 , Johanna M A Visser-Meily  2   3 , Leonard H van den Berg  5
Affiliations

Development and assessment of the inter-rater and intra-rater reproducibility of a self-administration version of the ALSFRS-R

Leonhard A Bakker et al. J Neurol Neurosurg Psychiatry. 2020 Jan.

Abstract

Objective: The Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is widely applied to assess disease severity and progression in patients with motor neuron disease (MND). The objective of the study is to assess the inter-rater and intra-rater reproducibility, i.e., the inter-rater and intra-rater reliability and agreement, of a self-administration version of the ALSFRS-R for use in apps, online platforms, clinical care and trials.

Methods: The self-administration version of the ALSFRS-R was developed based on both patient and expert feedback. To assess the inter-rater reproducibility, 59 patients with MND filled out the ALSFRS-R online and were subsequently assessed on the ALSFRS-R by three raters. To assess the intra-rater reproducibility, patients were invited on two occasions to complete the ALSFRS-R online. Reliability was assessed with intraclass correlation coefficients, agreement was assessed with Bland-Altman plots and paired samples t-tests, and internal consistency was examined with Cronbach's coefficient alpha.

Results: The self-administration version of the ALSFRS-R demonstrated excellent inter-rater and intra-rater reliability. The assessment of inter-rater agreement demonstrated small systematic differences between patients and raters and acceptable limits of agreement. The assessment of intra-rater agreement demonstrated no systematic changes between time points; limits of agreement were 4.3 points for the total score and ranged from 1.6 to 2.4 points for the domain scores. Coefficient alpha values were acceptable.

Discussion: The self-administration version of the ALSFRS-R demonstrates high reproducibility and can be used in apps and online portals for both individual comparisons, facilitating the management of clinical care and group comparisons in clinical trials.

Keywords: agreement; amyotrophic lateral sclerosis; amyotrophic lateral sclerosis functional rating scale-revised; inter-rater; intra-rater; reliability; reproducibility.

PubMed Disclaimer

Conflict of interest statement

Competing interests: LAB, CDS, HHGT, SMAGV, RPAVE and JMAV-M have nothing to disclose. MAvE received grants from the Netherlands Organization for Health Research and Development (Veni scheme), The Thierry Latran Foundation, Joint Programme – Neurodegenerative Disease Research (JPND) and the Netherlands ALS Foundation (Stichting ALS Nederland). He received travel grants from Shire (previously Baxalta) and serves on the medical ethical review board of University Medical Centre Utrecht. LHvdB reports grants from ALS Foundation Netherlands, grants from The Netherlands Organization for Health Research and Development (Vici scheme), grants from The Netherlands Organization for Health Research and Development (SOPHIA, STRENGTH, ALS-CarE project), funded through the EU JPND, personal fees from Shire (previously Baxalta), personal fees from Biogen, personal fees from Cytokinetics, other from Prinses Beatrix SpierFonds, other from Latran Foundation, outside the submitted work.

Comment in

LinkOut - more resources