Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017:2017:5694083.
doi: 10.1155/2017/5694083. Epub 2017 Jun 12.

Reliability of the NICMAN Scale: An Instrument to Assess the Quality of Acupuncture Administered in Clinical Trials

Caroline A Smith  1 , Christopher J Zaslawski  2 , Suzanne Cochrane  1 , Xiaoshu Zhu  1 , Zhen Zheng  3 , Bertrand Loyeung  2 , Peter C Meier  4 , Sean Walsh  2 , Charlie Changli Xue  3 , Anthony L Zhang  3 , Paul P Fahey  5 , Alan Bensoussan  1
Affiliations

Reliability of the NICMAN Scale: An Instrument to Assess the Quality of Acupuncture Administered in Clinical Trials

Caroline A Smith et al. Evid Based Complement Alternat Med. 2017.

Abstract

Background: The aim of this study was to examine the reliability of a scale to assess the methodological quality of acupuncture administered in clinical research.

Methods: We invited 36 acupuncture researchers and postgraduate students to participate in the study. Firstly, participants rated two articles using the scale. Following this initial stage, modifications were made to scale items and the exercise was repeated. Interrater reliability was assessed for individual items using the Fleiss kappa statistic, whilst the overall scale used the intraclass correlation coefficient statistic. A threshold agreement of ≥0.61 was acceptable.

Results: We received 26 responses and a 72% response rate. The first phase of testing found moderate reliability with intraclass correlation coefficients of 0.46 and 0.55 for the articles. The interrater reliability of the scales varied between and within the researchers (0.35, 0.60) and was more consistent with the postgraduate students (0.54, 0.54). Five items on the scale scored below the threshold and were revised for further testing. In this phase the intraclass correlation coefficient demonstrated variability between articles but improved to achieve reliability above the agreed threshold.

Conclusion: This study provides evidence of the reliability of the NICMAN scale although improvements to a small number of items remain.

PubMed Disclaimer

References

    1. MacPherson H., Altman D. G., Hammerschlag R., et al. Revised standards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the consort statement. Acupuncture in Medicine. 2010;28(2):83–93. doi: 10.1136/aim.2009.001370. - DOI - PMC - PubMed
    1. Prady S. L., Richmond S. J., Morton V. M., MacPherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS ONE. 2008;3(2) doi: 10.1371/journal.pone.0001577.e1577 - DOI - PMC - PubMed
    1. Donabedian A. Evaluating the quality of medical care. Milbank Quarterly. 2005;83(4):691–729. doi: 10.1111/j.1468-0009.2005.00397.x. - DOI - PMC - PubMed
    1. Smith C. A., Zaslawski C. J., Zheng Z., et al. Development of an instrument to assess the quality of acupuncture: results from a Delphi process. Journal of Alternative and Complementary Medicine. 2011;17(5):441–452. doi: 10.1089/acm.2010.0457. - DOI - PMC - PubMed
    1. Jadad A. R., Moore R. A., Carroll D., et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Controlled Clinical Trials. 1996;17(1):1–12. doi: 10.1016/0197-2456(95)00134-4. - DOI - PubMed

LinkOut - more resources