Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2017 Jan 25;30(1):3.
doi: 10.1186/s41155-016-0057-1.

Scale development: ten main limitations and recommendations to improve future research practices

Fabiane F R Morgado  1 , Juliana F F Meireles  2 , Clara M Neves  2 , Ana C S Amaral  3 , Maria E C Ferreira  2
Affiliations
Review

Scale development: ten main limitations and recommendations to improve future research practices

Fabiane F R Morgado et al. Psicol Reflex Crit. .

Erratum in

Abstract

The scale development process is critical to building knowledge in human and social sciences. The present paper aimed (a) to provide a systematic review of the published literature regarding current practices of the scale development process, (b) to assess the main limitations reported by the authors in these processes, and (c) to provide a set of recommendations for best practices in future scale development research. Papers were selected in September 2015, with the search terms "scale development" and "limitations" from three databases: Scopus, PsycINFO, and Web of Science, with no time restriction. We evaluated 105 studies published between 1976 and 2015. The analysis considered the three basic steps in scale development: item generation, theoretical analysis, and psychometric analysis. The study identified ten main types of limitation in these practices reported in the literature: sample characteristic limitations, methodological limitations, psychometric limitations, qualitative research limitations, missing data, social desirability bias, item limitations, brevity of the scale, difficulty controlling all variables, and lack of manual instructions. Considering these results, various studies analyzed in this review clearly identified methodological weaknesses in the scale development process (e.g., smaller sample sizes in psychometric analysis), but only a few researchers recognized and recorded these limitations. We hope that a systematic knowledge of the difficulties usually reported in scale development will help future researchers to recognize their own limitations and especially to make the most appropriate choices among different conceptions and methodological strategies.

Keywords: Assessment; Measurement; Psychometrics; Reliability; Validity.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interest.

Figures

Fig. 1
Fig. 1
Flowchart showing summary of the systematic process of identifying and selecting article
See this image and copyright information in PMC

References

    1. Aagja JP, Garg R. Measuring perceived service quality for public hospitals (PubHosQual) in the Indian context. International Journal of Pharmaceutical and Healthcare Marketing. 2010;4(10):60–83. doi: 10.1108/17506121011036033. - DOI
    1. Ahmad N, Awan MU, Raouf A, Sparks L. Development of a service quality scale for pharmaceutical supply chains. International Journal of Pharmaceutical and Healthcare Marketing. 2009;3(1):26–45. doi: 10.1108/17506120910948494. - DOI
    1. Akter S, D’Ambra J, Ray P. Development and validation of an instrument to measure user perceived service quality of mHealth. Information and Management. 2013;50:181–195. doi: 10.1016/j.im.2013.03.001. - DOI
    1. Alvarado-Herrera, A, Bigne, E, Aldas-Manzano, J, & Curras-Perez, R. (2015). A scale for measuring consumer perceptions of corporate social responsibility following the sustainable development paradigm. Journal of Business Ethics, 1-20. doi: 10.1007/s10551-015-2654-9 - DOI
    1. Arias, M. R. M., Lloreda, M. J. H., & Lloreda, M. V. H. (2014). Psicometría. S.A.: Alianza Editorial

LinkOut - more resources