Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Jun 15;74(5):80.
doi: 10.5688/aj740580.

Development of a reliable, valid annual skills mastery assessment examination

Gregory L Alston  1 , Bryan L Love
Affiliations

Development of a reliable, valid annual skills mastery assessment examination

Gregory L Alston et al. Am J Pharm Educ. .

Abstract

Objective: To develop a methodology for a reliable, valid annual skills mastery assessment examination to provide formative student feedback, inform curricular review, and comply with the Accreditation Council for Pharmacy Education (ACPE) Standards 2007.

Design: A sample of program-level ability-based outcomes skills were chosen for the examination. Test items were written, underwent quality control, and were scored for level of difficulty. Versions of the examination for first-, second-, third-, and fourth-year pharmacy students were developed and administered, the results were analyzed, reliability and validity were evaluated, and reports were generated. Item-writing guidelines, quality control procedures, and examination production steps were codified to create a criterion-referenced examination. Students and faculty advisors received detailed score reports and results were used to guide student performance and stimulate a review of curricular outcomes.

Assessment: Content, criterion, and construct validity were analyzed as defined in the literature for the intended use of this assessment tool. Data suggest the Annual Skills Mastery Assessment (ASMA) examination is both reliable and valid. Students and faculty members were surveyed regarding the usefulness of the examination. Results indicate general satisfaction with the assessment program.

Conclusion: A reasonably reliable, reasonably valid multiple-choice annual skills mastery assessment for selected outcomes statements providing formative feedback and informed curricular review was developed.

Keywords: ability-based outcomes; assessment; examination; progress examination; skill mastery.

PubMed Disclaimer

References

    1. Accreditation Council for Pharmacy Education. Accreditation Standards and Guidelines for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree. http://www.acpe-accredit.org/pdf/ACPE_Revised_PharmD_Standards_Adopted_J.... Accessed April 20, 2010.
    1. Plaza CM. Progress examinations in pharmacy education. Am J Pharm Educ. 2007;71(4) Article 66. - PMC - PubMed
    1. Haladyna TM. Writing Test Items to Evaluate Higher Order Thinking. Needham Heights, MA: Allyn & Bacon, A Pearson Education Company; 1997.
    1. American Educational Research Association. Position statement on high stakes testing in pre-K - 12 education. http://www.aera.net/?id=378. Accessed April 20, 2010.
    1. Downing SM, Haladyna TM. Test item development: validity evidence from quality assurance procedures. Appl Meas Educ. 1997;10(1):61–82.

Publication types

LinkOut - more resources