Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Jan;102(1):31-40.
doi: 10.3163/1536-5050.102.1.007.

Evaluation of best practices in the design of online evidence-based practice instructional modules

Margaret J Foster  1 , Suzanne Shurtz  1 , Catherine Pepper  1
Affiliations

Evaluation of best practices in the design of online evidence-based practice instructional modules

Margaret J Foster et al. J Med Libr Assoc. 2014 Jan.

Abstract

Objectives: The research determined to what extent best practices are being followed by freely available online modules aimed at teaching critical thinking and evidence-based practices (EBPs) in health sciences fields.

Methods: In phase I, an evaluation rubric was created after reviewing the literature. Individual rubric questions were assigned point values and grouped into sections, and the sections weighted. Phase II involved searching Internet platforms to locate online EBP modules, which were screened to determine if they met predetermined criteria for inclusion. Phase III comprised a first evaluation, in which two authors assessed each module, followed by a second evaluation of the top-scoring modules by five representatives from different health sciences units.

Results: The rubric's 28 questions were categorized into 4 sections: content, design, interactivity, and usability. After retrieving 170 online modules and closely screening 91, 42 were in the first evaluation and 8 modules were in the second evaluation. Modules in the first evaluation earned, on average, 59% of available points; modules in the second earned an average of 68%. Both evaluations had a moderate level of inter-rater reliability.

Conclusions: The rubric was effective and reliable in evaluating the modules. Most modules followed best practices for content and usability but not for design and interactivity.

Implications: By systematically collecting and evaluating instructional modules, the authors found many potentially useful elements for module creation. Also, by reviewing the limitations of the evaluated modules, the authors were able to anticipate and plan ways to overcome potential issues in module design.

PubMed Disclaimer

References

    1. Bouchoucha S, Wikander L, Wilkin C. Assessment of simulated clinical skills and distance students: can we do it better. Nurse Educ Today. 2012 Dec 10. DOI: http://dx.doi.org/10.1016/j.nedt.2012.11.008. - PubMed
    1. Findlater GS, Kristmundsdottir F, Parson SH, Gillingwater TH. Development of a supported self-directed learning approach for anatomy education. Anat Sci Educ. 2012 Mar/Apr;5(2):114–21. DOI: http://dx.doi.org/10.1002/ase.1255. - PubMed
    1. Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, Germar MJ, Pisake L, Mittal S, Pattinson R, Wolomby-Molondo JJ, Bergh AM, May W, Souza JP, Koppenhoefer S, Khan KS. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA. 2012 Dec 5;308(21):2218–25. DOI: http://dx.doi.org/10.1001/jama.2012.33640. - PubMed
    1. Lewin LO, Singh M, Bateman BL, Glover PB. Improving education in primary care: development of an online curriculum using the blended learning model. BMC Med Educ. 2009 Jun 10;9:33. DOI: http://dx.doi.org/10.1186/1472-6920-9-33. - PMC - PubMed
    1. Smith SJ, Kakarala RR, Talluri SK, Sud P, Parboosingh J. Internal medicine residents' acceptance of self-directed learning plans at the point of care. J Grad Med Educ. 2011 Sep;3(3):425–8. DOI: http://dx.doi.org/10.4300/JGME-03-03-30. - PMC - PubMed