Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2003 Feb 8;326(7384):319-21.
doi: 10.1136/bmj.326.7384.319.

Validation of the Fresno test of competence in evidence based medicine

Kathleen D Ramos  1 , Sean Schafer, Susan M Tracz
Affiliations

Validation of the Fresno test of competence in evidence based medicine

Kathleen D Ramos et al. BMJ. .

Abstract

Objective: To describe the development and validation of a test of knowledge and skills in evidence based medicine.

Design: Cross sectional study.

Setting: Family practice residency programme in California; a list server for those who teach evidence based medicine; and an evidence based medicine seminar series.

Participants: Family practice residents and faculty members (n=43); volunteers self identified as experts in evidence based medicine (n=53); family practice teachers (19) beginning a seminar series on evidence based medicine.

Intervention: The Fresno test is a performance based measure for use in medical education that assesses a wide range of evidence based medicine skills. Open ended questions are scored with standardised grading rubrics. Calculation skills are assessed by fill in the blank questions.

Main outcome measures: Inter-rater reliability, internal reliability, item analyses, and construct validity.

Results: Inter-rater correlations ranged from 0.76 to 0.98 for individual items. Cronbach's alpha was 0.88. Item difficulties ranged from moderate to difficult, all with positive and strong ability to discriminate between candidates. Experts scored consistently higher than novices. On the 212 point test, the novice mean was 95.6 and the expert mean was 147.5 (P<0.001). On individual items, a higher proportion of experts than novices earned passing scores on 15 of the 17 items.

Conclusion: The Fresno test is a reliable and valid test for detecting the effect of instruction in evidence based medicine. Its use in other settings requires further exploration.

PubMed Disclaimer

References

    1. Hatala R, Guyatt G. Evaluating the teaching of evidence-based medicine. JAMA. 2002;288:1110–1111. - PubMed
    1. Grad R, Macaulay AC, Warner M. Teaching evidence-based medical care: description and evaluation. Fam Med. 2001;33:602–606. - PubMed
    1. Stern DT, Linzer M, O'Sullivan PS, Weld L. Evaluating medical residents' literature-appraisal skills. Acad Med. 1995;70:152–154. - PubMed
    1. Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB. Evidence-based medicine: how to practice and teach EBM. 2nd ed. London: Churchill Livingstone; 2000.
    1. Slawson DC, Shaughnessy AF, Barry H. Which should come first: rigor or relevance? J Fam Pract. 2001;50:209–210. - PubMed

Publication types