Knowledge Self-Assessment Engagement and Family Medicine Board Examination Outcomes
- PMID: 40526852
- PMCID: PMC12306612
- DOI: 10.22454/FamMed.2025.200510
Knowledge Self-Assessment Engagement and Family Medicine Board Examination Outcomes
Abstract
Background and objectives: Evidence on the relationship between formative assessment engagement and summative assessment outcomes in practicing physicians is sparse. We evaluated the relationship between engagement in the American Board of Family Medicine (ABFM) formative Continuous Knowledge Self-Assessment (CKSA) and performance on high-stakes summative assessments.
Methods: This retrospective cohort study included 24,926 ABFM diplomates who completed CKSA modules and summative assessments between 2017 and 2023. We analyzed CKSA engagement metrics-such as the number of quarters completed, time of completion, and self-reported confidence-against performance on summative assessments, measured by z scores. Multivariable regression models controlled for demographic factors and prior assessment performance.
Results: The overall cohort summative assessment pass rate during the study period was 90.3%. Greater CKSA engagement was strongly associated with higher summative assessment performance. Diplomates who completed all four CKSA quarters had significantly higher summative assessment z scores than those completing fewer quarters (P<.001). Early CKSA completion and spending more time on low-confidence questions were also positively correlated with both CKSA and summative assessment scores (P<.001). These effects were observed across different levels of prior exam performance.
Conclusions: Engagement in formative assessments like CKSA, particularly early and consistent participation and reviewing incorrect or low-confidence questions, is linked to better outcomes on high-stakes assessments. Future research should explore the mechanisms underlying these associations and consider developing an index of engagement to identify physicians at risk of poor performance. Incorporating structured, longitudinal self-assessments like CKSA into certification requirements could enhance continuous learning and improve summative exam readiness.
Figures



Similar articles
-
The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11.Med Teach. 2009 Apr;31(4):282-98. doi: 10.1080/01421590902889897. Med Teach. 2009. PMID: 19404891
-
Comparison of Two Modern Survival Prediction Tools, SORG-MLA and METSSS, in Patients With Symptomatic Long-bone Metastases Who Underwent Local Treatment With Surgery Followed by Radiotherapy and With Radiotherapy Alone.Clin Orthop Relat Res. 2024 Dec 1;482(12):2193-2208. doi: 10.1097/CORR.0000000000003185. Epub 2024 Jul 23. Clin Orthop Relat Res. 2024. PMID: 39051924
-
Computer and mobile technology interventions for self-management in chronic obstructive pulmonary disease.Cochrane Database Syst Rev. 2017 May 23;5(5):CD011425. doi: 10.1002/14651858.CD011425.pub2. Cochrane Database Syst Rev. 2017. PMID: 28535331 Free PMC article.
-
Education support services for improving school engagement and academic performance of children and adolescents with a chronic health condition.Cochrane Database Syst Rev. 2023 Feb 8;2(2):CD011538. doi: 10.1002/14651858.CD011538.pub2. Cochrane Database Syst Rev. 2023. PMID: 36752365 Free PMC article.
-
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis.Cochrane Database Syst Rev. 2017 Dec 22;12(12):CD011535. doi: 10.1002/14651858.CD011535.pub2. Cochrane Database Syst Rev. 2017. Update in: Cochrane Database Syst Rev. 2020 Jan 9;1:CD011535. doi: 10.1002/14651858.CD011535.pub3. PMID: 29271481 Free PMC article. Updated.
References
-
- Watchter R. The ABIM controversy: a brief history of board certification and MOC. The Health Care Blog. 2015. https://thehealthcareblog.com/blog/2015/07/02/the-abim-controversy-a-bri... https://thehealthcareblog.com/blog/2015/07/02/the-abim-controversy-a-bri...
-
- ACEP Now AMA opposes mandatory American Board of Medical Specialties’ recertification exams. 2016. https://www.acepnow.com/article/american-medical-association-opposes-man... https://www.acepnow.com/article/american-medical-association-opposes-man...
-
- Teirstein P S. Boarded to death-why maintenance of certification is bad for doctors and patients. N Engl J Med. 2015;372(2):106–108. - PubMed
-
- Cook D A, Price D W, Wittich C M, West C P, Blachman M J. Factors Influencing physicians’ selection of continuous professional development activities: a cross-specialty national survey. J Contin Educ Health Prof. 2017(37):154–160. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources