Learning to mark: a qualitative study of the experiences and concerns of medical markers
- PMID: 16638150
- PMCID: PMC1475573
- DOI: 10.1186/1472-6920-6-25
Learning to mark: a qualitative study of the experiences and concerns of medical markers
Abstract
Background: Although there is published research on the methods markers use in marking various types of assessment, there is relatively little information on the processes markers use in approaching a marking exercise. This qualitative paper describes the preparation and experiences of general practice (GP) teachers who undertake marking a written assessment in an undergraduate medical course.
Methods: Semi-structured interviews were conducted with seven of the 16 GP tutors on an undergraduate course. The purposive sample comprised two new markers, two who had marked for a couple of years and three experienced markers. Each respondent was interviewed twice, once following a formative assessment of a written case study, and again after a summative assessment. All interviews were audio-taped and analysed for emerging themes. A respondent validation exercise was conducted with all 16 GP tutors.
Results: Markers had internal concerns about their ability to mark fairly and made considerable efforts to calibrate their marking. They needed guidance and coaching when marking for the first time and adopted a variety of marking styles, reaching a decision through a number of routes. Dealing with pass/fail borderline scripts and the consequences of the mark on the student were particular concerns. Even experienced markers felt the need to calibrate their marks both internally and externally
Conclusion: Previous experience of marking appears to improve markers' confidence and is a factor in determining the role which markers adopt. Confidence can be improved by giving clear instructions, along with examples of marking. The authors propose that one method of providing this support and coaching could be by a process of peer review of a selection of papers prior to the main marking. New markers in particular would benefit from further guidance, however they are influenced by others early on in their marking career and course organisers should be mindful of this when arranging double marking.
Similar articles
-
Leniency and halo effects in marking undergraduate short research projects.BMC Med Educ. 2004 Nov 29;4(1):28. doi: 10.1186/1472-6920-4-28. BMC Med Educ. 2004. PMID: 15569395 Free PMC article.
-
Putting double marking to the test: a framework to assess if it is worth the trouble.Med Educ. 2005 Mar;39(3):299-308. doi: 10.1111/j.1365-2929.2005.02093.x. Med Educ. 2005. PMID: 15733166
-
Student and educator experiences of maternal-child simulation-based learning: a systematic review of qualitative evidence protocol.JBI Database System Rev Implement Rep. 2015 Jan;13(1):14-26. doi: 10.11124/jbisrir-2015-1694. JBI Database System Rev Implement Rep. 2015. PMID: 26447004
-
Should we video OSCEs for student appeals?Clin Teach. 2020 Apr;17(2):171-176. doi: 10.1111/tct.13062. Epub 2019 Aug 6. Clin Teach. 2020. PMID: 31386278 Review.
-
An evaluation of educational interventions aimed at preparing medical students for discharge summary writing: a rapid review of the literature.Ir J Med Sci. 2021 May;190(2):523-530. doi: 10.1007/s11845-020-02325-0. Epub 2020 Jul 28. Ir J Med Sci. 2021. PMID: 32725348 Review.
Cited by
-
Use of cost-effectiveness analysis to compare the efficiency of study identification methods in systematic reviews.Syst Rev. 2016 Aug 17;5(1):140. doi: 10.1186/s13643-016-0315-4. Syst Rev. 2016. PMID: 27535658 Free PMC article.
References
-
- Wolfe EW. The relationship between essay reading style and scoring proficiency in a psychometric scoring system. Assessing Writing. 1997;4:83–106. doi: 10.1016/S1075-2935(97)80006-2. - DOI
-
- Weigle SC. Investigating rater/prompt interactions in writing assessment; Quantitative and qualitative approaches. Assessing Writing. 1999;6:145–178. doi: 10.1016/S1075-2935(00)00010-6. - DOI
-
- Miles MB, Huberman AM. Qualitative data analysis: an expanded source book. 2. London: Sage; 1994.
-
- Loftland J, Loftland L. Analyzing Social Settings: A guide to qualitative observation and analysis. London: Wadsworth; 1995.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources