Evaluation of an Interview Process for Admission into an Occupational Therapy Program

Abstract

Graduate school admissions interviews serve multiple purposes. Interviews allow applicants to promote non-cognitive attributes that may not have translated from other admissions materials. Additionally, the interview is often cited as a way for programs to assess the 'suitability' of an applicant. Evidence related to psychometric properties for graduate admissions interview processes is inconsistent. This study analyzes the psychometric properties of a specific group interview process for admission into an occupational therapy program. Retrospective data were used to assess interrater reliability using an intraclass correlation. Current students were invited to complete the RAND Social Health Battery to correlate with interview scores, two measures of social participation, to examine predictive validity. Results show a strong correlation between specific interviewers. A one-way ANOVA showed significant differences between individual interviewers. No significant correlation between interview scores and the RAND Social Health Battery was found. Results indicate that although inter-rater reliability was established, a closer look reveals individual differences between raters. The validity of the group interview, based on social participation, was not supported. Given the influence of the interview on admission processes, authors recommend programs complete in-depth evaluation of inter-rater reliability and identify and measure constructs intended to be captured in the interview.