A qualitative evaluation of the short and long-term impacts of an implementation science training program in South Africa

Abstract

Background: As implementation science (IS) in low and middle-income country settings continues to grow and generate interest, there is continual demand for capacity building in the field. Training programs have proliferated, but evaluations of these efforts are sparse and primarily from high-income countries. There is little knowledge about the impact of IS training on students' careers post-graduation. This evaluation of the first cohort of students who graduated from the 18-month implementation science concentration in HIV/AIDS within the Master of Science program at University of the Witwatersrand in South Africa addresses this gap.

Methods: We conducted two rounds of virtual interviews with the students, who were from eight African countries, immediately after the training program ended (n = 10 participants) and again five years later (n = 9 participants). The first survey captured student perceptions of IS before they entered the program and their opinions just after graduation. The follow-up evaluated their perceptions five years after graduation. Interviews were recorded, transcribed, and coded in ATLAS.ti (first round) and MAXQDA (second round), using the framework method and thematic analysis.

Results: Prior to the training, all students, even those with no knowledge of the field, perceived that the IS training program would help them develop skills to address critical public health priorities. These expectations were generally met by the training program, and most students reported satisfaction despite what they felt was a limited timeframe of the program and insufficient mentorship to complete their dissertation projects at their home institutions across the African continent. Five years post-graduation, most of the students did not have jobs in IS but continued applying their training in their roles and had subsequently pursued further education, some in IS-related programs.

Conclusions: IS training in Africa was clearly seen as valuable by trainees but IS job opportunities remain scarce. Training programs need to be more closely tied to local government priorities, and training for in-country policy and decision-makers is needed to increase demand for qualified IS researchers and practitioners.

Keywords: Capacity building; Implementation science; South Africa.

Fig. 1

Training timeline and research questions