Randomized Controlled Study to Test the Effectiveness of Developmental Network Coaching in the Career Advancement of Diverse Early-Stage Investigators (ESIs): Implementation Challenges and Lessons Learned

Abstract

Introduction: Adding developmental networks (DN) to grant-writing coaching can significantly enhance ESIs' research careers. Herein, we present study design, ESIs' characteristics and encountered challenges/lessons learned and their resolutions when deploying/implementing (a) NCR algorithm(s), (b) recruitment/retention and (c) implementing DN intervention. Methods: Nested Cluster Randomization (NCR) design governs this study implementation. The sample size is 220 ESIs intending to submit an NIH K, R, U, and/or Minority Supplement application(s). Primary outcome: intensity/sustainability of grant submission(s)/funding(s), measured by time to/between application(s). Outcome(s) analyses modes: summaries, Kaplan Meir and Cox proportional hazard models as a function of randomization groups and other predictors of outcomes. Results: In the present study, we recruited two cohorts of ESIs (N = 85): 39% African Americans, 18% Latinx, 18% Whites, 20% Asians and 6% Hawaiian/Pacific Islander/other ethnicities; 65% are women; 73% are assistant professors, 4% are Associate Professors and 23% are instructors/scientists/post-doctoral. Participants' disciplines: 32% basic/biomedical, 36% clinical/translational and 32% social/behavioral. Proposal(s) mechanisms: 61% research grants (R series), 31% career development (K series), 7% support of competitive research (SCORE) and 1% National Science Foundation applications. NCR did produce balance in the distribution of ESIs' demographics, sex at birth, ethnicity, professional appointments, background disciplines, and mechanism of sought funding. Lessons learned/challenges: NCR implementation was methodologically challenged during implementation by added constraints (e.g., assigning coaches to the same randomization arm of their participants as well as blinding them to ESIs' randomization group). Recruitment and retention were hampered by the COVID-19 pandemic and more progressive and innovative strategies were needed to heighten the visibility and outreach of this program. DN delivery was also affected by the pandemic and monitoring of ESIs' engagement and facilitation of communications interventions were needed. Resolution of these challenges effectively reconfigured NCR algorithms, recruitment/retention plans, and DN intervention delivery. We intend to recruit an additional 135 ESIs focusing on underrepresented scholars from RCMIs, CTSAs, and other programs. COVID-19 rendered this program 100% virtual, with recruitment/retention challenges and substantial disruption of ESIs' research. We may extend the grant writing period, coaching, and Mock Study Section support.

Keywords: COVID-19; National Research Mentoring Network (NRMN); career development; developmental networks; diversity; early-stage investigators; grant writing; mentorship; mock study section; nested cluster randomization.

Figure 1

Testing the efficacy of development network (DN) among ESIs in a structured grant writing coaching training.

Figure 2

Distribution of gender by randomization groups (1,2) (p-value = 0.3956).

Figure 3

Distribution of ethnicity by randomization groups (1,2). (p-value = 0.9227).

Figure 4

Distribution of academic position by randomization groups (1,2). (p-value = 0.3009).

Figure 5

Distribution of sought funding mechanism by randomization groups (1,2). (p-value = 0.1575).