Cumulative sum (CUSUM) analysis in the assessment of trainee competence in fetal biometry measurement

Abstract

Objective: To determine the value of cumulative sum (CUSUM) analysis in assessing trainee proficiency in fetal biometry measurement.

Methods: Three primary healthcare doctors with no prior ultrasound training were recruited. Each trainee measured the fetal biparietal diameter (BPD), head circumference (HC), abdominal circumference (AC) and femur length (FL) on 100 consecutive pregnant women. The supervisor repeated the measurements. The CUSUM for each set of trainee measurements was calculated at a set failure rate of 10%. The point at which the graph fell below two consecutive boundary lines indicated the number of examinations required to achieve competence.

Results: The CUSUM graphs showed that the rate of learning measurement skills varied among the three trainees. The graph for the CUSUM series for BPD and HC measurement for all trainees fell below two consecutive boundary lines and remained there, indicating competence. The CUSUM series for AC measurement for two of the trainees indicated that competence was achieved; however, for the third trainee, while the graph fell below two consecutive boundary lines, indicating competence, it rose again, crossing two consecutive boundary lines. This indicated a loss of competence and the need for further training. FL measurements for the same trainee never fell below two consecutive boundary lines, indicating failure to achieve competence; the other two achieved competence, but failed to maintain it.

Conclusions: CUSUM is a useful tool for identifying points of competence and for quantifying the duration of ultrasound training required for each trainee. It provides an early indication of performance, and highlights difficulties in individual performance.