Comparison of a linear and a non-linear model for using sensory-motor, cognitive, personality, and demographic data to predict driving ability in healthy older adults

Abstract

This study compared the ability of binary logistic regression (BLR) and non-linear causal resource analysis (NCRA) to utilize a range of cognitive, sensory-motor, personality and demographic measures to predict driving ability in a sample of cognitively healthy older drivers. Participants were sixty drivers aged 70 and above (mean=76.7 years, 50% men) with no diagnosed neurological disorder. Test data was used to build classification models for a Pass or Fail score on an on-road driving assessment. The generalizability of the models was estimated using leave-one-out cross-validation. Sixteen participants (27%) received an on-road Fail score. Area under the ROC curve values were .76 for BLR and .88 for NCRA (no significant difference, z=1.488, p=.137). The ROC curve was used to select three different cut-points for each model and to compare classification. At the cut-point corresponding to the maximum average of sensitivity and specificity, the BLR model had a sensitivity of 68.8% and specificity of 75.0% while NCRA had a sensitivity of 75.0% and specificity of 95.5%. However, leave-one-out cross-validation reduced sensitivity in both models and particularly reduced specificity for NCRA. Neither model is accurate enough to be relied on solely for determination of driving ability. The lowered accuracy of the models following leave-one-out cross-validation highlights the importance of investigating models beyond classification alone in order to determine a model's ability to generalize to new cases.