Method-oriented systematic review on the simple scale for acceptance measurement in advanced transport telematics

Abstract

Acceptance intuitively is a precondition for the adaptation and use of technology. In this systematic review, we examine academic literature on the "simple scale for acceptance measurement" provided by Van der Laan, Heino, and de Waard (1997). This measure is increasingly applied in research on mobility systems without having been thoroughly analysed. This article aims to provide such a critical analysis. We identified 437 unique references in three aggregated databases and included 128 articles (N = 6,058 participants) that empirically applied the scale in this review. The typical study focused on a mobility system using a within-subjects design in a driving simulator in Europe. Based on quality indicators of transparent study aim, group allocation procedure, variable definitions, sample characteristics, (statistical) control of confounders, reproducibility, and reporting of incomplete data and test performance, many of the 128 articles exhibited room for improvements (44% below.50; range 0 to 1). Twenty-eight studies (22%) reported reliability coefficients providing evidence that the scale and its sub-scales produce reliable results (median Cronbach's α >.83). Missing data from the majority of studies limits this conclusion. Only 2 out of 10 factor analyses replicated the proposed two-dimensional structure questioning the use of these sub-scales. Correlation results provide evidence for convergent validity of acceptance, usefulness, and satisfying with limited confidence, since only 14 studies with a median sample size of N = 40 reported correlation coefficients. With these results, the scale might be a valuable addition for technology attitude research. Firstly, we recommend thorough testing for a better understanding of acceptance, usefulness, and satisfying. Secondly, we suggest to report scale results more transparently and rigorously to enable meta-analyses in the future. The study protocol is available at the Open Science Framework (https://osf.io/j782c/).

Fig 1. PRISMA diagram of the systematic literature search and exclusion in various points of the process.

Fig 2. Boxplots of Cronbach’s α for the two sub-scales and the entire scale.

(A) usefulness, (B) satisfying, (C) entire scale. The threshold of Cronbach’s α = .80 is highlighted.