Development of a sports technology quality framework

Abstract

Identifying tools and processes to effectively and efficiently evaluate technologies is an area of need for many sport stakeholders. This study aimed to develop a standardised, evidence-based framework to guide the evaluation of sports technologies. In developing the framework, a review of standards, guidelines and research into sports technology was conducted. Following this, 55 experts across the sports industry were presented with a draft framework for feedback. Following a two-round Delphi survey, the final framework consisted of 25 measurable features grouped under five quality pillars. These were 1) Quality Assurance & Measurement (Accuracy, Repeatability, Reproducibility, Specifications), 2) Established Benefit (Construct Validity, Concurrent Validity, Predictive Validity, Functionality), 3) Ethics & Security (Compliance, Privacy, Ownership, Safety, Transparency, Environmental Sustainability), 4) User Experience (Usability, Robustness, Data Representation, Customer Support & Training, Accessibility) & 5) Data Management (Data Standardisation, Interoperability, Maintainability, Scalability). The framework can be used to help design and refine sports technology in order to optimise quality and maintain industry standards, as well as guide purchasing decisions by organisations. It may also serve to create a common language for organisations, manufacturers, investors, and consumers to improve the efficiency of their decision-making relating to sports technology.

Keywords: Assessment; guidelines; policy; quality; technology.