Factors Influencing the Reliability of Auditory-Perceptual Evaluation of Voice: A Scoping Review

Abstract

Objectives: The primary objective of this scoping review is to identify and summarize the factors influencing the reliability of the auditory-perceptual evaluation of voice reported in the existing literature. The secondary objective is to identify the factors affecting the reliability of the auditory-perceptual evaluation of voice that have empirical support.

Study design: Scoping review.

Methods: Nine online databases were searched, and a backward search was conducted to identify studies that examined the factors affecting rater reliability in the auditory-perceptual evaluation of voice. Our initial online and manual search revealed 2643 studies, of which 101 sources met the eligibility criteria for data extraction.

Results: The scoping review revealed 6 broad factors and 17 subfactors that may influence rater reliability on the auditory-perceptual evaluation of voice. The most studied factor was voice samples (22.0%), followed by vocal parameters and rater characteristics (20.5%), rating scales (15.7%), training (13.4%), and rating tasks (7.9%). Thirty-two studies reported reliability indices and conducted statistical tests for the differences in reliability. Among these factors, the most frequent were training and rating scales (28.6%), voice samples (17.1%), rater characteristics and rating tasks (11.4%), and vocal parameters (2.9%).

Conclusions: The findings of this review allow researchers, clinicians, and educators to understand the various factors that affect the reliability of the auditory-perceptual evaluations of voice. The results may also guide researchers and educators in developing training programs for less experienced clinicians to improve their reliability in the auditory-perceptual evaluation of voice.

Keywords: Adult; Auditory perception; Reliability; Speech perception; Voice disorders; Voice quality.