Audio-visual feedback for electromyographic control of vowel synthesis

Abstract

We describe the design and testing of a human machine interface to use surface electromyography (sEMG) collected from a covert location in response audio-visual feedback. Using sEMG collected from the Auricularis Posterior muscle, N=5 healthy participants participated in 6 sessions over multiple days to learn to transition from visual and vowel synthesis feedback to vowel synthesis feedback alone. Results indicate that individuals are able to learn sEMG control of vowel synthesis using auditory feedback alone with an average of 67% accuracy and that this skill can also generalize to new vowel targets. Control of vowel synthesis using covertly-recorded sEMG is a promising step toward more reliable mobile human machine interfaces for communication.

Fig. 1.

Electrode placement over the Auricularis Posterior.

Fig. 2.

Target ellipse locations in the f1-f2 plane. Solid lines indicate training targets and dotted lines indicate generalization targets.

Fig. 3.

Bars indicate mean performance across sessions (+/− 1 standard error). Individual performance levels of the 5 participants are shown by the lines.