Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Apr;22(2):291-303.
doi: 10.3758/s13415-021-00961-2. Epub 2021 Nov 22.

Audio and visual speech emotion activate the left pre-supplementary motor area

Joseph Rovetti  1   2 , Fran Copelli  1 , Frank A Russo  3
Affiliations

Audio and visual speech emotion activate the left pre-supplementary motor area

Joseph Rovetti et al. Cogn Affect Behav Neurosci. 2022 Apr.

Abstract

Sensorimotor brain areas have been implicated in the recognition of emotion expressed on the face and through nonverbal vocalizations. However, no previous study has assessed whether sensorimotor cortices are recruited during the perception of emotion in speech-a signal that includes both audio (speech sounds) and visual (facial speech movements) components. To address this gap in the literature, we recruited 24 participants to listen to speech clips produced in a way that was either happy, sad, or neutral in expression. These stimuli also were presented in one of three modalities: audio-only (hearing the voice but not seeing the face), video-only (seeing the face but not hearing the voice), or audiovisual. Brain activity was recorded using electroencephalography, subjected to independent component analysis, and source-localized. We found that the left presupplementary motor area was more active in response to happy and sad stimuli than neutral stimuli, as indexed by greater mu event-related desynchronization. This effect did not differ by the sensory modality of the stimuli. Activity levels in other sensorimotor brain areas did not differ by emotion, although they were greatest in response to visual-only and audiovisual stimuli. One possible explanation for the pre-SMA result is that this brain area may actively support speech emotion recognition by using our extensive experience expressing emotion to generate sensory predictions that in turn guide our perception.

Keywords: Electroencephalography; Emotion; Independent component analysis; Presupplementary motor area; Sensorimotor simulation; Speech.

PubMed Disclaimer

References

    1. Alario, F.-X., Chainay, H., Lehericy, S., & Cohen, L. (2006). The role of the supplementary motor area (SMA) in word production. Brain Research, 1076, 129–143. - PubMed
    1. Avenanti, A., Bolognini, N., Maravita, A., & Aglioti, S. M. (2007). Somatic and motor components of action simulation. Current Biology, 17, 2129–2135. - PubMed
    1. Aziz-Zadeh, L., Sheng, T., & Gheytanchi, A. (2010). Common premotor regions for the perception and production of prosody and correlations with empathy and prosodic ability. PLOS One, 5(1), 1–8.
    1. Barbosa, A., Yehia, H., & Vatikiotis-Bateson, E. (2008). Linguistically valid movement behavior measured non-invasively. AVSP-2008, 173–177.
    1. Bastiaansen, J. A. C. J., Thioux, M., & Keysers, C. (2009). Evidence for mirror systems in emotions. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1528), 2391–2404.

Publication types

LinkOut - more resources