Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Dec 22:8:2281.
doi: 10.3389/fpsyg.2017.02281. eCollection 2017.

Gaze Patterns in Auditory-Visual Perception of Emotion by Children with Hearing Aids and Hearing Children

Yifang Wang  1 , Wei Zhou  1 , Yanhong Cheng  2 , Xiaoying Bian  1
Affiliations

Gaze Patterns in Auditory-Visual Perception of Emotion by Children with Hearing Aids and Hearing Children

Yifang Wang et al. Front Psychol. .

Abstract

This study investigated eye-movement patterns during emotion perception for children with hearing aids and hearing children. Seventy-eight participants aged from 3 to 7 were asked to watch videos with a facial expression followed by an oral statement, and these two cues were either congruent or incongruent in emotional valence. Results showed that while hearing children paid more attention to the upper part of the face, children with hearing aids paid more attention to the lower part of the face after the oral statement was presented, especially for the neutral facial expression/neutral oral statement condition. These results suggest that children with hearing aids have an altered eye contact pattern with others and a difficulty in matching visual and voice cues in emotion perception. The negative cause and effect of these gaze patterns should be avoided in earlier rehabilitation for hearing-impaired children with assistive devices.

Keywords: auditory-visual perception; emotion perception; eye-movement; hearing-impaired; oral statement.

PubMed Disclaimer

Figures

FIGURE 1
FIGURE 1
An example of AOIs.
FIGURE 2
FIGURE 2
The percentage for number of fixations during the periods with facial expression (top panel) and oral statement (bottom panel) in each condition. The ordinate (Y axis) presents the quotient of the fixation number within the upper part of the face divided by the total fixation number on the stimuli.
FIGURE 3
FIGURE 3
The scatter plots between time period and percentage for number of fixations in each condition. The abscissa (X axis) presents eight time periods with 1.5 s for each one. The ordinate (Y axis) presents the quotient of the fixation number within the upper part of the face divided by the total fixation number on the stimuli.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Adams R. B., Nelson A. J. (2016). “Eye behavior and gaze,” in APA Handbook of Nonverbal Communication, eds Matsumoto D., Hwang H. C., Frank M. G. (Washington, DC: American Psychological Association; ), 335–362. 10.1037/14669-013 - DOI
    1. Agrafiotis D., Canagarajah N., Bull D. R., Dye M. (2003). Perceptually optimised sign language video coding based on eye tracking analysis. Electr. Lett. 39 1703–1705. 10.1049/el:20031140 - DOI
    1. Aviezer H., Hassin R. R., Ryan J., Grady C., Susskind J., Anderson A., et al. (2008). Angry, disgusted, or afraid? Studies on the malleability of emotion perception. Psychol. Sci. 19 724–732. 10.1111/j.1467-9280.2008.02148.x - DOI - PubMed
    1. Banziger T., Grandjean D., Scherer K. R. (2009). Emotion recognition from expressions in face, voice, and body: the multimodal emotion recognition test (mert). Emotion 9 691–704. 10.1037/a0017088 - DOI - PubMed
    1. Barrett L. F., Kensinger E. A. (2010). Context is routinely encoded during emotion perception. Psychol. Sci. 21 595–599. 10.1177/0956797610363547 - DOI - PMC - PubMed

LinkOut - more resources