Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Jul 23:5:802.
doi: 10.3389/fpsyg.2014.00802. eCollection 2014.

Thermal expression of intersubjectivity offers new possibilities to human-machine and technologically mediated interactions

Arcangelo Merla  1
Affiliations

Thermal expression of intersubjectivity offers new possibilities to human-machine and technologically mediated interactions

Arcangelo Merla. Front Psychol. .

Abstract

The evaluation of the psychophysiological state of the interlocutor is an important element of interpersonal relationships and communication. Thermal infrared (IR) imaging has proved to be a reliable tool for non-invasive and contact-less evaluation of vital signs, psychophysiological responses, and emotional states. This technique is quickly spreading in many fields, from psychometrics to social and developmental psychology; and from the touch-less monitoring of vital signs and stress, up to the human-machine interaction. In particular, thermal IR imaging promises to be of use for gathering information about affective states in social situations. This paper presents the state of the art of thermal IR imaging in psychophysiology and in the assessment of affective states. The goal is to provide insights about its potentialities and limits for its use in human-artificial agent interaction in order to contribute to a major issue in the field: the perception by an artificial agent of human psychophysiological and affective states.

Keywords: emotions; human–machine interaction; intersubjectivity; psychophysiology; thermal infrared imaging.

PubMed Disclaimer

Figures

FIGURE 1
FIGURE 1
Facial thermal imprints of a mother–child–other mother triad synchronization during distressing situation (adapted from Manini et al., 2013). The picture shows many of the features of thermal imaging in psychophysiology, especially the possibility of simultaneous recording several individuals sharing an experimental condition or a social interaction. Facial temperature variations are shown across experimental phases. Such variations, expression of the sympathetic activity may regard not only the average value but also the spatial distribution of the temperature across the regions of interest.
FIGURE 2
FIGURE 2
Visible and thermal facial imprints of happiness (upper panel) and disgust (lower panel). Thermal infrared (IR) imaging provides physiological response in addition to the behavioral ones measured through facial expression. Changes into the temperature distribution associated with the two different conditions could help in classifying affective states.
See this image and copyright information in PMC

References

    1. Alonso-Martín F., Malfaz M., Sequeira J., Gorostiza J. F., Salichs M. A. (2013). A multimodal emotion detection system during human–robot interaction. Sensors 13 15549–15581 10.3390/s131115549 - DOI - PMC - PubMed
    1. Breazeal C. (2003). Emotion and sociable humanoid robots. Int. J. Hum. Comp. Stud. 59 119–155 10.1016/S1071-5819(03)00018-1 - DOI
    1. Bruce A., Nourbakhsh I., Simmons R. (2002). “The role of expressiveness and attention in human–robot interaction,” in Proceedings of the IEEE International Conference on Robotics and Automation, ICRA Washington, DC
    1. Buddharaju P., Dowdall J., Tsiamyrtzis P., Shastri D., Pavlidis I., Frank M. G. (2005). “Automatic Thermal Monitoring System (ATHEMOS) for Deception Detection,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Vol. 2 (Washington, DC: IEEE Computer Society; ) 1179
    1. Butler E. A., Egloff B., Wilhelm F. H., Smith N. C., Erickson E. A., Gross J. J. (2003). The social consequences of expressive suppression. Emotion 3 48–67 10.1037/1528-3542.3.1.48 - DOI - PubMed