Social neuroscience and hyperscanning techniques: past, present and future

Abstract

This paper reviews the published literature on the hyperscanning methodologies using hemodynamic or neuro-electric modalities. In particular, we describe how different brain recording devices have been employed in different experimental paradigms to gain information about the subtle nature of human interactions. This review also included papers based on single-subject recordings in which a correlation was found between the activities of different (non-simultaneously recorded) participants in the experiment. The descriptions begin with the methodological issues related to the simultaneous measurements and the descriptions of the results generated by such approaches will follow. Finally, a discussion of the possible future uses of such new approaches to explore human social interactions will be presented.

Keywords: EEG; Hyperscanning; NIRS; Social neuroscience; fMRI.

Figure 1. Different hyperscanning recording architectures

Different hyperscanning architectures employed for EEG recordings (A and B), fMRI recordings C) and NIRS recordings (from Montague et al., 2002, Dumas et al., 2010, Cui et al., 2012, Babiloni et al., 2011)

Figure 2. Different measures of interbrain synchronization or causal interactions in fMRI and EEG hyperscanning experiments

The figure shows different modalities to estimate interbrain correlations from hyperscanning recordings A) Time correlations between different hemodynamic signals (King-Casas et al., 2005) in two groups of subjects in a neuroeconomy game (“investor” on the left, “trustee” on the right). B) Patterns of interbrain coherence during simultaneous music production between two guitarists in an EEG hyperscanning experiment (head seen from above, nose up) (Lindenberger et al., 2009). C) Functional connections estimated between two brains of participants in an EEG hyperscanning experiment involving motor recognition and coordination (Dumas et al., 2010). Statistically significant Partial directed coherence (PDC) correlation in the frequency domains between different brain regions of a group of dyads involved in a Prisoner’s Dilemma EEG hyperscanning task. The arrows indicate the direction of the interaction (Astolfi et al., 2011)

Figure 3. Hyperscanning recordings related to games

This picture presents two EEG hyperscanning procedures, related to the execution of a card game (A) and of a ping-pong game (B). In this last application the cursors are moved by the modulation of the EEG activity of the two subjects. From Astolfi et al., 2010c and Babiloni et al., 2009.

Figure 4. A new device for fMRI hyperscanning

The picture shows in the left part A) an external vision of the dual coil, while in the section B) the dual coil ready for the recording. From Lee et al., 2012.

Figure 5. Different hyperscanning devices for hemodynamic and electric modalities

The figure shows in the upper part A) the split of the fibers to generate an NIRS hyperscanning device from one single NIRS device; in the lower part B) the EEG hyperscanning setup during an iterated Prisoner’s Dilemma task involving three subjects. Figures from Cui et al., 2011 and Astolfi et al., 2011.