Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2016 Jun 1;17(1):29.
doi: 10.1186/s12868-016-0258-7.

Multimodal interaction in the insect brain

Affiliations

Multimodal interaction in the insect brain

Anna Balkenius et al. BMC Neurosci. .

Abstract

Background: The magnitude of multimodal enhancement in the brain is believed to depend on the stimulus intensity and timing. Such an effect has been found in many species, but has not been previously investigated in insects.

Results: We investigated the responses to multimodal stimuli consisting of an odour and a colour in the antennal lobe and mushroom body of the moth Manduca sexta. The mushroom body shows enhanced responses for multimodal stimuli consisting of a general flower odour and a blue colour. No such effect was seen for a bergamot odour. The enhancement shows an inverse effectiveness where the responses to weaker multimodal stimuli are amplified more than those to stronger stimuli. Furthermore, the enhancement depends on the precise timing of the two stimulus components.

Conclusions: Insect multimodal processing show both the principle of inverse effectiveness and the existence of an optimal temporal window.

Keywords: Inverse effeciveness; Moth; Multmodal interaction; Superadditivity; Temporal window.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Responses of the antennal lobe to different odour concentrations (BM) with and without the colour stimulus (n = 18). Error bars show standard error of mean
Fig. 2
Fig. 2
Responses of the mushroom body to different odour concentrations (BM) with and without the colour stimulus (n = 21). Error bars show standard error of mean
Fig. 3
Fig. 3
Responses of the antennal lobe to different odour concentrations (PAA) with and without the colour stimulus (n = 9). Error bars show standard error of mean
Fig. 4
Fig. 4
Activity patterns in AL example of the activity pattern in the antennal lobe with different odour concentration. Top Multimodal stimulus. Bottom Only odour
Fig. 5
Fig. 5
Activity patterns in MB Example of the activity pattern in the mushroom body with different odour concentrations. Top Multimodal stimulus. Bottom Only odour
Fig. 6
Fig. 6
Responses of the mushroom body to different odour concentrations (PAA) with and without the colour stimulus (n = 22). Error bars show standard error of mean
Fig. 7
Fig. 7
Inverse effectiveness of multimodal interaction in the mushroom body The multimodal enhancement is larger for the lower odour concentrations (n = 22)
Fig. 8
Fig. 8
No responses to visual stimulus. The presentation of a visual stimulus (V) does not elicit a measurable response in the MB when compared to not stimulus at all (N) (n = 94)
Fig. 9
Fig. 9
Response peak latency density plot of the latency of the response peak for three odour concentrations relative to the start of each trial for the data set in Fig. 6 (red multmodal, green odour only). There are no differences in the respons timing for any of the odour concentrations
Fig. 10
Fig. 10
Stimulus timing five different temporal relations between the visual and the odour components of the multimodal stimulus stimulus used in the final experiment (ae) and the blank stimulus (f)
Fig. 11
Fig. 11
Temporal window the temporal window for multimodal interaction in the mushroom body for the highest (blue) and lowest (green) odour concentration (n = 122). For both concentrations, the response was significantly enhanced, compared to the timing A, when the visual stimulus component coincided (Δt=0 s) or came slightly after (Δt=0.5 s) the odour. For the higher concentration, there was also an significant increase in the response when the visual stimulus preceded the odour with half a second (Δt=-0.5 s). The different temporal relations are shown in Fig. 10. Error bars show standard error of mean

References

    1. Stein BE, Meredith MA. The merging of the senses. Cambridge: The MIT Press; 1993.
    1. Ernst MO, Bülthoff HH. Merging the senses into a robust percept. Trends Cogn Sci. 2004;8(4):162–169. doi: 10.1016/j.tics.2004.02.002. - DOI - PubMed
    1. Sella I, Reiner M, Pratt H. Natural stimuli from three coherent modalities enhance behavioral responses and electrophysiological cortical activity in humans. Int J Psychophysiol. 2014;93(1):45–55. doi: 10.1016/j.ijpsycho.2013.11.003. - DOI - PubMed
    1. Eagleman DM. How does the timing of neural signals map onto the timing of perception? In: Space and time in perception and action. 2010. p. 216–231.
    1. Balkenius A, Bisch-Knaden S, Hansson B. Interaction of visual and odour cues in the mushroom body of the hawkmoth Manduca sexta. J Exp Biol. 2009;212(4):535–541. doi: 10.1242/jeb.021220. - DOI - PubMed

Publication types

LinkOut - more resources