Abstract representations of associated emotions in the human brain

Junsuk Kim, Johannes Schultz, Tim Rohe, Christian Wallraven, Seong Whan Lee, Heinrich Bulthoff

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Emotions can be aroused by various kinds of stimulus modalities. Recent neuroimaging studies indicate that several brain regions represent emotions at an abstract level, i.e., independently from the sensory cues from which they are perceived (e.g., face, body, or voice stimuli). If emotions are indeed represented at such an abstract level, then these abstract representations should also be activated by the memory of an emotional event. We tested this hypothesis by asking human participants to learn associations between emotional stimuli (videos of faces or bodies) and non-emotional stimuli (fractals). After successful learning, fMRI signals were recorded during the presentations of emotional stimuli and emotion-associated fractals. We tested whether emotions could be decoded from fMRI signals evoked by the fractal stimuli using a classifier trained on the responses to the emotional stimuli (and vice versa). This was implemented as a whole-brain searchlight, multivoxel activation pattern analysis, which revealed successful emotion decoding in four brain regions: posterior cingulate cortex (PCC), precuneus, MPFC, and angular gyrus. The same analysis run only on responses to emotional stimuli revealed clusters in PCC, precuneus, and MPFC. Multidimensional scaling analysis of the activation patterns revealed clear clustering of responses by emotion across stimulus types. Our results suggest that PCC, precuneus, and MPFC contain representations of emotions that can be evoked by stimuli that carry emotional information themselves or by stimuli that evoke memories of emotional stimuli, while angular gyrus is more likely to take part in emotional memory retrieval.

Original languageEnglish
Pages (from-to)5655-5663
Number of pages9
JournalJournal of Neuroscience
Volume35
Issue number14
DOIs
Publication statusPublished - 2015 Apr 8

Fingerprint

Emotions
Parietal Lobe
Brain
Fractals
Gyrus Cinguli
Activation Analysis
Magnetic Resonance Imaging
Neuroimaging
Cues
Cluster Analysis
Learning

Keywords

  • Abstract representation
  • Associated emotion
  • fMRI
  • MVPA

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Abstract representations of associated emotions in the human brain. / Kim, Junsuk; Schultz, Johannes; Rohe, Tim; Wallraven, Christian; Lee, Seong Whan; Bulthoff, Heinrich.

In: Journal of Neuroscience, Vol. 35, No. 14, 08.04.2015, p. 5655-5663.

Research output: Contribution to journalArticle

@article{7ee6f5b78b0f404fab7c27bfe0a587a3,
title = "Abstract representations of associated emotions in the human brain",
abstract = "Emotions can be aroused by various kinds of stimulus modalities. Recent neuroimaging studies indicate that several brain regions represent emotions at an abstract level, i.e., independently from the sensory cues from which they are perceived (e.g., face, body, or voice stimuli). If emotions are indeed represented at such an abstract level, then these abstract representations should also be activated by the memory of an emotional event. We tested this hypothesis by asking human participants to learn associations between emotional stimuli (videos of faces or bodies) and non-emotional stimuli (fractals). After successful learning, fMRI signals were recorded during the presentations of emotional stimuli and emotion-associated fractals. We tested whether emotions could be decoded from fMRI signals evoked by the fractal stimuli using a classifier trained on the responses to the emotional stimuli (and vice versa). This was implemented as a whole-brain searchlight, multivoxel activation pattern analysis, which revealed successful emotion decoding in four brain regions: posterior cingulate cortex (PCC), precuneus, MPFC, and angular gyrus. The same analysis run only on responses to emotional stimuli revealed clusters in PCC, precuneus, and MPFC. Multidimensional scaling analysis of the activation patterns revealed clear clustering of responses by emotion across stimulus types. Our results suggest that PCC, precuneus, and MPFC contain representations of emotions that can be evoked by stimuli that carry emotional information themselves or by stimuli that evoke memories of emotional stimuli, while angular gyrus is more likely to take part in emotional memory retrieval.",
keywords = "Abstract representation, Associated emotion, fMRI, MVPA",
author = "Junsuk Kim and Johannes Schultz and Tim Rohe and Christian Wallraven and Lee, {Seong Whan} and Heinrich Bulthoff",
year = "2015",
month = "4",
day = "8",
doi = "10.1523/JNEUROSCI.4059-14.2015",
language = "English",
volume = "35",
pages = "5655--5663",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "14",

}

TY - JOUR

T1 - Abstract representations of associated emotions in the human brain

AU - Kim, Junsuk

AU - Schultz, Johannes

AU - Rohe, Tim

AU - Wallraven, Christian

AU - Lee, Seong Whan

AU - Bulthoff, Heinrich

PY - 2015/4/8

Y1 - 2015/4/8

N2 - Emotions can be aroused by various kinds of stimulus modalities. Recent neuroimaging studies indicate that several brain regions represent emotions at an abstract level, i.e., independently from the sensory cues from which they are perceived (e.g., face, body, or voice stimuli). If emotions are indeed represented at such an abstract level, then these abstract representations should also be activated by the memory of an emotional event. We tested this hypothesis by asking human participants to learn associations between emotional stimuli (videos of faces or bodies) and non-emotional stimuli (fractals). After successful learning, fMRI signals were recorded during the presentations of emotional stimuli and emotion-associated fractals. We tested whether emotions could be decoded from fMRI signals evoked by the fractal stimuli using a classifier trained on the responses to the emotional stimuli (and vice versa). This was implemented as a whole-brain searchlight, multivoxel activation pattern analysis, which revealed successful emotion decoding in four brain regions: posterior cingulate cortex (PCC), precuneus, MPFC, and angular gyrus. The same analysis run only on responses to emotional stimuli revealed clusters in PCC, precuneus, and MPFC. Multidimensional scaling analysis of the activation patterns revealed clear clustering of responses by emotion across stimulus types. Our results suggest that PCC, precuneus, and MPFC contain representations of emotions that can be evoked by stimuli that carry emotional information themselves or by stimuli that evoke memories of emotional stimuli, while angular gyrus is more likely to take part in emotional memory retrieval.

AB - Emotions can be aroused by various kinds of stimulus modalities. Recent neuroimaging studies indicate that several brain regions represent emotions at an abstract level, i.e., independently from the sensory cues from which they are perceived (e.g., face, body, or voice stimuli). If emotions are indeed represented at such an abstract level, then these abstract representations should also be activated by the memory of an emotional event. We tested this hypothesis by asking human participants to learn associations between emotional stimuli (videos of faces or bodies) and non-emotional stimuli (fractals). After successful learning, fMRI signals were recorded during the presentations of emotional stimuli and emotion-associated fractals. We tested whether emotions could be decoded from fMRI signals evoked by the fractal stimuli using a classifier trained on the responses to the emotional stimuli (and vice versa). This was implemented as a whole-brain searchlight, multivoxel activation pattern analysis, which revealed successful emotion decoding in four brain regions: posterior cingulate cortex (PCC), precuneus, MPFC, and angular gyrus. The same analysis run only on responses to emotional stimuli revealed clusters in PCC, precuneus, and MPFC. Multidimensional scaling analysis of the activation patterns revealed clear clustering of responses by emotion across stimulus types. Our results suggest that PCC, precuneus, and MPFC contain representations of emotions that can be evoked by stimuli that carry emotional information themselves or by stimuli that evoke memories of emotional stimuli, while angular gyrus is more likely to take part in emotional memory retrieval.

KW - Abstract representation

KW - Associated emotion

KW - fMRI

KW - MVPA

UR - http://www.scopus.com/inward/record.url?scp=84929359439&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929359439&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.4059-14.2015

DO - 10.1523/JNEUROSCI.4059-14.2015

M3 - Article

VL - 35

SP - 5655

EP - 5663

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 14

ER -