System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Not all Blends are Equal: The BlEmoRe Dataset of Blended Emotion Expressions with Relative Salience Annotations
Stockholm University, Faculty of Social Sciences, Department of Psychology.ORCID iD: 0009-0002-7472-1882
Stockholm University, Faculty of Social Sciences, Department of Psychology.ORCID iD: 0009-0003-3569-6079
Stockholm University, Faculty of Social Sciences, Department of Psychology.
Show others and affiliations
Number of Authors: 72026 (English)In: The 20th IEEE International Conference on Automatic Face and Gesture Recognition, IEEE, 2026, article id 105Conference paper, Published paper (Refereed)
Abstract [en]

Humans often experience not just a single emotion at a time, but rather a blend of several emotions with varying salience. Despite the importance of such blended emotions, most video-based emotion recognition approaches are designed to recognize single emotions only. The few approaches that have attempted to recognize blended emotions typically cannot assess the relative salience of the emotions within a blend. This limitation largely stems from the lack of datasets containing a substantial number of blended emotion samples annotated with relative salience. To address this shortcoming, we introduce BlEmoRe, a novel dataset for multimodal (video, audio) blended emotion recognition that includes information on the relative salience of each emotion within a blend. Blemore comprises over 3,000 clips from 58 actors, performing 6 basic emotions and 10 distinct blends, where each blend has 3 different salience configurations (30/70, 50/50, 70/30). We conducted extensive evaluations of state-of-the-art video classification approaches on two blended emotion prediction tasks: (1) predicting the presence of emotions in a given sample, and (2) predicting the relative salience of emotions in a blend. Our results show that unimodal classifiers achieve up to 29% presence accuracy and 13% salience accuracy on the validation set, while multimodal methods yield clear improvements, with ImageBind + WavLM reaching 35% presence accuracy and HiCMAE 18% salience accuracy. On the held-out test set, the best models achieve 33% presence accuracy (VideoMAEv2 + HuBERT) and 18% salience accuracy (HiCMAE). In sum, the BlEmoRe dataset provides a valuable resource to advancing research on emotion recognition systems that account for the complexity and significance of blended emotion expressions.

Place, publisher, year, edition, pages
IEEE, 2026. article id 105
Series
International Conference on Automatic Face and Gesture Recognition, ISSN 2326-5396, E-ISSN 2770-8330
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:su:diva-259093DOI: 10.1109/FG67764.2026.11557034Scopus ID: 2-s2.0-105043367136ISBN: 979-8-3315-7231-0 (electronic)ISBN: 979-8-3315-7232-7 (print)OAI: oai:DiVA.org:su-259093DiVA, id: diva2:2098977
Conference
20th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2026), Kyoto, Japan, May 25-29, 2026
Available from: 2026-09-07 Created: 2026-09-07 Last updated: 2026-09-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Lachmann, TimIsraelsson, AlexandraTornberg, Christina

Search in DiVA

By author/editor
Lachmann, TimIsraelsson, AlexandraTornberg, Christina
By organisation
Department of Psychology
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 26 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf