Please use this identifier to cite or link to this item:
Title: Unity assumption in audiovisual emotion perception
Authors: Sou, Ka Lon
Say, Ashley
Xu, Hong
Keywords: Social sciences::Psychology
Issue Date: 2022
Source: Sou, K. L., Say, A. & Xu, H. (2022). Unity assumption in audiovisual emotion perception. Frontiers in Neuroscience, 16, 782318-.
Project: AISG2-RP-2020-019 
Journal: Frontiers in Neuroscience 
Abstract: We experience various sensory stimuli every day. How does this integration occur? What are the inherent mechanisms in this integration? The "unity assumption" proposes a perceiver's belief of unity in individual unisensory information to modulate the degree of multisensory integration. However, this has yet to be verified or quantified in the context of semantic emotion integration. In the present study, we investigate the ability of subjects to judge the intensities and degrees of similarity in faces and voices of two emotions (angry and happy). We found more similar stimulus intensities to be associated with stronger likelihoods of the face and voice being integrated. More interestingly, multisensory integration in emotion perception was observed to follow a Gaussian distribution as a function of the emotion intensity difference between the face and voice-the optimal cut-off at about 2.50 points difference on a 7-point Likert scale. This provides a quantitative estimation of the multisensory integration function in audio-visual semantic emotion perception with regards to stimulus intensity. Moreover, to investigate the variation of multisensory integration across the population, we examined the effects of personality and autistic traits of participants. Here, we found no correlation of autistic traits with unisensory processing in a nonclinical population. Our findings shed light on the current understanding of multisensory integration mechanisms.
ISSN: 1662-4548
DOI: 10.3389/fnins.2022.782318
Schools: School of Social Sciences 
Rights: © 2022 Sou, Say and Xu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Fulltext Permission: open
Fulltext Availability: With Fulltext
Appears in Collections:SSS Journal Articles

Files in This Item:
File Description SizeFormat 
Unity Assumption in Audiovisual Emotion Perception.pdf1.53 MBAdobe PDFThumbnail

Page view(s)

Updated on Sep 30, 2023


Updated on Sep 30, 2023

Google ScholarTM




Items in DR-NTU are protected by copyright, with all rights reserved, unless otherwise indicated.