期刊文献+

动态面孔和语音情绪信息的整合加工及神经生理机制 预览 被引量:3

The Integration of Dynamic Facial and Vocal Emotion and Its Neurophysiological Mechanism
在线阅读 免费下载
收藏 分享 导出
摘要 面孔、语音情绪信息的整合加工是社会交往的重要技能,近年来逐渐引起心理学、神经科学研究的关注。当前研究较为系统地考察了双通道情绪信息整合加工的行为表现和影响因素,也很好地回答了“何时整合”与“在哪里整合”两个认知神经科学关注的问题,但对“面孔、语音情绪信息能否整合为一致情绪客体?双通道情绪信息在大脑中如何整合为一?”两个关键问题都还缺乏系统研究。因此,本项目拟系统操纵面孔、语音刺激的情绪凸显度和任务要求,引入动态面孔.语音刺激以增加外部效度,综合运用行为和电生理技术,从多角度挖掘数据,特别是引入神经振荡(时频、相干)分析,系统考察动态性面孔和语音情绪信息是否能整合成一致情绪客体,并在神经振荡层面探明双通道情绪信息整合的机制。 The integration of facial-vocal emotion is an important factor for successful communication that intrigue psychologists and neuroscientists in recent years. Previous studies have elaborated on the behavioral performance and the influence factors for facial-vocal emotion integration, as well as "when" and "where" information from the two modes integrated. However, it remains open questions whether the integration of facial-vocal emotion follows the principles of multisensory integration (eg.the principle of inverse effectiveness), and how the bimodal emotional information merges into a coherence emotional object. Therefore, taking "whether facial-vocal emotion integration obeys the principle of inverse effectiveness" as main line, we designed six experiments which manipulated emotional salience of the dynamic facial-vocal emotional stimuli and task demands systematically. Moreover, using multi-dimensional analysis of behavioral and EEG data, especially time-frequency and coherence analysis of EEG data, we aimed to answer the two proposed questions, to further reveal the neurophysiological mechanism of facial-vocal emotion integration.
作者 王苹 潘治辉 张立洁 陈煦海 WANG Ping; PAN Zhihui; ZHANG Lijie; CHEN Xuhai (Shaanxi Province Key Laboratory of Behavior and Cognitive Neuroscience, School of Psychology, Shaanxi Normal University, Xi'an 710062, China)
出处 《心理科学进展》 CSSCI CSCD 北大核心 2015年第7期1109-1117,共9页 Advances In Psychological Science
基金 国家自然科学基金项目(31300835),教育部人文社科基金(12XJC190003),中央高校基本科研业务费(14SZYB07)资助.
关键词 面孔情绪 语音情绪 整合加工 神经振荡 事件相关电位 facial emotion vocal emotion integration neural oscillation ERPs
作者简介 通讯作者:陈煦海,E-mail:shiningocean@silnu.edu.cn shiningoceanchan@gmail.com
  • 相关文献

参考文献50

  • 1吴奇,申寻兵,傅小兰.微表情研究及其应用[J].心理科学进展,2010(9):1359-1368. 被引量:73
  • 2张亮,孙向红,张侃.情绪信息的多通道整合[J].心理科学进展,2009(6):1133-1138. 被引量:6
  • 3Briick, C” Kreifelts, B” & Wildgruber* D. (2011). Emotional voices in context: A neurobiological model of multimodal affective information processing. Physics of Life Reviews, 8(4), 383403. 被引量:1
  • 4Charbonneau, G” Bertone, A., Lepore, F., Nassim, M., Lassonde, M., Mottron, L., & Collignon, O. (2013). Multilevel deficits in the processing of audio-visual emotion expressions in Autism Spectrum Disorders. Neuropsychologia, 5/(5), 1002-1010. 被引量:1
  • 5Chen, X” Yang, X.,& Yang, Y. (2013). Neurophysiological mechanism of implicit processing of vocal emotion transition. Acta Psychologica Sinica, 45(4), 416-426. 被引量:1
  • 6Chen, X.,Zhao, L., Jiang, A., & Yang, Y. (2011). Event-related potential correlates of the expectancy violation effect during emotional prosody processing. Biological Psychology, 86(3), 158-167. 被引量:1
  • 7Collignon, 0., Girard, S., Gosselin, F.,Saint-Amour, D., Lepore, F., & Lassonde, M. (2010). Women process multisensory emotion expressions more efficiently than men. Neuropsychologia, 48{\), 220-225. 被引量:1
  • 8De Gelder, B.,Bocker, K. B.,Tuomainen, J” Hensen, M.,& Vroomen,J. (1999). The combined perception of emotion from voice and face: Early interaction revealed by human electric brain responses. Neuroscience Letters, 260(2), 133-136. 被引量:1
  • 9De Gelder, B,,Pourtois, G,,& Weiskrantz, L. (2002). Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proceedings of the National Academy of Sciences of the United States of America, 99(6),4121-1126. 被引量:1
  • 10De Gelder, B.,& Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, /4(3), 289-311. 被引量:1

二级参考文献74

  • 1Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia, 40, 817-826. 被引量:1
  • 2Barbara, A. B., Lucy J. M., William J. G., & Patricia, L. D. (2008). Multisensory integration in children: A preliminary ERP study. Brain Research, 1242, 283-290. 被引量:1
  • 3Bavelier, D., Neville, H. J. (2002). Cross-modal Plasticity: where and how. Nature Reviews Neuroscience, 3, 443~t52. 被引量:1
  • 4Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., & Lepore, F. (2008). Audio-visual integration of emotion expression. Brain Research, 1242, 126-135. 被引量:1
  • 5de Gelder, B., Boecker, K., Tuomainen. J., Hensen, M., & Vroomen, J. (1999). The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses. Neuroscience Letters, 260, 133-136. 被引量:1
  • 6de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14, 289-311. 被引量:1
  • 7de Gelder, B., Vroomen, J., de Jong, S. J., Masthoff, E.D., Trompenaars, F. J., & Hodiamont, P. (2005). Multisensory integration of emotional faces and voices in schizophrenics Schizophrenia Research, 72, 195-203. 被引量:1
  • 8de Gelder, B., Morris, J. S., & Dolan, R. J. (2005). Unconscious fear influences emotional awareness of faces and voices. PNAS, 102, 18682-87. 被引量:1
  • 9Dolan, R.J., Morris, J.S., & de Gelder, B. (2001). Crossmodal binding of fear in voice and face. Proceeding of National Academy Science USA, 98, 10006-10010. 被引量:1
  • 10Driver, J., & Noesselt, T. (2008). Multisensory Interplay Reveals Crossmodal Influences on 'Sensory-Specific' Brain Regions. Neuron, 57, 11-20. 被引量:1

共引文献77

同被引文献13

引证文献3

投稿分析

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部 意见反馈