基于一维心电二维特征提取的情绪识别研究

      Emotion Recognition Based on 2D Feature Extraction from 1D ECG

      • 摘要: 客观的情绪识别在生理健康、医疗与教育等领域均有着重要的研究意义。从信号获取难易程度、成本与使用者接受度等角度来看,人体的心电信号是实现客观情绪识别的重要生物标志物。针对深度学习网络在一维心电信号时-空特征提取、融合方面的难点,该文首先提出了一种基于小波包分解的1D-2D信号转换方法,将一维心电信号转换为“二维图像”;随后,以此“二维图像”作为输入,以ResNet18作为骨干网,设计了Fusion Block模块,提高了网络的时-空特征提取、融合能力。该文在WESAD与SWELL-KW数据集上进行了情绪识别任务,实验结果表明,与次优方法相比,该文提出的情绪识别方法在准确度与F1分数两个指标上分别高出2.19%与4.48%,为情绪的客观识别提供了技术支持。

         

        Abstract: Objective emotion recognition is significantly important for some fields such as physiological health, healthcare and education. From the perspectives of signal acquisition difficulty, cost and user acceptance, the electrocardiogram (ECG) signals are appropriate biomarkers for achieving objective emotion recognition. As it is difficult for deep-learning based methods to extract and fuse the spatio-temporal features of one-dimensional ECG signals, a 1D-2D signal transformation method based on wavelet packet decomposition was proposed firstly, which converted one-dimensional ECG signals to "two-dimensional images". Subsequently, the ResNet18 was used as the backbone network and the "two-dimensional images" were used as its input, where a Fusion Block module was designed to improve the network's spatio-temporal feature extraction and fusion capabilities. Finally, extensive experiments were implemented for the emotion recognition task on the WESAD and SWELL-KW datasets. The experimental results demonstrated that in comparison with the suboptimal method, the emotion recognition method proposed in this paper improved the performance in both metrics of average accuracy and F1 scores by 2.19 and 4.48 percentage points respectively, which may provide the technical support for objective emotion recognition.

         

      /

      返回文章
      返回