- Yangyang Xia, Li-Wei Chen, Alexander I. Rudnicky, R. Stern. 2021. Temporal Context in Speech Emotion Recognition. Abstract: We investigate the importance of temporal context for speech emotion recognition (SER). Two SER systems trained on traditional and learned features, respectively, are developed to predict categorical labels of emotion. For traditional acoustical features, we study the combination of ﬁlterbank features and prosodic features and the impact on SER when the temporal context of these features is expanded by learnable spectro-temporal receptive ﬁelds (STRFs). Experiments show that the system trained on learnable STRFs outperforms other reported systems evalu-ated with a similar setup. We also demonstrate that the wav2vec features, pretrained with long temporal context, are superior to traditional features. We then introduce a novel segment-based learning objective to constrain our classiﬁer to extract local emotion features from the large temporal context. Combined with the learning objective and ﬁne-tuning strategy, our top-line system using wav2vec features reaches state-of-the-art performance on the IEMOCAP dataset.
