- P. Frederiksen, J. Villalba, Shinji Watanabe, Z. Tan, N. Dehak. 2018. Effectiveness of Single-Channel BLSTM Enhancement for Language Identification. Abstract: This paper proposes to apply deep neural network (DNN)-based single-channel speech enhancement (SE) to language identiﬁcation. The 2017 language recognition evaluation (LRE17) introduced noisy audios from videos, in addition to the telephone conversation from past challenges. Because of that, adapting models from telephone speech to noisy speech from the video domain was required to obtain optimum performance. However, such adaptation requires knowledge of the audio domain and availability of in-domain data. Instead of adaptation, we propose to use a speech enhancement step to clean up the noisy audio as preprocessing for language identiﬁcation. We used a bi-directional long short-term memory (BLSTM) neural network, which given log-Mel noisy features predicts a spectral mask indicating how clean each time-frequency bin is. The noisy spectrogram is multiplied by this predicted mask to obtain the enhanced magnitude spectrogram, and it is transformed back into the time domain by using the unaltered noisy speech phase. The experiments show signiﬁcant improvement to language identiﬁcation of noisy speech, for systems with and without domain adaptation, while preserving the identiﬁcation performance in the telephone audio domain. In the best adapted state-of-the-art bottleneck i-vector system the relative improvement is 11.3% for noisy speech.
