@inproceedings{shang-etal-2023-hw,
    title = "The {HW}-{TSC}{'}s Simultaneous Speech-to-Speech Translation System for {IWSLT} 2023 Evaluation",
    author = "Shang, Hengchao  and
      Rao, Zhiqiang  and
      Li, Zongyao  and
      Wu, Zhanglin  and
      Guo, Jiaxin  and
      Wang, Minghan  and
      Wei, Daimeng  and
      Li, Shaojun  and
      Yu, Zhengzhe  and
      Chen, Xiaoyu  and
      Lei, Lizhi  and
      Yang, Hao",
    editor = "Salesky, Elizabeth  and
      Federico, Marcello  and
      Carpuat, Marine",
    booktitle = "Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada (in-person and online)",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.iwslt-1.36",
    doi = "10.18653/v1/2023.iwslt-1.36",
    pages = "383--388",
    abstract = "In this paper, we present our submission to the IWSLT 2023 Simultaneous Speech-to-Speech Translation competition. Our participation involves three language directions: English-German, English-Chinese, and English-Japanese. Our solution is a cascaded incremental decoding system, consisting of an ASR model, an MT model, and a TTS model. By adopting the strategies used in the Speech-to-Text track, we have managed to generate a more confident target text for each audio segment input, which can guide the next MT incremental decoding process. Additionally, we have integrated the TTS model to seamlessly reproduce audio files from the translation hypothesis. To enhance the effectiveness of our experiment, we have utilized a range of methods to reduce error conditions in the TTS input text and improve the smoothness of the TTS output audio.",
}

In this paper, we present our submission to the IWSLT 2023 Simultaneous Speech-to-Speech Translation competition. Our participation involves three language directions: English-German, English-Chinese, and English-Japanese. Our solution is a cascaded incremental decoding system, consisting of an ASR model, an MT model, and a TTS model. By adopting the strategies used in the Speech-to-Text track, we have managed to generate a more confident target text for each audio segment input, which can guide the next MT incremental decoding process. Additionally, we have integrated the TTS model to seamlessly reproduce audio files from the translation hypothesis. To enhance the effectiveness of our experiment, we have utilized a range of methods to reduce error conditions in the TTS input text and improve the smoothness of the TTS output audio.
Shang, Hengchao Rao, Zhiqiang Li, Zongyao Wu, Zhanglin Guo, Jiaxin Wang, Minghan Wei, Daimeng Li, Shaojun Yu, Zhengzhe Chen, Xiaoyu Lei, Lizhi Yang, Hao
The HW-TSC's Simultaneous Speech-to-Speech Translation System for IWSLT 2023 Evaluation