@inproceedings{jung-etal-2023-bring,
    title = "Bring More Attention to Syntactic Symmetry for Automatic Postediting of High-Quality Machine Translations",
    author = "Jung, Baikjin  and
      Lee, Myungji  and
      Lee, Jong-Hyeok  and
      Kim, Yunsu",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.acl-short.122",
    doi = "10.18653/v1/2023.acl-short.122",
    pages = "1433--1441",
    abstract = "Automatic postediting (APE) is an automated process to refine a given machine translation (MT). Recent findings present that existing APE systems are not good at handling high-quality MTs even for a language pair with abundant data resources, English{--}German: the better the given MT is, the harder it is to decide what parts to edit and how to fix these errors. One possible solution to this problem is to instill deeper knowledge about the target language into the model. Thus, we propose a linguistically motivated method of regularization that is expected to enhance APE models{'} understanding of the target language: a loss function that encourages symmetric self-attention on the given MT. Our analysis of experimental results demonstrates that the proposed method helps improving the state-of-the-art architecture{'}s APE quality for high-quality MTs.",
}

Automatic postediting (APE) is an automated process to refine a given machine translation (MT). Recent findings present that existing APE systems are not good at handling high-quality MTs even for a language pair with abundant data resources, English{--}German: the better the given MT is, the harder it is to decide what parts to edit and how to fix these errors. One possible solution to this problem is to instill deeper knowledge about the target language into the model. Thus, we propose a linguistically motivated method of regularization that is expected to enhance APE models{'} understanding of the target language: a loss function that encourages symmetric self-attention on the given MT. Our analysis of experimental results demonstrates that the proposed method helps improving the state-of-the-art architecture{'}s APE quality for high-quality MTs.
Jung, Baikjin Lee, Myungji Lee, Jong-Hyeok Kim, Yunsu
Bring More Attention to Syntactic Symmetry for Automatic Postediting of High-Quality Machine Translations