@inproceedings{pan-etal-2023-query,
    title = "Query Generation Using {GPT}-3 for {CLIP}-Based Word Sense Disambiguation for Image Retrieval",
    author = "Pan, Xiaomeng  and
      Chen, Zhousi  and
      Komachi, Mamoru",
    editor = "Palmer, Alexis  and
      Camacho-collados, Jose",
    booktitle = "Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.starsem-1.36",
    doi = "10.18653/v1/2023.starsem-1.36",
    pages = "417--422",
    abstract = "In this study, we propose using the GPT-3 as a query generator for the backend of CLIP as an implicit word sense disambiguation (WSD) component for the SemEval 2023 shared task Visual Word Sense Disambiguation (VWSD). We confirmed previous findings {---} human-like prompts adapted for WSD with quotes benefit both CLIP and GPT-3, whereas plain phrases or poorly templated prompts give the worst results.",
}

In this study, we propose using the GPT-3 as a query generator for the backend of CLIP as an implicit word sense disambiguation (WSD) component for the SemEval 2023 shared task Visual Word Sense Disambiguation (VWSD). We confirmed previous findings {---} human-like prompts adapted for WSD with quotes benefit both CLIP and GPT-3, whereas plain phrases or poorly templated prompts give the worst results.
Pan, Xiaomeng Chen, Zhousi Komachi, Mamoru
Query Generation Using GPT-3 for CLIP-Based Word Sense Disambiguation for Image Retrieval