@inproceedings{ghahroodi-etal-2023-sut,
    title = "{SUT} at {S}em{E}val-2023 Task 1: Prompt Generation for Visual Word Sense Disambiguation",
    author = "Ghahroodi, Omid  and
      Dalili, Seyed Arshan  and
      Mesforoush, Sahel  and
      Asgari, Ehsaneddin",
    editor = {Ojha, Atul Kr.  and
      Do{\u{g}}ru{\"o}z, A. Seza  and
      Da San Martino, Giovanni  and
      Tayyar Madabushi, Harish  and
      Kumar, Ritesh  and
      Sartori, Elisa},
    booktitle = "Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.semeval-1.298",
    doi = "10.18653/v1/2023.semeval-1.298",
    pages = "2160--2163",
    abstract = "Visual Word Sense Disambiguation (V-WSD) identifies the correct visual sense of a multi-sense word in a specific context. This can be challenging as images may need to provide additional context and words may have multiple senses. A proper V-WSD system can benefit applications like image retrieval and captioning. This paper proposes a Prompt Generation approach to solve this challenge. This approach improves the robustness of language-image models like CLIP to contextual ambiguities and helps them better correlate between textual and visual contexts of different senses of words.",
}

Visual Word Sense Disambiguation (V-WSD) identifies the correct visual sense of a multi-sense word in a specific context. This can be challenging as images may need to provide additional context and words may have multiple senses. A proper V-WSD system can benefit applications like image retrieval and captioning. This paper proposes a Prompt Generation approach to solve this challenge. This approach improves the robustness of language-image models like CLIP to contextual ambiguities and helps them better correlate between textual and visual contexts of different senses of words.
Ghahroodi, Omid Dalili, Seyed Arshan Mesforoush, Sahel Asgari, Ehsaneddin
SUT at SemEval-2023 Task 1: Prompt Generation for Visual Word Sense Disambiguation