@inproceedings{wold-etal-2023-text,
    title = "Text-To-{KG} Alignment: Comparing Current Methods on Classification Tasks",
    author = "Wold, Sondre  and
      {\O}vrelid, Lilja  and
      Velldal, Erik",
    editor = "Hruschka, Estevam  and
      Mitchell, Tom  and
      Rahman, Sajjadur  and
      Mladeni{\'c}, Dunja  and
      Grobelnik, Marko",
    booktitle = "Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023)",
    month = jul,
    year = "2023",
    address = "Toronto, ON, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.matching-1.1",
    doi = "10.18653/v1/2023.matching-1.1",
    pages = "1--13",
    abstract = "In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language models with an external knowledge source. This has especially been the case for classification tasks, where recent work has focused on creating pipeline models that retrieve information from KGs like ConceptNet as additional context. Many of these models consist of multiple components, and although they differ in the number and nature of these parts, they all have in common that for some given text query, they attempt to identify and retrieve a relevant subgraph from the KG. Due to the noise and idiosyncrasies often found in KGs, it is not known how current methods compare to a scenario where the aligned subgraph is completely relevant to the query. In this work, we try to bridge this knowledge gap by reviewing current approaches to text-to-KG alignment and evaluating them on two datasets where manually created graphs are available, providing insights into the effectiveness of current methods. We release our code for reproducibility.",
}

In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language models with an external knowledge source. This has especially been the case for classification tasks, where recent work has focused on creating pipeline models that retrieve information from KGs like ConceptNet as additional context. Many of these models consist of multiple components, and although they differ in the number and nature of these parts, they all have in common that for some given text query, they attempt to identify and retrieve a relevant subgraph from the KG. Due to the noise and idiosyncrasies often found in KGs, it is not known how current methods compare to a scenario where the aligned subgraph is completely relevant to the query. In this work, we try to bridge this knowledge gap by reviewing current approaches to text-to-KG alignment and evaluating them on two datasets where manually created graphs are available, providing insights into the effectiveness of current methods. We release our code for reproducibility.
Wold, Sondre {\O}vrelid, Lilja Velldal, Erik
Text-To-KG Alignment: Comparing Current Methods on Classification Tasks