@inproceedings{tan-etal-2023-reimagining,
    title = "Reimagining Retrieval Augmented Language Models for Answering Queries",
    author = "Tan, Wang-Chiew  and
      Li, Yuliang  and
      Rodriguez, Pedro  and
      James, Richard  and
      Lin, Xi Victoria  and
      Halevy, Alon  and
      Yih, Wen-tau",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.findings-acl.382",
    doi = "10.18653/v1/2023.findings-acl.382",
    pages = "6131--6146",
    abstract = "We present a reality check on large language models and inspect the promise of retrieval-augmented language models in comparison. Such language models are semi-parametric, where models integrate model parameters and knowledge from external data sources to make their predictions, as opposed to the parametric nature of vanilla large language models. We give initial experimental findings that semi-parametric architectures can be enhanced with views, a query analyzer/planner, and provenance to make a significantly more powerful system for question answering in terms of accuracy and efficiency, and potentially for other NLP tasks.",
}

We present a reality check on large language models and inspect the promise of retrieval-augmented language models in comparison. Such language models are semi-parametric, where models integrate model parameters and knowledge from external data sources to make their predictions, as opposed to the parametric nature of vanilla large language models. We give initial experimental findings that semi-parametric architectures can be enhanced with views, a query analyzer/planner, and provenance to make a significantly more powerful system for question answering in terms of accuracy and efficiency, and potentially for other NLP tasks.
Tan, Wang-Chiew Li, Yuliang Rodriguez, Pedro James, Richard Lin, Xi Victoria Halevy, Alon Yih, Wen-tau
Reimagining Retrieval Augmented Language Models for Answering Queries