transformers pytorch llama text-generation retrieval-augmented generation en license:cc-by-sa-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-sa-4.0
language:
- en
tags:
- retrieval-augmented generation
---

This is a FilCo context filtering model for open-domain documents such as Wikipedia articles.
Specifically, this is a `meta-llama/Llama-2-7b` trained using LoRA for 3 epochs on the NaturalQuestions (NQ) training set.

It is intented to be used in FilCo: [https://github.com/zorazrw/filco](https://github.com/zorazrw/filco), but can be further applied in similar scenarios.

## Citation
if you use this model for research, please cite:
```
@article{wang2023learning,
  title={Learning to Filter Context for Retrieval-Augmented Generation},
  author={Zhiruo Wang, Jun Araki, Zhengbao Jiang, Md Rizwan Parvez, Graham Neubig},
  journal={arXiv preprint arXiv:2311.08377},
  year={2023}
}
```