text
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
new_line
text
- 
- 
resource
https://huggingface.co/vidore/colpali
model
vidore/colpali
https://huggingface.co/vidore/colpali
text
 for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
 for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
new_line
text
- 
- 
resource
https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct
model
Qwen/Qwen2-VL-2B-Instruct
https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct
text
 for generation 💬 directly feed images as is to a vision language model with no processing to text! 
 for generation 💬 directly feed images as is to a vision language model with no processing to text! 
new_line
text
I used ColPali implementation of the new 🐭 Byaldi library by 
I used ColPali implementation of the new 🐭 Byaldi library by 
mention
@bclavie
bclavie
text
  🤗
  🤗
new_line
link
https://github.com/answerdotai/byaldi
https://github.com/answerdotai/byaldi
new_line
text
Link to notebook: 
Link to notebook: 
link
https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
new_line
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- https://huggingface.co/vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text! 
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie  🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb

🔥
rwightman umair894 clem louisbrulenaudet s3nh John6666 BasitMustafa Johnyquest7 phanhoang resbyte denizaybey allandclive fdaudens vilarin ak0601 rreed-pha xi0v Rajaram1996 Rayvee oceansweep parjun byteprobe Filippo
👍
hitchhiker3010 Csplk sasikiran fsommers rogermt navin7 sambarnett96 oceansweep ysdede shreyamondal
❤️
rreed-pha oceansweep Yassmen madstuntman11