text
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the 
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the 
resource
https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct
model
Qwen/Qwen2-VL-7B-Instruct
https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct
text
 model.
 model.
new_line
new_line
text
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: 
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: 
resource
https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator
space
davanstrien/ColPali-Query-Generator
https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator
new_line
new_line
text
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
new_line
new_line
text
You can read the original blog post that goes into more detail here: 
You can read the original blog post that goes into more detail here: 
link
https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct model.

To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: https://huggingface.co/spaces/davanstrien/ColPali-Query-Generator

I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.

You can read the original blog post that goes into more detail here: https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
➕
blooket John6666 AtAndDev victor fsommers
❤️
louisbrulenaudet AtAndDev Csplk johko
👍
fsommers UniLLMer
🚀
AtAndDev