text
Fine-tune Florence-2 on any task 🔥
Fine-tune Florence-2 on any task 🔥
new_line
new_line
text
Today we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset 
Today we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset 
mention
@andito
andito
text
mention
@SkalskiP
SkalskiP
text
new_line
text
new_line
text
Blog: 
Blog: 
link
https://huggingface.co/blog
https://huggingface.co/blog
text
 📕
 📕
new_line
text
Notebook: 
Notebook: 
link
https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing
https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing
text
 📖
 📖
new_line
text
Florence-2 is a great vision-language model thanks to it's massive dataset and small size!
Florence-2 is a great vision-language model thanks to it's massive dataset and small size!
new_line
new_line
text
This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA 📝
This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA 📝
new_line
new_line
text
We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks 🥹
We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks 🥹
new_line
new_line
text
See below how it looks like before and after FT 🤩
See below how it looks like before and after FT 🤩
new_line
text
Play with the demo here 
Play with the demo here 
resource
https://huggingface.co/spaces/andito/Florence-2-DocVQA
space
andito/Florence-2-DocVQA
https://huggingface.co/spaces/andito/Florence-2-DocVQA
text
 🏄‍♀️
 🏄‍♀️
Fine-tune Florence-2 on any task 🔥

Today we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset @andito @SkalskiP 
 
Blog: https://huggingface.co/blog 📕
Notebook: https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing 📖
Florence-2 is a great vision-language model thanks to it's massive dataset and small size!

This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA 📝

We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks 🥹

See below how it looks like before and after FT 🤩
Play with the demo here https://huggingface.co/spaces/andito/Florence-2-DocVQA 🏄‍♀️
🤗
omaryshchenko pcuenq MrDragonFox SixOpen Taylor658 KvrParaskevi jxtngx fdaudens gokaygokay osanseviero John6666 nicolay-r IsmaelMousa emanuelevivoli JoPmt CelineLind pandora-s IlyasMoutawwakil damerajee bharatxoni louisbrulenaudet ucsahin victor not-lain LeonceNsh andito fcakyon
🔥
not-lain catyung John6666 hoangphu7122002ai Nadav314 uurcelikk fcakyon