Bharat Soni's picture
2 14

Bharat Soni

bharatxoni

AI & ML interests

None yet

Recent Activity

upvoted a collection 27 days ago
InternVL2.5
liked a Space about 1 month ago
showlab/ShowUI
liked a model about 1 month ago
jadechoghari/Ferret-UI-Llama8b
View all activity

Organizations

None yet

bharatxoni's activity

liked a Space about 1 month ago
reacted to merve's post with 🤗 7 months ago
view post
Post
6054
Fine-tune Florence-2 on any task 🔥

Today we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset @andito @SkalskiP

Blog: https://huggingface.co/blog 📕
Notebook: https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing 📖
Florence-2 is a great vision-language model thanks to it's massive dataset and small size!

This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA 📝

We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks 🥹

See below how it looks like before and after FT 🤩
Play with the demo here andito/Florence-2-DocVQA 🏄‍♀️
updated a Space 9 months ago
updated a Space 10 months ago