text
New open multimodal model in town: Idefics2!  
New open multimodal model in town: Idefics2!  
new_line
new_line
text
💪 Strong 8B-parameters model: often on par with open 30B counterparts. 
💪 Strong 8B-parameters model: often on par with open 30B counterparts. 
new_line
text
🔓Open license: Apache 2.0. 
🔓Open license: Apache 2.0. 
new_line
text
🚀 Strong improvement over Idefics1: +12 points on VQAv2, +30 points on TextVQA while having 10x fewer parameters. 
🚀 Strong improvement over Idefics1: +12 points on VQAv2, +30 points on TextVQA while having 10x fewer parameters. 
new_line
text
📚 Better data: boosting OCR capabilities with 6TB of documents to transcribe, and improving QA capabilities on charts/figures/diagrams. 
📚 Better data: boosting OCR capabilities with 6TB of documents to transcribe, and improving QA capabilities on charts/figures/diagrams. 
new_line
text
🕵️‍♀️ Transparent training data: inspect and build upon all the data (10s of TB of data) we trained on. 
🕵️‍♀️ Transparent training data: inspect and build upon all the data (10s of TB of data) we trained on. 
new_line
text
🔲 More natural image processing: Incorporating strategies to treat images in their native resolution and native aspect ratio. 
🔲 More natural image processing: Incorporating strategies to treat images in their native resolution and native aspect ratio. 
new_line
text
📸 High-resolution images: image resolutions up to 980 x 980 and integrating strategies that allow to trade computational efficiency for performance. 
📸 High-resolution images: image resolutions up to 980 x 980 and integrating strategies that allow to trade computational efficiency for performance. 
new_line
text
😎 2 checkpoints: Releasing both base checkpoint and instruction fine-tuned checkpoint. Chat version to come.
😎 2 checkpoints: Releasing both base checkpoint and instruction fine-tuned checkpoint. Chat version to come.
new_line
new_line
text
Ressources: 
Ressources: 
resource
https://huggingface.co/collections/HuggingFaceM4/idefics2-661d1971b7c50831dd3ce0fe
collection
HuggingFaceM4/idefics2-661d1971b7c50831dd3ce0fe
https://huggingface.co/collections/HuggingFaceM4/idefics2-661d1971b7c50831dd3ce0fe
new_line
text
Blogpost: 
Blogpost: 
link
https://huggingface.co/blog/idefics2
https://huggingface.co/blog/idefics2
New open multimodal model in town: Idefics2!  

💪 Strong 8B-parameters model: often on par with open 30B counterparts. 
🔓Open license: Apache 2.0. 
🚀 Strong improvement over Idefics1: +12 points on VQAv2, +30 points on TextVQA while having 10x fewer parameters. 
📚 Better data: boosting OCR capabilities with 6TB of documents to transcribe, and improving QA capabilities on charts/figures/diagrams. 
🕵️‍♀️ Transparent training data: inspect and build upon all the data (10s of TB of data) we trained on. 
🔲 More natural image processing: Incorporating strategies to treat images in their native resolution and native aspect ratio. 
📸 High-resolution images: image resolutions up to 980 x 980 and integrating strategies that allow to trade computational efficiency for performance. 
😎 2 checkpoints: Releasing both base checkpoint and instruction fine-tuned checkpoint. Chat version to come.

Ressources: https://huggingface.co/collections/HuggingFaceM4/idefics2-661d1971b7c50831dd3ce0fe
Blogpost: https://huggingface.co/blog/idefics2
🚀
VictorSanh rwightman monsoon-nlp oceansweep pierrci ajibawa-2023 osanseviero Ayushnangia andrewrreed m-ric clem Molbap lunarflu fynnkroeger marcsun13 raincandy-u jlzhou
🔥
VictorSanh clem oceansweep pierrci samusenps osanseviero andrewrreed m-ric Molbap lunarflu
❤️
VictorSanh clem samusenps andrewrreed m-ric lunarflu