text
LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
new_line
text
Demo: 
Demo: 
resource
https://huggingface.co/spaces/merve/llava-next
space
merve/llava-next
https://huggingface.co/spaces/merve/llava-next
new_line
text
Notebook: 
Notebook: 
link
https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
new_line
text
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
new_line
text
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
new_line
text
- Nous-Hermes-Yi-34B
- Nous-Hermes-Yi-34B
new_line
text
- Mistral-7B
- Mistral-7B
new_line
text
- Vicuna 7B & 13B 
- Vicuna 7B & 13B 
new_line
text
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
new_line
text
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
new_line
text
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
LLaVA-NeXT is recently merged to Hugging Face transformers and it outperforms many of the closed source models like Gemini on various benchmarks 🤩  Let's take a look!
Demo: https://huggingface.co/spaces/merve/llava-next
Notebook: https://colab.research.google.com/drive/1afNudu72SNWZCYtCVrRlb9T9Vj9CFJEK?usp=sharing
LLaVA is essentially a vision-language model that consists of ViT-based CLIP encoder, a MLP projection and Vicuna as decoder ✨
LLaVA 1.5 was released with Vicuna, but LLaVA NeXT (1.6) is released with four different LLMs:
- Nous-Hermes-Yi-34B
- Mistral-7B
- Vicuna 7B & 13B 
Mistral and Nous-Hermes-Yi-34B are performing better and have better commercial use. 
Moreover, according to authors' findings, the improvements comes from more diverse and high quality data mixture and dynamic high resolution.
LLaVA based on Nous-Hermes-Yi-34B outperforms many other models, including Gemini in various multimodal understanding and generation benchmarks 😊 
🚀
osanseviero samusenps yesdeepakmittalTA Dlbk InferenceIllusionist nqtruong mirellyssl acamilogg88 clem LucienL shing3232 jarvisx17