text
Diaries of Open Source. Part 11 🚀
Diaries of Open Source. Part 11 🚀
new_line
new_line
text
🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
new_line
text
Blog: 
Blog: 
link
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
new_line
text
Base and instruct models: 
Base and instruct models: 
resource
https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
collection
databricks/dbrx-6601c0852a0cdd3c59f71962
https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
new_line
text
Demo: 
Demo: 
resource
https://hf.co/spaces/databricks/dbrx-instruct
space
databricks/dbrx-instruct
https://hf.co/spaces/databricks/dbrx-instruct
new_line
new_line
text
🤏1-bit and 2-bit quantization exploration using HQQ+
🤏1-bit and 2-bit quantization exploration using HQQ+
new_line
text
Blog post: 
Blog post: 
link
https://mobiusml.github.io/1bit_blog/
https://mobiusml.github.io/1bit_blog/
new_line
text
Models: 
Models: 
link
https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
new_line
text
GitHub: 
GitHub: 
link
https://github.com/mobiusml/hqq
https://github.com/mobiusml/hqq
new_line
new_line
text
📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
new_line
text
Dataset: 
Dataset: 
resource
https://hf.co/datasets/HuggingFaceTB/cosmopedia
dataset
HuggingFaceTB/cosmopedia
https://hf.co/datasets/HuggingFaceTB/cosmopedia
new_line
text
Blog: 
Blog: 
link
https://hf.co/blog/cosmopedia
https://hf.co/blog/cosmopedia
new_line
new_line
text
⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
new_line
text
Models: 
Models: 
link
https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
new_line
text
Paper: 
Paper: 
resource
https://huggingface.co/papers/2403.18814
paper
2403.18814
https://huggingface.co/papers/2403.18814
Mini-Gemini: Mining the Potential of Multi-modality Vision Language
  Models (2403.18814)
new_line
text
GitHub: 
GitHub: 
link
https://github.com/dvlab-research/MiniGemini
https://github.com/dvlab-research/MiniGemini
new_line
new_line
text
🔥VILA - On Pre-training for VLMs
🔥VILA - On Pre-training for VLMs
new_line
text
Models: 
Models: 
resource
https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
collection
Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
new_line
text
Paper: 
Paper: 
resource
https://hf.co/papers/2312.07533
paper
2312.07533
https://hf.co/papers/2312.07533
VILA: On Pre-training for Visual Language Models (2312.07533)
new_line
new_line
text
Misc
Misc
new_line
text
👀 FeatUp: a framework for image features at any resolution: 
👀 FeatUp: a framework for image features at any resolution: 
resource
https://hf.co/spaces/mhamilton723/FeatUp
space
mhamilton723/FeatUp
https://hf.co/spaces/mhamilton723/FeatUp
text
resource
https://hf.co/papers/2403.10516
paper
2403.10516
https://hf.co/papers/2403.10516
FeatUp: A Model-Agnostic Framework for Features at Any Resolution (2403.10516)
new_line
text
🍞ColBERTus Maxiums, a colbertialized embedding model 
🍞ColBERTus Maxiums, a colbertialized embedding model 
resource
https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
model
mixedbread-ai/mxbai-colbert-large-v1
https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
new_line
text
🖌️Semantic Palette, a new drawing paradigm  
🖌️Semantic Palette, a new drawing paradigm  
resource
https://hf.co/spaces/ironjr/SemanticPalette
space
ironjr/SemanticPalette
https://hf.co/spaces/ironjr/SemanticPalette
new_line
text
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  
resource
https://hf.co/marr-peng-lab/histogpt
model
marr-peng-lab/histogpt
https://hf.co/marr-peng-lab/histogpt
text
link
https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
Diaries of Open Source. Part 11 🚀

🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
Blog: https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Base and instruct models: https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://hf.co/spaces/databricks/dbrx-instruct

🤏1-bit and 2-bit quantization exploration using HQQ+
Blog post: https://mobiusml.github.io/1bit_blog/
Models: https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
GitHub: https://github.com/mobiusml/hqq

📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
Dataset: https://hf.co/datasets/HuggingFaceTB/cosmopedia
Blog: https://hf.co/blog/cosmopedia

⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
Models: https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
Paper: https://huggingface.co/papers/2403.18814
GitHub: https://github.com/dvlab-research/MiniGemini

🔥VILA - On Pre-training for VLMs
Models: https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
Paper: https://hf.co/papers/2312.07533

Misc
👀 FeatUp: a framework for image features at any resolution: https://hf.co/spaces/mhamilton723/FeatUp https://hf.co/papers/2403.10516
🍞ColBERTus Maxiums, a colbertialized embedding model https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
🖌️Semantic Palette, a new drawing paradigm  https://hf.co/spaces/ironjr/SemanticPalette
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  https://hf.co/marr-peng-lab/histogpt https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
🔥
mobicham appoose loubnabnl davanstrien samusenps DmitryRyumin ajibawa-2023 clem GO4code victor vladbogo nikgr VictorSanh reach-vb manuel-tran
❤️
ironjr loubnabnl samusenps clem reach-vb manuel-tran
👍
shiv2050 ssml2050 manuel-tran
https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
Omar Sanseviero
osanseviero
user
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/eglpdmqkla3CnYgB5KVFY.jpeg
CloudEnabledSingapore
cloudenabled
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user