text
We just released bitsandbytes==0.43.0 📦 , with these significant new additions:
We just released bitsandbytes==0.43.0 📦 , with these significant new additions:
new_line
new_line
text
‣ 🛫 FSDP+QLoRA support (alpha release)
‣ 🛫 FSDP+QLoRA support (alpha release)
new_line
text
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
new_line
text
  ◦ in collab with Jeremy Howard + team @ answer.ai
  ◦ in collab with Jeremy Howard + team @ answer.ai
new_line
text
  ◦ answer.ai blogpost: 
  ◦ answer.ai blogpost: 
link
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
new_line
text
  ◦ example repo: 
  ◦ example repo: 
link
https://github.com/AnswerDotAI/fsdp_qlora/
https://github.com/AnswerDotAI/fsdp_qlora/
new_line
new_line
text
‣ 🌈⊞ Official Windows support
‣ 🌈⊞ Official Windows support
new_line
text
  ◦ now via simple 
  ◦ now via simple 
inline_code
`pip install bitsandbytes>=0.43.0`
pip install bitsandbytes>=0.43.0
new_line
new_line
text
‣ 📄 Huge docs update:
‣ 📄 Huge docs update:
new_line
text
  ◦ 
  ◦ 
link
https://huggingface.co/docs/bitsandbytes/main
https://huggingface.co/docs/bitsandbytes/main
new_line
text
  ◦ Be sure to check out the optimizers and the API docs
  ◦ Be sure to check out the optimizers and the API docs
new_line
text
  ◦ ... even more upcoming ...
  ◦ ... even more upcoming ...
new_line
new_line
text
Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍
Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍
new_line
new_line
text
We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
new_line
link
https://github.com/TimDettmers/bitsandbytes/discussions
https://github.com/TimDettmers/bitsandbytes/discussions
new_line
new_line
text
Have a great weekend everyone!
Have a great weekend everyone!
We just released bitsandbytes==0.43.0 📦 , with these significant new additions:

‣ 🛫 FSDP+QLoRA support (alpha release)
  ◦ now anyone with 2 powerful gaming GPUs can fine-tune 70B param models at home!
  ◦ in collab with Jeremy Howard + team @ answer.ai
  ◦ answer.ai blogpost: https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html
  ◦ example repo: https://github.com/AnswerDotAI/fsdp_qlora/

‣ 🌈⊞ Official Windows support
  ◦ now via simple `pip install bitsandbytes>=0.43.0`

‣ 📄 Huge docs update:
  ◦ https://huggingface.co/docs/bitsandbytes/main
  ◦ Be sure to check out the optimizers and the API docs
  ◦ ... even more upcoming ...

Under the hood there we have many other improvements, due to extensive maintenance activity, community contributions by super active + knowledgable volunteers ✨ 🚀 and the official sponsorship by Hugging Face that makes all this possible 🤗 ❤️ 🌍

We would greatly appreciate any further community contributions, be it to help with refactorings, exterminating flaky tests, writing doc-strings, tutorials, new features. Don't be shy, just contact us and we see where this leads us:
https://github.com/TimDettmers/bitsandbytes/discussions

Have a great weekend everyone!
🤗
Titus-von-Koeller mdouglas clem osanseviero rganti ajibawa-2023 julien-c t1u1 ybelkada cstr tolgacangoz hiyouga danielus smangrul
❤️
Djruffkutz clem osanseviero samusenps julien-c Theli ybelkada hiyouga smangrul
https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg
Julien Chaumond
julien-c
user