Directly quantized 4bit model with `bitsandbytes`.

Unsloth can finetune LLMs with QLoRA 2.2x faster and use 62% less memory!

We have a Google Colab Tesla T4 notebook for Mistral 7b here: https://colab.research.google.com/drive/1Dyauq4kTZoLewQ1cApceUQVNcnnNTzg_?usp=sharing
{"license": "apache-2.0"}
transformers safetensors mistral text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference 4-bit region:us has_space