peft safetensors mistral text-generation conversational en base_model:mistralai/Mistral-7B-v0.1 license:apache-2.0 region:us
---
library_name: peft
base_model: mistralai/Mistral-7B-v0.1
license: apache-2.0
language:
- en
pipeline_tag: text-generation
tags:
- mistral
inference: false
---
## General Information

For this supervised fine-tuning, I am using:

* Mistral-7B-v0.1 LLM
* Datasets for loading a SFT dataset from the 🤗 hub, and preparing it for the model
* BitsandBytes and PEFT for fine-tuning the model on consumer hardware, leveraging [Q-LoRa](https://huggingface.co/blog/4bit-transformers-bitsandbytes), a technique which drastically reduces the compute requirements for fine-tuning
* TRL, a [library](https://huggingface.co/docs/trl/index) which includes useful Trainer classes for LLM fine-tuning.