Vijayendra
/

QST-Mistral-7b

Text Generation

4-bit precision

Model card Files Files and versions Community

Vijayendra commited on Nov 30, 2024

Commit

454ad0b

·

verified ·

1 Parent(s): a1bb37b

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -2,7 +2,8 @@
 base_model: unsloth/mistral-7b-bnb-4bit
 library_name: peft
 ---
 !pip install peft accelerate bitsandbytes
 from peft import PeftModel, PeftConfig
 from transformers import AutoModelForCausalLM, AutoTokenizer

 base_model: unsloth/mistral-7b-bnb-4bit
 library_name: peft
 ---
+How to use :
+```python
 !pip install peft accelerate bitsandbytes
 from peft import PeftModel, PeftConfig
 from transformers import AutoModelForCausalLM, AutoTokenizer