Update README.md
Browse files
README.md
CHANGED
@@ -2,12 +2,17 @@
|
|
2 |
library_name: peft
|
3 |
base_model: mistralai/Mistral-7B-v0.1
|
4 |
pipeline_tag: text-generation
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
---
|
6 |
|
7 |
# Model Card for Model ID
|
8 |
|
9 |
-
|
10 |
-
|
11 |
|
12 |
|
13 |
## Model Details
|
|
|
2 |
library_name: peft
|
3 |
base_model: mistralai/Mistral-7B-v0.1
|
4 |
pipeline_tag: text-generation
|
5 |
+
datasets:
|
6 |
+
- wikisql
|
7 |
+
language:
|
8 |
+
- en
|
9 |
+
tags:
|
10 |
+
- mistral-7b
|
11 |
---
|
12 |
|
13 |
# Model Card for Model ID
|
14 |
|
15 |
+
This model card presents the finetuning of the Mistral-7b model using the PEFT library and bitsandbytes for loading large models in 4-bit. The notebook demonstrates finetuning with Low Rank Adapters (LoRA), allowing only the adapters to be finetuned instead of the entire model. The process is designed for ease of use with Google Colab and is applicable for models supporting device_map.This specialized model offers a powerful tool for database querying and analysis, streamlining the process of extracting information from databases using conversational inputs.
|
|
|
16 |
|
17 |
|
18 |
## Model Details
|