Update README.md
Browse files
README.md
CHANGED
@@ -34,14 +34,15 @@ Training Code can be found here: https://github.com/Saikat-M/LLM-Finetuning
|
|
34 |
* Code generation tasks
|
35 |
|
36 |
### Training Data
|
37 |
-
Dataset: https://huggingface.co/datasets/SaikatM/Code-Platypus
|
38 |
-
|
|
|
39 |
|
40 |
### Training Procedure
|
41 |
|
42 |
Used QLoRA from PEFT and used SFTTrainer.
|
43 |
|
44 |
-
#### Preprocessing
|
45 |
|
46 |
From the Open-Platypus dataset filtering-out rows which has leetcode_ne in it's data_source column.
|
47 |
|
@@ -93,7 +94,14 @@ Took around 1 hour to train.
|
|
93 |
|
94 |
### Results
|
95 |
|
96 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
97 |
|
98 |
### Compute Infrastructure
|
99 |
|
|
|
34 |
* Code generation tasks
|
35 |
|
36 |
### Training Data
|
37 |
+
* Dataset: https://huggingface.co/datasets/SaikatM/Code-Platypus
|
38 |
+
|
39 |
+
* Source Dataset: https://huggingface.co/datasets/garage-bAInd/Open-Platypus
|
40 |
|
41 |
### Training Procedure
|
42 |
|
43 |
Used QLoRA from PEFT and used SFTTrainer.
|
44 |
|
45 |
+
#### Preprocessing
|
46 |
|
47 |
From the Open-Platypus dataset filtering-out rows which has leetcode_ne in it's data_source column.
|
48 |
|
|
|
94 |
|
95 |
### Results
|
96 |
|
97 |
+
```<bos>Write a fucntion to sort a list in python.<eos>
|
98 |
+
|
99 |
+
Answer:
|
100 |
+
|
101 |
+
def sort_list(list):
|
102 |
+
return sorted(list)<eos>
|
103 |
+
Response: None
|
104 |
+
```
|
105 |
|
106 |
### Compute Infrastructure
|
107 |
|