Upload folder using huggingface_hub
Browse files- .gitattributes +1 -0
- README.md +18 -0
- mistral-nemo-gutenberg-doppel-12b-v2.Q4_0.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
mistral-nemo-gutenberg-doppel-12b-v2.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
base_model:
|
4 |
+
- axolotl-ai-co/romulus-mistral-nemo-12b-simpo
|
5 |
+
datasets:
|
6 |
+
- jondurbin/gutenberg-dpo-v0.1
|
7 |
+
- nbeerbower/gutenberg2-dpo
|
8 |
+
license: apache-2.0
|
9 |
+
---
|
10 |
+
![image/png](https://huggingface.co/nbeerbower/Mistral-Small-Gutenberg-Doppel-22B/resolve/main/doppel-header?download=true)
|
11 |
+
|
12 |
+
# Mistral-Nemo-Gutenberg-Doppel-12B
|
13 |
+
|
14 |
+
[axolotl-ai-co/romulus-mistral-nemo-12b-simpo](https://huggingface.co/axolotl-ai-co/romulus-mistral-nemo-12b-simpo) finetuned on [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1) and [nbeerbower/gutenberg2-dpo](https://huggingface.co/datasets/nbeerbower/gutenberg2-dpo).
|
15 |
+
|
16 |
+
### Method
|
17 |
+
|
18 |
+
[ORPO tuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) with 2x A100 for 3 epochs.
|
mistral-nemo-gutenberg-doppel-12b-v2.Q4_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bf7f56dd1b607166198f175881c3a77ea92167c30745bdb8ee50519c2cd89a7c
|
3 |
+
size 7071700288
|