DavidAU commited on
Commit
15b9ca6
·
verified ·
1 Parent(s): b6abee3

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -46
README.md DELETED
@@ -1,46 +0,0 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Gemma-The-Writer-f32
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using G:/9B/gemma-2-9b-it-SimPO as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * G:/9B/Gemma-2-Ataraxy-9B
22
- * G:/9B/gemma-2-Ifable-9B
23
- * G:/9B/Gemma-2-9B-It-SPPO-Iter3
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- # Gemma - Dark Writer
31
-
32
- models:
33
- - model: G:/9B/Gemma-2-Ataraxy-9B
34
- parameters:
35
- weight: [0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0,0,0,0,0,0,0,0,0.5,0.5,0.6,0.6,0.6,1,1,1,1,1,0.6,0.6,0.6,0.6,0.6,0.6,0.7,0.7,0.7,0.7,0.7,1,0.7,1,0,0.9]
36
- - model: G:/9B/Gemma-2-9B-It-SPPO-Iter3
37
- parameters:
38
- weight: [0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0.3,0,0,0,0,0,0,0,0.2,0.2,0.2,0.05,0.05,0,0,0,0,0,0.05,0.05,0.05,0.05,0.05,0.05,0,0,0,0,0,0,0,0,0,0]
39
- - model: G:/9B/gemma-2-Ifable-9B
40
- parameters:
41
- weight: [0.1,0.1,0.1,0.1,0.1,0.1,0.1,0.1,0.1,1,1,1,1,1,1,1,0.2,0.2,0.2,0.35,0.35,0,0,0,0,0,0.2,0.2,0.2,0.2,0.2,0.2,0.3,0.3,0.3,0.3,0.3,0,0.3,0,1,0.1]
42
- merge_method: dare_ties
43
- base_model: G:/9B/gemma-2-9b-it-SimPO
44
- dtype: float32
45
-
46
- ```