Delta-Vector commited on
Commit
2e73a21
·
verified ·
1 Parent(s): dab83b3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -36
README.md CHANGED
@@ -1,36 +1,36 @@
1
- ---
2
- base_model:
3
- - anthracite-org/magnum-v2-4b
4
- - NewEden/KTOlora
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # f
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the passthrough merge method using [anthracite-org/magnum-v2-4b](https://huggingface.co/anthracite-org/magnum-v2-4b) + [NewEden/KTOlora](https://huggingface.co/NewEden/KTOlora) as a base.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
-
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- base_model: anthracite-org/magnum-v2-4b+NewEden/KTOlora
31
- dtype: bfloat16
32
- merge_method: passthrough
33
- models:
34
- - model: anthracite-org/magnum-v2-4b+NewEden/KTOlora
35
- dtype: bfloat16
36
- ```
 
1
+ ---
2
+ base_model:
3
+ - anthracite-org/magnum-v2-4b
4
+ - NewEden/KTOlora
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # KTO experiment on Magnum-4b
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the passthrough merge method using [anthracite-org/magnum-v2-4b](https://huggingface.co/anthracite-org/magnum-v2-4b) + [NewEden/KTOlora](https://huggingface.co/NewEden/KTOlora) as a base.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+
24
+
25
+ ### Configuration
26
+
27
+ The following YAML configuration was used to produce this model:
28
+
29
+ ```yaml
30
+ base_model: anthracite-org/magnum-v2-4b+NewEden/KTOlora
31
+ dtype: bfloat16
32
+ merge_method: passthrough
33
+ models:
34
+ - model: anthracite-org/magnum-v2-4b+NewEden/KTOlora
35
+ dtype: bfloat16
36
+ ```