Update README.md

README.md

@@ -1,5 +1,102 @@
+---
+base_model:
+- Sao10K/70B-L3.3-Cirrus-x1
+- nitky/Llama-3.3-SuperSwallowX-70B-Instruct-v0.1
+- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+- Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
+- TheDrummer/Anubis-70B-v1
+- Undi95/Sushi-v1.4
+- pankajmathur/orca_mini_v9_3_70B
+- SicariusSicariiStuff/Negative_LLAMA_70B
+- Sao10K/L3.3-70B-Euryale-v2.3
+- nbeerbower/Llama-3.1-Nemotron-lorablated-70B
+- Blackroot/Mirai-3.0-70B
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
 
 # ...?
 
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/OsfG_W1DavvURfreTJ52l.png)
 
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+Doomer but probably Gooder. Rest of the numbers are guessed up.
+
+This will probably be the last model I mix for a while. Going to touch grass in another country.
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [Sao10K/70B-L3.3-Cirrus-x1](https://huggingface.co/Sao10K/70B-L3.3-Cirrus-x1)
+* [nitky/Llama-3.3-SuperSwallowX-70B-Instruct-v0.1](https://huggingface.co/nitky/Llama-3.3-SuperSwallowX-70B-Instruct-v0.1)
+* [EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1](https://huggingface.co/EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1)
+* [Doctor-Shotgun/L3.3-70B-Magnum-v4-SE](https://huggingface.co/Doctor-Shotgun/L3.3-70B-Magnum-v4-SE)
+* [TheDrummer/Anubis-70B-v1](https://huggingface.co/TheDrummer/Anubis-70B-v1)
+* [Undi95/Sushi-v1.4](https://huggingface.co/Undi95/Sushi-v1.4)
+* [pankajmathur/orca_mini_v9_3_70B](https://huggingface.co/pankajmathur/orca_mini_v9_3_70B)
+* [Sao10K/L3.3-70B-Euryale-v2.3](https://huggingface.co/Sao10K/L3.3-70B-Euryale-v2.3)
+* [nbeerbower/Llama-3.1-Nemotron-lorablated-70B](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B)
+* [Blackroot/Mirai-3.0-70B](https://huggingface.co/Blackroot/Mirai-3.0-70B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: Blackroot/Mirai-3.0-70B
+    parameters:
+      density: 0.2
+      weight: 0.5
+  - model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
+    parameters:
+      density: 1
+      weight: 0.25
+  - model: Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
+    parameters:
+      density: 0.3
+      weight: 0.5
+  - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+    parameters:
+      density: 0.75
+      weight: 0.5
+  - model: TheDrummer/Anubis-70B-v1
+    parameters:
+      density: 0.351
+      weight: 0.751
+  - model: Sao10K/L3.3-70B-Euryale-v2.3
+    parameters:
+      density: 0.420
+      weight: 0.679
+  - model: Sao10K/70B-L3.3-Cirrus-x1
+    parameters:
+      density: 0.43
+      weight: 0.3
+  - model: nitky/Llama-3.3-SuperSwallowX-70B-Instruct-v0.1
+    parameters:
+      density: 0.25
+      weight: 0.2
+  - model: Undi95/Sushi-v1.4
+    parameters:
+      density: 0.1457
+      weight: 0.69
+  - model: pankajmathur/orca_mini_v9_3_70B
+    parameters:
+      density: 0.2
+      weight: 0.2
+
+merge_method: ties
+base_model: SicariusSicariiStuff/Negative_LLAMA_70B
+parameters:
+  normalize: true
+dtype: bfloat16
+```