Update README.md

README.md

@@ -7,42 +7,31 @@ library_name: transformers
 tags:
 - mergekit
 - merge
-
+license: apache-2.0
 ---
-# merge
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+<style>
+@import url('https://fonts.googleapis.com/css2?family=Vollkorn:ital,wght@0,400..900;1,400..900&display=swap');
+</style>
+
+<div style="background-color: #101010; border-radius: .5rem; padding: 2rem; font-family: monospace; font-size: .85rem; text-align: justify;">
+  
+![palmer-004](https://huggingface.co/appvoid/palmer-004/resolve/main/palmer-004.jpeg)
 
-## Merge Details
-### Merge Method
+  
+#### Introducing palmer-004
 
-This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [appvoid/palmer-002-32k](https://huggingface.co/appvoid/palmer-002-32k) as a base.
+We are thrilled to unveil palmer-004, the fourth iteration in our esteemed palmer series, designed to push the boundaries of performance and context window capacity. Merging the best of palmer-003 with the expansive capabilities of palmer-002-32k, palmer-004 is a testament to the power of merging similar trained models, think of it as palmer-003 with 32k context with minimal performance degradation.
 
-### Models Merged
+| Model         | MMLU  | ARC-C | HellaSwag | PIQA   | Winogrande |
+|---------------|-------|-------|-----------|--------|------------|
+| tinyllama-3t  | 0.2577| 0.3029| 0.5935    | 0.7329 | 0.5959     |
+| palmer-003    | 0.2523| 0.3439| 0.6208    | 0.7524 | 0.6590     |
+| palmer-004    | 0.2601| 0.3456| 0.6138    | 0.7443 | 0.6511     |
 
-The following models were included in the merge:
-* [raidhon/coven_tiny_1.1b_32k_orpo_alpha](https://huggingface.co/raidhon/coven_tiny_1.1b_32k_orpo_alpha)
-* [appvoid/palmer-003](https://huggingface.co/appvoid/palmer-003)
+Crafted using the TIES merge method, palmer-004 elevates its predecessor's prowess to a remarkable 32k context window without needing to train on additional data. This model doesn't just aim to match; it surpasses, outperforming the current state-of-the-art coven_tiny_1.1b_32k_orpo_alpha on several benchmarks. As of June 1, 2024, palmer-004 stands as the premier 32k 1B model to fine-tune from on Hugging Face, setting a new standard for excellence in the open-source AI community.
 
-### Configuration
 
-The following YAML configuration was used to produce this model:
 
-```yaml
-models:
-  - model: appvoid/palmer-003
-    parameters:
-      density: 0.75
-      weight: 0.5
-  - model: raidhon/coven_tiny_1.1b_32k_orpo_alpha
-    parameters:
-      density: 0.75
-      weight: 0.5
 
-merge_method: ties
-base_model: appvoid/palmer-002-32k
-parameters:
-  normalize: false
-  int8_mask: true
-dtype: float16
-```
+</div>