Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,7 @@ library_name: gguf
|
|
| 4 |
pipeline_tag: text-generation
|
| 5 |
---
|
| 6 |
GGUF importance matrix (imatrix) quants for https://huggingface.co/CausalLM/34b-beta
|
| 7 |
-
The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
pipeline_tag: text-generation
|
| 5 |
---
|
| 6 |
GGUF importance matrix (imatrix) quants for https://huggingface.co/CausalLM/34b-beta
|
| 7 |
+
The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
|
| 8 |
+
|
| 9 |
+
From the model author:
|
| 10 |
+
*Please do not use wikitext for quantization calibration because all wikitext have been re-aligned on synthetic dataset, and its distribution differs significantly from the original wikitext.*
|