Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,7 @@ tags:
|
|
19 |
- [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)
|
20 |
|
21 |
## Quantizations
|
22 |
-
Measured using
|
23 |
|
24 |
I also provided zipped quantization because a lot of people find gguf single download convenient. Zipped quantization is relatively smaller in size to download. After extracted, you can use the model folder as usual.
|
25 |
|
|
|
19 |
- [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)
|
20 |
|
21 |
## Quantizations
|
22 |
+
Measured using ExLlamav2_HF and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
|
23 |
|
24 |
I also provided zipped quantization because a lot of people find gguf single download convenient. Zipped quantization is relatively smaller in size to download. After extracted, you can use the model folder as usual.
|
25 |
|