Hugging Face's logo

mradermacher
/
Bagel-Hermes-2x34B-i1-GGUF

Transformers
GGUF
English
yi
Mixture of Experts
Inference Endpoints
conversational
Model card Files Community
mradermacher commited on
Commit
f18d7f8
·
verified ·
1 Parent(s): a7aa84c

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -19,7 +19,6 @@ tags:
19
  <!-- ### vocab_type: -->
20
  weighted/imatrix quants of https://huggingface.co/Weyaxi/Bagel-Hermes-2x34B
21
 
22
-
23
  <!-- provided-files -->
24
  static quants are available at https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-GGUF
25
  ## Usage
@@ -43,6 +42,7 @@ more details, including on how to concatenate multi-part files.
43
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 32.6 | |
44
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 34.7 | optimal size/speed/quality |
45
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 36.8 | fast, recommended |
 
46
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q6_K.gguf) | i1-Q6_K | 50.0 | practically like static Q6_K |
47
 
48
 
 
19
  <!-- ### vocab_type: -->
20
  weighted/imatrix quants of https://huggingface.co/Weyaxi/Bagel-Hermes-2x34B
21
 
 
22
  <!-- provided-files -->
23
  static quants are available at https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-GGUF
24
  ## Usage
 
42
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 32.6 | |
43
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 34.7 | optimal size/speed/quality |
44
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 36.8 | fast, recommended |
45
+ | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 42.0 | |
46
  | [GGUF](https://huggingface.co/mradermacher/Bagel-Hermes-2x34B-i1-GGUF/resolve/main/Bagel-Hermes-2x34B.i1-Q6_K.gguf) | i1-Q6_K | 50.0 | practically like static Q6_K |
47
 
48