Dracones
/

EXL2_Measurements

Model card Files Files and versions Community

Dracones commited on Dec 3, 2024

Commit

94a24bd

•

1 Parent(s): e2fde3c

Upload folder using huggingface_hub

Browse files

Files changed (7) hide show

Athene-V2-Chat.json +0 -0
Llama-3.1-Nemotron-70B-Instruct.json +0 -0
QwQ-32B-Preview.json +0 -0
Qwen2.5-32B-Instruct.json +0 -0
Qwen2.5-72B-Instruct.json +0 -0
Qwen2.5-Coder-32B-Instruct.json +0 -0
README.md +7 -0

Athene-V2-Chat.json ADDED Viewed

The diff for this file is too large to render. See raw diff

Llama-3.1-Nemotron-70B-Instruct.json ADDED Viewed

The diff for this file is too large to render. See raw diff

QwQ-32B-Preview.json ADDED Viewed

The diff for this file is too large to render. See raw diff

Qwen2.5-32B-Instruct.json ADDED Viewed

The diff for this file is too large to render. See raw diff

Qwen2.5-72B-Instruct.json ADDED Viewed

The diff for this file is too large to render. See raw diff

Qwen2.5-Coder-32B-Instruct.json ADDED Viewed

The diff for this file is too large to render. See raw diff

README.md CHANGED Viewed

@@ -22,5 +22,12 @@ This repository contains EXL2 measurement files for quants made here.
 | `CodeQwen1.5-7B.json`       | EXL2 measurement file for CodeQwen1.5-7B                                                                                | [Qwen/CodeQwen1.5-7B](https://huggingface.co/Qwen/CodeQwen1.5-7B) |
 | `Mixtral-8x22B-Instruct-v0.1.json`       | EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1                                                      | [mistralai/Mixtral-8x22B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1) |
 | `Llama-3-Lumimaid-70B-v0.1.json`       | EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1                                                      | [NeverSleep/Llama-3-Lumimaid-70B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1) |

 | `CodeQwen1.5-7B.json`       | EXL2 measurement file for CodeQwen1.5-7B                                                                                | [Qwen/CodeQwen1.5-7B](https://huggingface.co/Qwen/CodeQwen1.5-7B) |
 | `Mixtral-8x22B-Instruct-v0.1.json`       | EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1                                                      | [mistralai/Mixtral-8x22B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1) |
 | `Llama-3-Lumimaid-70B-v0.1.json`       | EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1                                                      | [NeverSleep/Llama-3-Lumimaid-70B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1) |
+| `Qwen2.5-72B-Instruct.json`       | EXL2 measurement file for Qwen2.5-72B-Instruct                                                      | [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct) |
+| `Qwen2.5-Coder-32B-Instruct.json`       | EXL2 measurement file for Qwen2.5-Coder-32B-Instruct                                                      | [Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) |
+| `QwQ-32B-Preview.json`       | EXL2 measurement file for QwQ-32B-Preview                                                      | [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview) |
+| `Athene-V2-Chat.json`       | EXL2 measurement file for Athene-V2-Chat                                                      | [Nexusflow/Athene-V2-Chat](https://huggingface.co/Nexusflow/Athene-V2-Chat) |
+| `Llama-3.1-Nemotron-70B-Instruct.json`       | EXL2 measurement file for Llama-3.1-Nemotron-70B-Instruct                                                      | [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) |
+| `Qwen2.5-32B-Instruct.json`       | EXL2 measurement file for Qwen2.5-32B-Instruct                                                      | [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) |