File size: 7,277 Bytes
a1af7d0
 
e0abb73
a1af7d0
 
 
067ac4e
 
 
 
 
 
 
 
 
 
 
 
c298323
8eca10d
 
b78b50e
 
e2fde3c
94a24bd
 
 
 
 
 
540c31f
 
5980292
46b22fb
 
 
94a24bd
8eca10d
78893bd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
# Midnight Miqu EXL2 Measurement Files

This repository contains EXL2 measurement files for quants made here.

## Contents

| Filename                        | Description                                                                                                         | Model Link                                                                                |
|---------------------------------|---------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------|
| `midnight70b.json`              | EXL2 measurement file for Midnight Miqu 70b                                                                         | [sophosympatheia/Midnight-Miqu-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0) |
| `midnight103b.json`             | EXL2 measurement file for Midnight Miqu 103b                                                                        | [sophosympatheia/Midnight-Miqu-103B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-103B-v1.0) |
| `midnight70b-v15.json`          | EXL2 measurement file for Midnight Miqu 70b v1.5                                                                    | [sophosympatheia/Midnight-Miqu-70B-v1.5](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.5) |
| `Merged-RP-Stew-V2-34B.json`    | EXL2 measurement file for Merged RP Stew V2 34B                                                                     | [ParasiticRogue/Merged-RP-Stew-V2-34B](https://huggingface.co/ParasiticRogue/Merged-RP-Stew-V2-34B) |
| `perky70b.json`                 | EXL2 measurement file for Perky 70b                                                                                 | [Dracones/perky-70b-v0.1](https://huggingface.co/Dracones/perky-70b-v0.1)                 |
| `perky103b.json`                | EXL2 measurement file for Perky 103b                                                                                | [Dracones/perky-103b-v0.1](https://huggingface.co/Dracones/perky-103b-v0.1)               |
| `miqu-1-70b-sf.json`            | EXL2 measurement file for miqu-1-70b-sf                                                                             | [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)                     |
| `c4ai-command-r-v01.json`       | EXL2 measurement file for Cohere Command R                                                                          | [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)   |
| `c4ai-command-r-v01-rpcal.json` | EXL2 measurement file for Cohere Command R, RP Calibrated again PIPPA-cleaned                                       | [CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)   |
| `Mixtral-8x22B-v0.1.json`       | EXL2 measurement file for Mixtral 8x22 v0.1                                                                         | [mistral-community/Mixtral-8x22B-v0.1](https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1) |
| `mixtral-8x22b-instruct-oh.json`       | EXL2 measurement file for mixtral-8x22b-instruct-oh                                                          | [fireworks-ai/mixtral-8x22b-instruct-oh](https://huggingface.co/fireworks-ai/mixtral-8x22b-instruct-oh) |
| `WizardLM-2-8x22B.json`       | EXL2 measurement file for WizardLM-2-8x22B                                                                            | [microsoft/WizardLM-2-8x22B](https://huggingface.co/microsoft/WizardLM-2-8x22B) |
| `CodeQwen1.5-7B-Chat.json`       | EXL2 measurement file for CodeQwen1.5-7B-Chat                                                                      | [Qwen/CodeQwen1.5-7B-Chat](https://huggingface.co/Qwen/CodeQwen1.5-7B-Chat) |
| `CodeQwen1.5-7B.json`       | EXL2 measurement file for CodeQwen1.5-7B                                                                                | [Qwen/CodeQwen1.5-7B](https://huggingface.co/Qwen/CodeQwen1.5-7B) |
| `Mixtral-8x22B-Instruct-v0.1.json`       | EXL2 measurement file for Mixtral-8x22B-Instruct-v0.1                                                      | [mistralai/Mixtral-8x22B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1) |
| `Llama-3-Lumimaid-70B-v0.1.json`       | EXL2 measurement file for Llama-3-Lumimaid-70B-v0.1                                                      | [NeverSleep/Llama-3-Lumimaid-70B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1) |
| `Qwen2.5-72B-Instruct.json`       | EXL2 measurement file for Qwen2.5-72B-Instruct                                                      | [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct) |
| `Qwen2.5-Coder-32B-Instruct.json`       | EXL2 measurement file for Qwen2.5-Coder-32B-Instruct                                                      | [Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct) |
| `QwQ-32B-Preview.json`       | EXL2 measurement file for QwQ-32B-Preview                                                      | [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview) |
| `Athene-V2-Chat.json`       | EXL2 measurement file for Athene-V2-Chat                                                      | [Nexusflow/Athene-V2-Chat](https://huggingface.co/Nexusflow/Athene-V2-Chat) |
| `Llama-3.1-Nemotron-70B-Instruct.json`       | EXL2 measurement file for Llama-3.1-Nemotron-70B-Instruct                                                      | [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) |
| `Qwen2.5-32B-Instruct.json`       | EXL2 measurement file for Qwen2.5-32B-Instruct                                                      | [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) |
| `Chronos-Platinum-72B.json`       | EXL2 measurement file for Chronos-Platinum-72B                                                     | [ZeusLabs/Chronos-Platinum-72B](https://huggingface.co/ZeusLabs/Chronos-Platinum-72B) |
| `Evathene-v1.3.json`       | EXL2 measurement file for Evathene-v1.3                                                     | [sophosympatheia/Evathene-v1.3](https://huggingface.co/sophosympatheia/Evathene-v1.3) |
| `Llama-3.3-70B-Instruct.json`       | EXL2 measurement file for Llama-3.3-70B-Instruct                                                     | [meta-llama/Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) |
| `EVA-LLaMA-3.33-70B-v0.0.json`       | EXL2 measurement file for EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0                                                     | [](https://huggingface.co/EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0) |
| `L3.3-70B-Euryale-v2.3.json`       | EXL2 measurement file for Sao10K/L3.3-70B-Euryale-v2.3                                                     | [](https://huggingface.co/Sao10K/L3.3-70B-Euryale-v2.3) |
| `72B-Qwen2.5-Kunou-v1.json`       | EXL2 measurement file for Sao10K/72B-Qwen2.5-Kunou-v1                                                     | [](https://huggingface.co/Sao10K/72B-Qwen2.5-Kunou-v1) |