TheMelonGod commited on
Commit
9d5e939
·
verified ·
1 Parent(s): 6ee0449

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -19
README.md CHANGED
@@ -18,25 +18,24 @@ base_model_relation: quantized
18
 
19
  For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
20
 
21
- 6hb Soon
22
  **ExLlamaV2 Quantizations:**
23
- **8.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-8.0bpw)
24
- **7.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-7.5bpw)
25
- **7.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-7.0bpw)
26
- **6.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-6.5bpw)
27
- **6.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-6.0bpw)
28
- **5.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-5.5bpw)
29
- **5.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-5.0bpw)
30
- **4.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.5bpw)
31
- **4.25bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.25bpw)
32
- **4.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.0bpw)
33
- **3.75bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.75bpw)
34
- **3.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.5bpw)
35
- **3.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.0bpw)
36
- **2.75bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.75bpw)
37
- **2.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.5bpw)
38
- **2.25bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.25bpw)
39
- **2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.0bpw)
40
 
41
  [Measurement File](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/blob/main/Captain-Eris_Twighlight-V0.420-12B-measurement.json) _(Default/built-in calibration dataset was used)_
42
 
@@ -45,4 +44,3 @@ If you need a specific model quantized or particular bits per weight, please let
45
  Your feedback and suggestions are always welcome! They help me improve and make quantizations better for everyone.
46
 
47
  Special thanks to [turboderp](https://huggingface.co/turboderp) for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!
48
-
 
18
 
19
  For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
20
 
 
21
  **ExLlamaV2 Quantizations:**
22
+ **8.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-8.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-8.0bpw)
23
+ **7.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-7.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-7.5bpw)
24
+ **7.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-7.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-7.0bpw)
25
+ **6.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-6.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-6.5bpw)
26
+ **6.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-6.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-6.0bpw)
27
+ **5.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-5.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-5.5bpw)
28
+ **5.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-5.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-5.0bpw)
29
+ **4.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-4.5bpw)
30
+ **4.25bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.25bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-4.25bpw)
31
+ **4.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-4.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-4.0bpw)
32
+ **3.75bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.75bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-3.75bpw)
33
+ **3.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-3.5bpw)
34
+ **3.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-3.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-3.0bpw)
35
+ **2.75bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.75bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-2.75bpw)
36
+ **2.5bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.5bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-2.5bpw)
37
+ **2.25bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.25bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-2.25bpw)
38
+ **2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/8hb-2.0bpw) | [6hb](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/tree/6hb-2.0bpw)
39
 
40
  [Measurement File](https://huggingface.co/TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2/blob/main/Captain-Eris_Twighlight-V0.420-12B-measurement.json) _(Default/built-in calibration dataset was used)_
41
 
 
44
  Your feedback and suggestions are always welcome! They help me improve and make quantizations better for everyone.
45
 
46
  Special thanks to [turboderp](https://huggingface.co/turboderp) for developing the tools that made these quantizations possible. Your contributions are greatly appreciated!