Hugging Face's logo

Lewdiculous
/
Prodigy_7B-GGUF-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
mergekit
Merge
Model card Files Community
1
Lewdiculous commited on
Commit
53a9f11
·
verified ·
1 Parent(s): 720b8eb

Add: Q3s, Q5s, Q6, Q8, Data

Browse files
Files changed (8) hide show
  1. .gitattributes +6 -0
  2. Prodigy_7B-IQ3_S-imatrix.gguf +3 -0
  3. Prodigy_7B-Q3_K_M-imatrix.gguf +3 -0
  4. Prodigy_7B-Q5_K_S-imatrix.gguf +3 -0
  5. Prodigy_7B-Q6_K-imatrix.gguf +3 -0
  6. Prodigy_7B-Q8_0-imatrix.gguf +3 -0
  7. imatrix-Prodigy_7B-F16.dat +3 -0
  8. imatrix-base.txt +0 -0
.gitattributes CHANGED
@@ -36,3 +36,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Prodigy_7B-Q4_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
  Prodigy_7B-Q4_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
38
  Prodigy_7B-Q5_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
36
  Prodigy_7B-Q4_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
  Prodigy_7B-Q4_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
38
  Prodigy_7B-Q5_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
39
+ imatrix-Prodigy_7B-F16.dat filter=lfs diff=lfs merge=lfs -text
40
+ Prodigy_7B-IQ3_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Prodigy_7B-Q3_K_M-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Prodigy_7B-Q5_K_S-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Prodigy_7B-Q6_K-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Prodigy_7B-Q8_0-imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Prodigy_7B-IQ3_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af69ec5401dfff786a95b937eb8e82d7e43909ee6004276d382e2f0d3ebfa8d9
3
+ size 3182393088
Prodigy_7B-Q3_K_M-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6122d61de03be2401566cb73206ef6c1729f03f30a8eea7a068a4ee9588e3c1f
3
+ size 3518985984
Prodigy_7B-Q5_K_S-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60c41c64a15215650be9106f2dc9f57994bf6a33c8f88112172a5166315e3133
3
+ size 4997715712
Prodigy_7B-Q6_K-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d32c933d0c6085e30a46d75f5b9a08d101882a02b811fba5c07f7abbb8ab1f3
3
+ size 5942064896
Prodigy_7B-Q8_0-imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4c69a660ba5b88f1ed36c383fe023e20e1c5fa7c659cfb8674be360d37c363c
3
+ size 7695857408
imatrix-Prodigy_7B-F16.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68ce93d4f53c961a2ebb9d60e1765b4b669cbd6bbc2738524c5fb7a423d10508
3
+ size 4988126
imatrix-base.txt ADDED
The diff for this file is too large to render. See raw diff