Hugging Face's logo

ChristianAzinn
/
mixtral-8x22b-v0.1-imatrix

Text Generation
Transformers
GGUF
English
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
ChristianAzinn commited on
Commit
f3634a7
·
verified ·
1 Parent(s): f5aecc8

Upload 5 files

Browse files
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00001-of-00005.gguf +3 -0
  3. mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00002-of-00005.gguf +3 -0
  4. mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00003-of-00005.gguf +3 -0
  5. mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00004-of-00005.gguf +3 -0
  6. mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -86,3 +86,8 @@ mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00002-of-00005.gguf filter=lfs diff=lfs m
86
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
87
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
88
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
86
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
87
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
88
  mixtral-8x22b-v0.1-imatrix.q3_k_s.gguf-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
89
+ mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
90
+ mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
91
+ mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
92
+ mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
93
+ mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4e4e68d38f74bca2b57ca45470c061d36770398e47515673f90614240e0f123
3
+ size 1013391808
mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b244c1a5fd6c1c6458a2f1489a7a9729beff75b120cb87c21ce73f67c9889688
3
+ size 960732800
mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca5b2a0c7426a2101ac1393bf0a52eb6da576dc900e3e945ec1958b96ca49eb3
3
+ size 946871936
mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72141bc8274b3b8fb9753e3d3f43b14fa5504b94b19c8b7c9734677ae9dd4da0
3
+ size 36255728832
mixtral-8x22b-v0.1-imatrix.iq3_xxs.gguf-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b64d5dbfe6d7e4d930d60cb5ff71fc6259357f969725d3c41ec5a220616b8fcf
3
+ size 15722352448