Hugging Face's logo

mradermacher
/
Mixtral-8x7B-Instruct-v0.1-i1-GGUF

Transformers
GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
210bcb4
•
1 Parent(s): 809baef

uploaded from kaos

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Mixtral-8x7B-Instruct-v0.1.i1-IQ2_M.gguf +3 -0
  3. Mixtral-8x7B-Instruct-v0.1.i1-IQ2_S.gguf +3 -0
  4. Mixtral-8x7B-Instruct-v0.1.i1-IQ3_M.gguf +3 -0
  5. Mixtral-8x7B-Instruct-v0.1.i1-IQ3_S.gguf +3 -0
  6. Mixtral-8x7B-Instruct-v0.1.i1-IQ3_XS.gguf +3 -0
  7. Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -46,3 +46,9 @@ Mixtral-8x7B-Instruct-v0.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
  Mixtral-8x7B-Instruct-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
  Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
48
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
46
  Mixtral-8x7B-Instruct-v0.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
  Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
48
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
49
+ Mixtral-8x7B-Instruct-v0.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mixtral-8x7B-Instruct-v0.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mixtral-8x7B-Instruct-v0.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mixtral-8x7B-Instruct-v0.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Mixtral-8x7B-Instruct-v0.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x7B-Instruct-v0.1.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9ea85450c546053ebadfaa4fff49834cf2b2231ffc30d9a4faed6c8886f864a
3
+ size 15665170304
Mixtral-8x7B-Instruct-v0.1.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c80e9467619493c8d7aa748d09a7c09d7eeda6ee13f234d650cff9c8ad762717
3
+ size 14297827200
Mixtral-8x7B-Instruct-v0.1.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f58d28cb102696ea29aea932286555b1927b7bb6ca75c1711caa40b6cd88a122
3
+ size 21583333248
Mixtral-8x7B-Instruct-v0.1.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cb1823fd3f8a2fdb48f95f6623759960528bd5a83fa31113ef348aa032e32f5
3
+ size 20585088896
Mixtral-8x7B-Instruct-v0.1.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd23335dfa31813eb95c9e24b05915eebedd3533ab56836b014844ba18f6e199
3
+ size 19436898176
Mixtral-8x7B-Instruct-v0.1.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:140e464962bac7a19afeef3746ebc7cf2ae0aa161f112742fae91a6117c747a0
3
+ size 32383903616