Hugging Face's logo

xaskasdf
/
phi-3-mini-4k-instruct-gguf

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
xaskasdf commited on
Commit
a2ee631
·
verified ·
1 Parent(s): 792af0b

Upload converted and quantized model weights

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. phi-3-mini-4k-instruct-f16.gguf +3 -0
  3. phi-3-mini-4k-instruct-q2_k.gguf +3 -0
  4. phi-3-mini-4k-instruct-q3_k.gguf +3 -0
  5. phi-3-mini-4k-instruct-q4_0.gguf +3 -0
  6. phi-3-mini-4k-instruct-q4_k.gguf +3 -0
  7. phi-3-mini-4k-instruct-q5_0.gguf +3 -0
  8. phi-3-mini-4k-instruct-q5_k.gguf +3 -0
  9. phi-3-mini-4k-instruct-q6_k.gguf +3 -0
  10. phi-3-mini-4k-instruct-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ phi-3-mini-4k-instruct-f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ phi-3-mini-4k-instruct-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
38
+ phi-3-mini-4k-instruct-q3_k.gguf filter=lfs diff=lfs merge=lfs -text
39
+ phi-3-mini-4k-instruct-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ phi-3-mini-4k-instruct-q4_k.gguf filter=lfs diff=lfs merge=lfs -text
41
+ phi-3-mini-4k-instruct-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ phi-3-mini-4k-instruct-q5_k.gguf filter=lfs diff=lfs merge=lfs -text
43
+ phi-3-mini-4k-instruct-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
44
+ phi-3-mini-4k-instruct-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
phi-3-mini-4k-instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe4c64522173db6b3dae84ae667f6a8ad9e6cbc767f37ef165addbed991b129d
3
+ size 7643296704
phi-3-mini-4k-instruct-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5aed8a7392fede27a0d08e2e8acd0451fd6354e311947e28c2b11c3effebeee7
3
+ size 1532403648
phi-3-mini-4k-instruct-q3_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e269bff20f78ab65732f1f008bf82c28c5f48f3a038fc1ebb5d17beb572e98ec
3
+ size 2071676352
phi-3-mini-4k-instruct-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3d6d9fae9a0fe8feab3940329466b02863bae44cae3b8805b63ae349e410246
3
+ size 2292376512
phi-3-mini-4k-instruct-q4_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9632ac1ea30d0ce601eb6d6a9c4a7d9d9b50cdd0db4a0cdcc95395a6c9ab91f5
3
+ size 2509431744
phi-3-mini-4k-instruct-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:059b7339cb343870b67204738753016fa720722abfc927ac815bdf798214abcc
3
+ size 2757673920
phi-3-mini-4k-instruct-q5_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aff7018298dada74f613c192fcd3c9610b04281ee75c3d0f5c337a1ba240663a
3
+ size 2931475392
phi-3-mini-4k-instruct-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:386f5b1a3c8d976875b7b863a20e74b23f4579df4f5718c6d816299d7fa14e10
3
+ size 3252052416
phi-3-mini-4k-instruct-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bcf856905efac1eb4bb237c71f187043263e7cb8e1218e292ce3e1fa39c47a8
3
+ size 4153566144