Hugging Face's logo

mradermacher
/
HarmBench-Mistral-7b-val-cls-i1-GGUF

Transformers
GGUF
English
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
72991bf
·
verified ·
1 Parent(s): 9908d3a

uploaded from rich1

Browse files
Files changed (23) hide show
  1. .gitattributes +22 -0
  2. HarmBench-Mistral-7b-val-cls.i1-IQ1_M.gguf +3 -0
  3. HarmBench-Mistral-7b-val-cls.i1-IQ1_S.gguf +3 -0
  4. HarmBench-Mistral-7b-val-cls.i1-IQ2_M.gguf +3 -0
  5. HarmBench-Mistral-7b-val-cls.i1-IQ2_S.gguf +3 -0
  6. HarmBench-Mistral-7b-val-cls.i1-IQ2_XS.gguf +3 -0
  7. HarmBench-Mistral-7b-val-cls.i1-IQ2_XXS.gguf +3 -0
  8. HarmBench-Mistral-7b-val-cls.i1-IQ3_M.gguf +3 -0
  9. HarmBench-Mistral-7b-val-cls.i1-IQ3_S.gguf +3 -0
  10. HarmBench-Mistral-7b-val-cls.i1-IQ3_XS.gguf +3 -0
  11. HarmBench-Mistral-7b-val-cls.i1-IQ3_XXS.gguf +3 -0
  12. HarmBench-Mistral-7b-val-cls.i1-IQ4_XS.gguf +3 -0
  13. HarmBench-Mistral-7b-val-cls.i1-Q2_K.gguf +3 -0
  14. HarmBench-Mistral-7b-val-cls.i1-Q2_K_S.gguf +3 -0
  15. HarmBench-Mistral-7b-val-cls.i1-Q3_K_L.gguf +3 -0
  16. HarmBench-Mistral-7b-val-cls.i1-Q3_K_M.gguf +3 -0
  17. HarmBench-Mistral-7b-val-cls.i1-Q3_K_S.gguf +3 -0
  18. HarmBench-Mistral-7b-val-cls.i1-Q4_0.gguf +3 -0
  19. HarmBench-Mistral-7b-val-cls.i1-Q4_K_M.gguf +3 -0
  20. HarmBench-Mistral-7b-val-cls.i1-Q4_K_S.gguf +3 -0
  21. HarmBench-Mistral-7b-val-cls.i1-Q5_K_M.gguf +3 -0
  22. HarmBench-Mistral-7b-val-cls.i1-Q5_K_S.gguf +3 -0
  23. HarmBench-Mistral-7b-val-cls.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ HarmBench-Mistral-7b-val-cls.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ HarmBench-Mistral-7b-val-cls.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ HarmBench-Mistral-7b-val-cls.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ HarmBench-Mistral-7b-val-cls.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ HarmBench-Mistral-7b-val-cls.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ HarmBench-Mistral-7b-val-cls.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ HarmBench-Mistral-7b-val-cls.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ HarmBench-Mistral-7b-val-cls.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ HarmBench-Mistral-7b-val-cls.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ HarmBench-Mistral-7b-val-cls.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ HarmBench-Mistral-7b-val-cls.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ HarmBench-Mistral-7b-val-cls.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ HarmBench-Mistral-7b-val-cls.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ HarmBench-Mistral-7b-val-cls.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ HarmBench-Mistral-7b-val-cls.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ HarmBench-Mistral-7b-val-cls.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ HarmBench-Mistral-7b-val-cls.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ HarmBench-Mistral-7b-val-cls.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ HarmBench-Mistral-7b-val-cls.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ HarmBench-Mistral-7b-val-cls.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ HarmBench-Mistral-7b-val-cls.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ HarmBench-Mistral-7b-val-cls.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
HarmBench-Mistral-7b-val-cls.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96dc8087220cd70f2fa787b07d00e2290991a13a92b00bb8bda0d1df4c2f411f
3
+ size 1754447104
HarmBench-Mistral-7b-val-cls.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:371bac307acb2cd4dc94d1f54b35f4a9c766d1009441fc52f4b3fc5274f79fbe
3
+ size 1612102912
HarmBench-Mistral-7b-val-cls.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fdaad3159d786fbee87a06807e6348f38a7855bda92023adf98e8023f96eedb
3
+ size 2500713728
HarmBench-Mistral-7b-val-cls.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1656c3b49f122dbc697430c8b60e494699873d266c3553c33358bd46e258f18
3
+ size 2310921472
HarmBench-Mistral-7b-val-cls.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:665722c84c08448f4911db5a5d8b1607dba8f039115da2d08634857d6e7c8783
3
+ size 2198256896
HarmBench-Mistral-7b-val-cls.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba854641148bbb0326917736d4f381b7f73682b4a1b68959bfbb052b43217360
3
+ size 1991687424
HarmBench-Mistral-7b-val-cls.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78c7be06d49a55fc98bde808d350f238b48a1fe7af936bbe221c4c48aef2fdc0
3
+ size 3284892928
HarmBench-Mistral-7b-val-cls.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04a75bfc577726062ab4e04e6afb57fa82724357630f83d4582fb4d290fbbc4f
3
+ size 3182394624
HarmBench-Mistral-7b-val-cls.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8228056cc04b32c8af4a3e7c19e034577030020ac90ec5f5c6f6d477ca52be21
3
+ size 3018816768
HarmBench-Mistral-7b-val-cls.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8ed56a3282681932baa0270cdce1696a168f7d9efa215aecda53b12e4491017
3
+ size 2827345152
HarmBench-Mistral-7b-val-cls.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c8094319b82ab887d1b4de9733345f78e581fa257da82e492b69e6cec0add9d
3
+ size 3907689728
HarmBench-Mistral-7b-val-cls.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e6acb0d407b38e11cd3540823f5271f445a3e8d52df83b5ee295b1b77ceccc0
3
+ size 2719243520
HarmBench-Mistral-7b-val-cls.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a33553dc3cfba4eced7f87597d927997c03b1e4f0cfc227feca6067dcaa63ff
3
+ size 2528926976
HarmBench-Mistral-7b-val-cls.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d6e6683f99f555f148161202b8bb6a58f5e254aa3e72cde38c9cd4560236de0
3
+ size 3822025984
HarmBench-Mistral-7b-val-cls.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f663371c14e120058c51818c992e0ad7a7ee4e618e631750a30669e64be81e3a
3
+ size 3518987520
HarmBench-Mistral-7b-val-cls.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:917f8c5293f81c699f65abb95a730884a017c0b2b1cbc91e37018a7328bcd696
3
+ size 3164568832
HarmBench-Mistral-7b-val-cls.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb4aeb5cdc3dea37893517228913855d03941ca0bc82b88e06b887f11d451199
3
+ size 4123598080
HarmBench-Mistral-7b-val-cls.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e20fc535ed589ac3fb292898d7f112bcba0cf3bd3b5b45b5a35f2441a53b706f
3
+ size 4368440576
HarmBench-Mistral-7b-val-cls.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f0f3fdc9c31e06c14c05b56bcfe8318eed563899ae24becae6c8edf223ef99a
3
+ size 4140375296
HarmBench-Mistral-7b-val-cls.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:835fd31f0f0a15c538735aab11f812f14c3b035e49a1a6f059ba90d8c09670ad
3
+ size 5131410688
HarmBench-Mistral-7b-val-cls.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b98eed5dec9d73f58b4f491a4d6ab4b282da5f612ba4470164589baa14711f5
3
+ size 4997717248
HarmBench-Mistral-7b-val-cls.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73f5ec66abd181efe4a48c84941ab1244a378ece76df0068d278a532e041c2ac
3
+ size 5942066432