Hugging Face's logo

CISCai
/
gorilla-openfunctions-v2-SOTA-GGUF

Text Generation
GGUF
English
Inference Endpoints
conversational
Model card Files Community
2
CISCai commited on
Commit
ac17bfd
·
verified ·
1 Parent(s): ac699f6

Minor chat template fix and requantized for IQ3_S improvements

Browse files

The tokenizer.chat_template now only generates functions in the last message to save multi-turn context.

Requantized everything to benefit of [minor IQ3_S improvements](https://github.com/ggerganov/llama.cpp/pull/5829) which are used in some of the weights across almost all the quants.

Files changed (10) hide show
  1. gorilla-openfunctions-v2.IQ1_S.gguf +2 -2
  2. gorilla-openfunctions-v2.IQ2_M.gguf +2 -2
  3. gorilla-openfunctions-v2.IQ2_S.gguf +2 -2
  4. gorilla-openfunctions-v2.IQ2_XS.gguf +2 -2
  5. gorilla-openfunctions-v2.IQ2_XXS.gguf +2 -2
  6. gorilla-openfunctions-v2.IQ3_M.gguf +2 -2
  7. gorilla-openfunctions-v2.IQ3_S.gguf +2 -2
  8. gorilla-openfunctions-v2.IQ3_XS.gguf +2 -2
  9. gorilla-openfunctions-v2.IQ3_XXS.gguf +2 -2
  10. gorilla-openfunctions-v2.IQ4_XS.gguf +2 -2
gorilla-openfunctions-v2.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5854c9390ff451720b14423b812917c508ef379737c467dc86434afb212436c8
3
- size 1733444160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdf682b7e4b13f67566d2a5ce0eb84b23ddacfe77833d71914c9ee1067bdca59
3
+ size 1733444192
gorilla-openfunctions-v2.IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a70c69406a842a190ba6393205e4db16256100645970ad4ad725cdb9e3e1cb8
3
- size 2543575616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b1e50e1c006c31336256eb1d9076a8b3b7de0558732014b0c69d04abcf7e880
3
+ size 2543575648
gorilla-openfunctions-v2.IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:478406dea92c4320e2f9dff287dda1d115f53308e08156c9b336d72fc3eb127e
3
- size 2389533248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15d462b085b9e07c792d261ee4112ca4aa6c9f42051bc47b16cb864d3983c6ba
3
+ size 2389533280
gorilla-openfunctions-v2.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:32da41bb393c0e56baf836d5982037af620d7e4eb449d382bd5d659eabe2ae64
3
- size 2211299904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:947e483db824498f5cf43dd5752c184606cb97f93a0ecbce0d0095a9472f2fe2
3
+ size 2211299936
gorilla-openfunctions-v2.IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f02fbb33f57e18e6d5b4f35a679b900960528afc1217280056a5d84c1ee8ecd4
3
- size 2041528896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d2484d0ad985417a9d7073bc30f63c9dc5f216a45f568b9892c24b94f6cadd0
3
+ size 2041528928
gorilla-openfunctions-v2.IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffa582a4328753f96663057057b22e7af57f8028c50ea1a947f13694382e2150
3
- size 3290088000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1028e3efaeec822182d964f30052d74dd31bd8707dbc4659fe78200afb2c4f5
3
+ size 3290088032
gorilla-openfunctions-v2.IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96777f8fe78e22d594ce96d4b977a043b7e42448cf45fd56e1784f23ea507841
3
- size 3138429504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c2dd4d95355e9bc1754a588cbf59b6530733f9b42c2e7a8c669d245018cdb55
3
+ size 3138429536
gorilla-openfunctions-v2.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c10e8766e9895dae01cd1b38900f605830ef6659ca8eed51d8abe90698c58a2b
3
- size 2994020928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f03929c9df18ce0df3026395e67efb1811cf3397f3debd207b6c9d32ad988e93
3
+ size 2994020960
gorilla-openfunctions-v2.IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c2784d4b9ad08bc28dca9880f2c38b90c15cc197eb616be86d77553cbe34cc3
3
- size 2758812224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b344450a000a4dfdd2b699acf442aa143cc1db86af7d7789d3742969ebd64ae
3
+ size 2758812256
gorilla-openfunctions-v2.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79a8b5e02f9a15883d6c57350a288c458cc8392e83571e1f42df688176449639
3
- size 3797639744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00b3ba4aed1296bb8c10d33f5f10b42938921c1c7a2cf710fc8da60ac3cc0858
3
+ size 3797639776