Add models

Signed-off-by: Xin Liu <[email protected]>

Files changed (10) hide show

Mixtral-8x7B-Instruct-v0.1-Q3_K_L.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:3e00697bc004cd19b2b6c3b1f8da70283559be1457b5c9a8b74fdc146d9229b9
+size 24167589760

Mixtral-8x7B-Instruct-v0.1-Q3_K_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9728d89750c879bc2bab36a105bfb1c2ce93675b38938ba750d32deb6d09f75
+size 22544394112

Mixtral-8x7B-Instruct-v0.1-Q3_K_S.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:e685c729b482a0fba3f7560cd20235569937c55fde9a79526bfc8271ed16d88d
+size 20430464896

Mixtral-8x7B-Instruct-v0.1-Q4_0.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:a66f440f631d56d54a3ee444448c98d7e3ba44d58c32fb00852d25e72bbcd369
+size 26441533312

Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:f82f5e18140c1b715d97623b8d3d2453252d0517e1bc3f53e7828362c6e50137
+size 28446410624

Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:d758d872813b4006b12334f9881fd1babb678643925889e926cbf6435ce98181
+size 26743523200

Mixtral-8x7B-Instruct-v0.1-Q5_0.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:c912687e8c1d0093b24420f57490e5676c742e59c0cd2632d9d78899cc973755
+size 32229279616

Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:6d6f69cbed2dc3b46d73d340250346809eca7e214fe050c8339f450208775060
+size 32229279616

Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:6aa6a3a2a576fe549e136e1f17ef1cb7627e7d2b337a0cb06d675ffb66ba7be3
+size 38378760064

Mixtral-8x7B-Instruct-v0.1-Q8_0.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:b738afcd7892b22286377f4c25ba70dbefad5e8ff3d33dba64767b640f4884b1
+size 49624262528