flyingfishinwater
/

good_and_small_models

Inference Endpoints

Model card Files Files and versions Community

good_and_small_models

1 contributor

History: 59 commits

flyingfishinwater's picture

flyingfishinwater

Upload qwen1_5-4b-chat-q4_k_m.gguf

446ae9a verified 9 months ago

.gitattributes

2.99 kB

Upload qwen1_5-4b-chat-q4_k_m.gguf 9 months ago
LiteLlama-460M-1T-Q8_0.gguf

493 MB
LFS

Upload LiteLlama-460M-1T-Q8_0.gguf about 1 year ago
Meta-Llama-3-8B-Instruct-Q4_K_M.gguf

4.92 GB
LFS

Upload Meta-Llama-3-8B-Instruct-Q4_K_M.gguf 9 months ago
README.md

19.2 kB

Update README.md 9 months ago
WizardLM-2-7B.Q3_K_M.gguf

3.52 GB
LFS

Upload WizardLM-2-7B.Q3_K_M.gguf 9 months ago
WizardLM-2-7B.Q8_0.gguf

7.7 GB
LFS

Upload WizardLM-2-7B.Q8_0.gguf 9 months ago
chinese-tiny-llm-2b-Q8_0.gguf

2.27 GB
LFS

Upload chinese-tiny-llm-2b-Q8_0.gguf 9 months ago
dolphin-2.8-mistral-7b-v02-Q2_K.gguf

2.72 GB
LFS

Upload dolphin-2.8-mistral-7b-v02-Q2_K.gguf 10 months ago
gemma-2b-it-q8_0.gguf

2.67 GB
LFS

Upload gemma-2b-it-q8_0.gguf 11 months ago
mistral-7b-instruct-v0.2.Q8_0.gguf

7.7 GB
LFS

Upload 7 files about 1 year ago
openchat-3.5-0106.Q3_K_M.gguf

3.52 GB
LFS

Upload openchat-3.5-0106.Q3_K_M.gguf 9 months ago
phi-2.Q5_K_M.gguf

2.07 GB
LFS

Upload phi-2.Q5_K_M.gguf 9 months ago
qwen1_5-4b-chat-q4_k_m.gguf

2.46 GB
LFS

Upload qwen1_5-4b-chat-q4_k_m.gguf 9 months ago
starcoder2-3b-instruct-gguf_Q8_0.gguf

3.22 GB
LFS

Upload starcoder2-3b-instruct-gguf_Q8_0.gguf 11 months ago
tinyllama-1.1B-chat-v1.0-Q8_0.gguf

1.17 GB
LFS

Upload tinyllama-1.1B-chat-v1.0-Q8_0.gguf about 1 year ago
yi-chat-6b.Q4_K_M.gguf

3.67 GB
LFS

Upload yi-chat-6b.Q4_K_M.gguf 9 months ago