Ollama-ready Coding Models - a onekq-ai Collection

onekq-ai 's Collections

Ollama-ready Coding Models

QLora-ready Coding Models

Ollama-ready Coding Models

updated 4 days ago

For inference. CPU is enough for both quantization and inference.

QuantFactory/OpenCoder-8B-Instruct-GGUF

Text Generation • Updated Nov 9, 2024 • 139 • 6
QuantFactory/OpenCoder-8B-Base-GGUF

Text Generation • Updated Nov 9, 2024 • 59 • 3
bartowski/starcoder2-15b-instruct-GGUF

Text Generation • Updated Mar 6, 2024 • 461 • 2
QuantFactory/starcoder2-15b-GGUF

Text Generation • Updated Sep 6, 2024 • 138 • 2
bartowski/starcoder2-15b-instruct-v0.1-GGUF

Text Generation • Updated Apr 30, 2024 • 421 • 6
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 20.3k • 92
QuantFactory/starcoder2-7b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 117 • 1
QuantFactory/starcoder2-7b-GGUF

Text Generation • Updated Sep 5, 2024 • 137 • 2
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF

Updated Oct 18, 2024 • 154 • 1
QuantFactory/starcoder2-3b-instruct-GGUF

Text Generation • Updated Oct 18, 2024 • 49 • 1
QuantFactory/starcoder2-3b-GGUF

Text Generation • Updated Sep 5, 2024 • 443 • 3
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 8 days ago • 55.4k • 120
bartowski/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated Nov 11, 2024 • 1.47k • 11
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 42.4k • 34
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF

Updated 14 days ago • 340 • 1
Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 17.2k • 49
QuantFactory/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated Sep 19, 2024 • 478 • 2
Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 39.1k • 27
QuantFactory/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Sep 19, 2024 • 167 • 2
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF

Text Generation • Updated Jun 24, 2024 • 179 • 1
ibm-granite/granite-34b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 49 • 2
ibm-granite/granite-34b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 21 • 3
ibm-granite/granite-20b-code-instruct-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 62 • 4
ibm-granite/granite-20b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 21 • 4
QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 171 • 3
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf

Updated Aug 22, 2024 • 75
ibm-granite/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 292 • 10
ibm-granite/granite-8b-code-base-4k-GGUF

Text Generation • Updated Sep 2, 2024 • 15 • 2
mradermacher/granite-3b-code-instruct-128k-GGUF

Updated 21 days ago • 258
QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7, 2024 • 85 • 2
ibm-granite/granite-3b-code-instruct-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 86 • 5
ibm-granite/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 2, 2024 • 30 • 2