Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

17

Full-text search

Active filters: ibm-granite/granite-3.1-8b-instruct

bartowski/granite-3.1-8b-instruct-GGUF

Text Generation • Updated 9 days ago • 4.25k • 6

lmstudio-community/granite-3.1-8b-instruct-GGUF

Text Generation • Updated 9 days ago • 11.9k • 2

NikolayKozloff/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • Updated 14 days ago • 20 • 1

DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation • Updated 13 days ago • 187 • 2

mradermacher/granite-3.1-8b-instruct-GGUF

Updated 12 days ago • 125

mradermacher/granite-3.1-8b-instruct-i1-GGUF

Updated 12 days ago • 383

jakiAJK/granite-3.1-8b-instruct_GPTQ-int4

Text Generation • Updated 10 days ago • 103

jakiAJK/granite-3.1-8b-instruct_AWQ

Text Generation • Updated 10 days ago • 36

itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 9 days ago • 3

SandLogicTechnologies/Granite-3.1-8b-instruct-GGUF

Updated 9 days ago • 8

Triangle104/granite-3.1-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated 7 days ago • 19

Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 7 days ago • 10

Triangle104/granite-3.1-8b-instruct-Q5_K_S-GGUF

Text Generation • Updated 7 days ago • 19

Triangle104/granite-3.1-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated 7 days ago • 19

Triangle104/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • Updated 7 days ago • 7

Triangle104/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • Updated 7 days ago • 5

tensorblock/granite-3.1-8b-instruct-GGUF

Text Generation • Updated about 3 hours ago • 33