nmerkle
/

Meta-Llama-3-8B-Instruct-ggml-model-Q4_K_M.gguf

Inference Endpoints

Model card Files Files and versions Community

Quantized Meta-Llama-3B-Instruct model

Tested inference on Raspberry PI Model 4 with llama.cpp. ~0.5 Tokens per second.

Downloads last month: 79

GGUF

Model size

8.03B params

Architecture

llama

4-bit

Inference API

Unable to determine this model's library. Check the docs .