transformers gguf llama text-generation-inference unsloth en base_model:unsloth/Meta-Llama-3.1-8B-bnb-4bit base_model:quantized:unsloth/Meta-Llama-3.1-8B-bnb-4bit license:llama3.1 endpoints_compatible region:us
{"model_type": "llama"}