Hugging Face's logo

emircanerol
/
Llama3-Med42-8B-4bit

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
unsloth
trl
conversational
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Uploaded model

  • Developed by: emircanerol
  • License: apache-2.0
  • Finetuned from model : m42-health/Llama3-Med42-8B

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
58
Safetensors
Model size
4.65B params
Tensor type
FP16
路
F32
路
U8
路
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for emircanerol/Llama3-Med42-8B-4bit

Base model

m42-health/Llama3-Med42-8B
Quantized
(8)
this model

Space using emircanerol/Llama3-Med42-8B-4bit 1