Converted to MLX and quantized to Q4. Base model https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct .

Downloads last month
1
Safetensors
Model size
502M params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for jesusoctavioas/Llama-3.2-3B-Instruct-MLX-Q4

Quantized
(226)
this model