Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

201

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

wonjib/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 20, 2024

wonjib/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 1

Hyeopgeon/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 20, 2024 • 4

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 21, 2024

ShinnningPikachu/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 21, 2024 • 1

GuilFV/llama3sarcastic

Updated Nov 21, 2024 • 2

matrixportal/Llama-3.2-3B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Nov 23, 2024 • 4

matrixportal/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 22, 2024

matrixportal/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 25, 2024 • 1

matrixportal/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 22, 2024 • 3

Maites/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 1

espressor/meta-llama.Llama-3.2-3B-Instruct_W8A8_FP8

Text Generation • Updated Nov 28, 2024 • 22

espressor/meta-llama.Llama-3.2-3B-Instruct_W4A16

Text Generation • Updated Nov 28, 2024 • 38

espressor/meta-llama.Llama-3.2-3B-Instruct_W8A8_int8

Text Generation • Updated Nov 28, 2024 • 15

serena97/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 30, 2024 • 2

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-asym

Text Generation • Updated Dec 1, 2024 • 21

ericflo/Llama-3.2-3B-COTv2

Text Generation • Updated Dec 2, 2024 • 612

ericflo/Llama-3.2-3B-COTv2.1

Text Generation • Updated Dec 2, 2024 • 761

ericflo/Llama-3.2-3B-COTv2.2

Text Generation • Updated Dec 2, 2024 • 542

hainam2410/vstep_llama

Text Generation • Updated Dec 3, 2024 • 18

jwiggerthale/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Dec 2, 2024 • 9

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 2, 2024 • 15

jwiggerthale/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Dec 2, 2024 • 61

prettyvampire/poemma

Text Generation • Updated about 1 month ago • 28

fractionallab/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Dec 3, 2024 • 16

amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid

Updated 23 days ago • 19

apu20/Llama3-2_3B_dora

Text Generation • Updated 13 days ago • 15

Boo1312/Llama-3.2-3B-original-GGUF

Text Generation • Updated 25 days ago • 37

amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-bf16-onnx-ryzen-strix

Updated 23 days ago • 11

boadisamson/Qgis-Hermes-3-Llama-3.2-3B

Text Generation • Updated 4 days ago • 152