Edit Models filters

Model Tree

meta-llama/Llama-3.1-70B

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

48

Full-text search

Active filters: meta-llama/Llama-3.1-70B

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 8.2k • 29

neuralmagic/Meta-Llama-3.1-70B-FP8

Text Generation • Updated Oct 9, 2024 • 223 • 1

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23, 2024 • 978 • 36

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 20 • 17

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated 28 days ago • 25.9k • 22

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-4.25bpw-h6-exl2

Text Generation • Updated 28 days ago • 33 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated 28 days ago • 59 • 1

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated 28 days ago • 70 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated 28 days ago • 131 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated 28 days ago • 154 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated 28 days ago • 86 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated 28 days ago • 121 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated 28 days ago • 112 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated 28 days ago • 92 • 1

ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF

Updated 19 days ago • 6.28k • 1

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8, 2024 • 284 • 2

mradermacher/Meta-Llama-3.1-70B-GGUF

Updated 19 days ago • 286

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

Updated 19 days ago • 163 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 13

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 10

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 7

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 9

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 7

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 3

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 7

LoneStriker/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 16, 2024 • 19 • 2

XelotX/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 17, 2024 • 8

Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2

Updated Aug 18, 2024 • 7

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024 • 3

bullerwins/Hermes-3-Llama-3.1-70B-exl2_4.0bpw

Updated Aug 24, 2024 • 6