Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

129

Full-text search

Active filters: llama3.1

mav23/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 17, 2024 • 105 • 1

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.0bpw-6hb-exl2

Text Generation • Updated Oct 18, 2024 • 6

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.5bpw-6hb-exl2

Text Generation • Updated Oct 18, 2024 • 5

impactframes/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • Updated Oct 19, 2024 • 12

win28703/Llama-3.1-Nemotron-70B-Instruct-HF-Q8-mlx

Text Generation • Updated Oct 21, 2024 • 17

AIDX-ktds/ktdsbaseLM-v0.10-onbased-llama3.1

Text Generation • Updated Oct 31, 2024 • 143

AIDX-ktds/ktdsbaseLM-v0.14-onbased-llama3.1

Text Generation • Updated 1 day ago • 472 • 1

mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-i1-GGUF

Updated Nov 4, 2024 • 255 • 1

AIDXteam/ktdsbaseLM-v0.16-onbased-llama3.1

Text Generation • Updated 5 days ago • 12

RohitPoreddy/Llama-3.1-Nemotron-70B-Instruct-HF-Q4-mlx

Text Generation • Updated Nov 7, 2024 • 15

Sai003/llama-70-b

Text Generation • Updated Nov 7, 2024 • 5

Sai003/Llama-3.1-70B

Text Generation • Updated Nov 8, 2024 • 13

tensorblock/Arabic-llama3.1-16bit-FT-GGUF

Text Generation • Updated Nov 16, 2024 • 47

elitexp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4-mlx

Text Generation • Updated Nov 13, 2024 • 9

Jellon/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-exl2-3bpw

Text Generation • Updated Nov 15, 2024 • 14

sequelbox/Llama3.1-70B-PlumChat

Text Generation • Updated Dec 4, 2024 • 51 • 1

mradermacher/Llama3.1-70B-PlumChat-GGUF

Updated Nov 19, 2024 • 4

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

Updated Nov 19, 2024 • 36

Model-SafeTensors/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • Updated Oct 25, 2024 • 18

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 5

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 7

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 9

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 7

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 2, 2024 • 11

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 10

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 2, 2024 • 4

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 2, 2024 • 4

tensorblock/Llama-3.1-Nemotron-70B-Instruct-HF-bf16-GGUF

Text Generation • Updated Dec 3, 2024 • 132

tensorblock/Llama-3.1-Nemotron-70B-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 73

aeranginkaman/Dorna2-Llama3.1-8B-Instruct-Q4_K_M-GGUF

Updated Dec 7, 2024 • 22