Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

32

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-70B

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated 2 days ago • 6.87k • 16

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 1 day ago • 4.51k • 11

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 21 minutes ago • 7.12k • 3

mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF

Updated about 14 hours ago • 602 • 3

mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit

Updated 1 day ago • 143 • 2

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 1 day ago • 735 • 2

WaveCut/deepseek-ai_DeepSeek-R1-Distill-Llama-70B_MLX-4bit

Updated 1 day ago • 48 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated 2 days ago • 180 • 1

mradermacher/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated about 16 hours ago • 227 • 1

lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated 2 days ago • 907

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

Text Generation • Updated 2 days ago • 51

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

Text Generation • Updated 2 days ago • 45

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated 2 days ago • 52

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

Text Generation • Updated 2 days ago • 47

mmnga/DeepSeek-R1-Distill-Llama-70B-gguf

Updated 1 day ago • 714

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 49

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q5_0-GGUF

Text Generation • Updated 2 days ago • 57

XelotX/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated 2 days ago • 168

zhitels/DeepSeek-R1-Distill-Llama-70B-4bit

Updated 1 day ago • 73

zhitels/DeepSeek-R1-Distill-Llama-70B-6bit

Updated 1 day ago • 19

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q8_0-GGUF

Text Generation • Updated 1 day ago • 61

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated 1 day ago • 56

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q4f16_1-MLC

Updated 1 day ago • 2

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q0f16-MLC

Updated 1 day ago • 6

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q4f32_1-MLC

Updated 1 day ago • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated 1 day ago • 72

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated about 24 hours ago • 19

second-state/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated about 6 hours ago

gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated about 1 hour ago

mlx-community/DeepSeek-R1-Distill-Llama-70B-6bit

Text Generation • Updated about 23 hours ago • 29