DeepSeek-R1-Distill-Llama-8B-GGUF
Original Model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Run with Gaianet
Prompt template:
prompt template: llama-3-chat
Context size:
chat_ctx_size: 128000
Run with GaiaNet:
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4519
- Downloads last month
- 0
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B