Qwen-2.5 GGUF Models - a second-state Collection

second-state 's Collections

Falcon3-Instruct GGUF Models

Qwen2-VL GGUF Models

InternLM-2.5 GGUF

Llama-3.2 1B & 3B GGUF Models

Qwen-2.5 GGUF Models

Yi-1.5 GGUF Models

FLUX.1 GGUF Models

Qwen-2.5 GGUF Models

updated Sep 25, 2024

LlamaEdge compatible quants for Qwen 2.5 instruct and coder models.

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 195 • 2
second-state/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 80 • 1
second-state/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 116 • 1
second-state/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 110
second-state/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 202
second-state/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 88
second-state/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 84
second-state/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 88
second-state/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 78