DevQuasar
/

PowerInfer.SparseQwen2-7B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

PowerInfer.SparseQwen2-7B-GGUF

Commit History

Upload PowerInfer.SparseQwen2-7B.f16.gguf

2db83f1
verified

csabakecskemeti commited on 18 days ago

Upload PowerInfer.SparseQwen2-7B.Q3_K_M.gguf with huggingface_hub

4fa4a3e
verified

csabakecskemeti commited on 19 days ago

Upload PowerInfer.SparseQwen2-7B.Q5_K_M.gguf with huggingface_hub

240b9e7
verified

csabakecskemeti commited on 19 days ago

Upload PowerInfer.SparseQwen2-7B.Q4_K_M.gguf with huggingface_hub

601710f
verified

csabakecskemeti commited on 19 days ago

Upload PowerInfer.SparseQwen2-7B.Q8_0.gguf with huggingface_hub

214e646
verified

csabakecskemeti commited on 19 days ago

Upload PowerInfer.SparseQwen2-7B.Q6_K.gguf with huggingface_hub

4122583
verified

csabakecskemeti commited on 19 days ago

Upload PowerInfer.SparseQwen2-7B.Q2_K.gguf with huggingface_hub

95e109e
verified

csabakecskemeti commited on 19 days ago

Upload README.md with huggingface_hub

395067a
verified

csabakecskemeti commited on 19 days ago

initial commit

a1f5d75
verified

csabakecskemeti commited on 19 days ago