Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Q2.5-Veltha-14B-0.5-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
e81581b
Q2.5-Veltha-14B-0.5-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
903dbba8eb782fb26f8eb42f676f3e1a6a2201005e1350222fedd28fa54ab711
e81581b
verified
14 days ago
.gitattributes
1.79 kB
903dbba8eb782fb26f8eb42f676f3e1a6a2201005e1350222fedd28fa54ab711
14 days ago
Q2.5-Veltha-14B-0.5.Q5_K_M.gguf
10.5 GB
LFS
c01f6bc6d5a154fff384e4c34ecc6b415bd9c3bef1f594af2456b76fb6ce5f18
14 days ago
Q2.5-Veltha-14B-0.5.Q5_K_S.gguf
10.3 GB
LFS
59d8e1bd37a070300fa09f8fba2d13487c0c1b9a695bfccb20617dedd493f4e9
14 days ago
Q2.5-Veltha-14B-0.5.Q6_K.gguf
12.1 GB
LFS
39b7a92e7c83989a6f2058574fdadb6969ffd50570bf37bdb06599eedccb90d5
14 days ago
Q2.5-Veltha-14B-0.5.Q8_0.gguf
15.7 GB
LFS
903dbba8eb782fb26f8eb42f676f3e1a6a2201005e1350222fedd28fa54ab711
14 days ago