Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Falcon3-3B-Base-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card
Files
Files and versions
Community
1
Train
Use this model
65c0188
Falcon3-3B-Base-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
374c7f8759c4ccecc2acce685c9eca2fe0dcec117be95681c17855a3b9079e45
65c0188
verified
about 1 month ago
.gitattributes
Safe
1.9 kB
374c7f8759c4ccecc2acce685c9eca2fe0dcec117be95681c17855a3b9079e45
about 1 month ago
Falcon3-3B-Base-GGUF_imatrix.dat
2.44 MB
LFS
374c7f8759c4ccecc2acce685c9eca2fe0dcec117be95681c17855a3b9079e45
about 1 month ago
Falcon3-3B-Base.Q5_K_M.gguf
2.32 GB
LFS
9b37597a9375d203400d101f65d84979726cb9de90331fe6e134a3e9c40577db
about 1 month ago
Falcon3-3B-Base.Q5_K_S.gguf
2.28 GB
LFS
4ad28a1f6edf3b9bb52c7d7ae8a6164287a13adb7ce0516bf1ff8b70c81f9c5c
about 1 month ago
Falcon3-3B-Base.Q6_K.gguf
2.65 GB
LFS
842ec56584c2f01a3ac9a0c7045e17f0c6e8ef58a8f35ac56ff827c89c753a96
about 1 month ago
Falcon3-3B-Base.Q8_0.gguf
3.44 GB
LFS
578adf0e144dcb0b0031127b4b42934896e610eb5b079058b5002a5b4ba50b12
about 1 month ago
Falcon3-3B-Base.fp16.gguf
6.46 GB
LFS
440a6c4efe18cdecb171822f367cfc7e315b279bbc97a65047d35d213c45e220
about 1 month ago
README.md
Safe
2.9 kB
374c7f8759c4ccecc2acce685c9eca2fe0dcec117be95681c17855a3b9079e45
about 1 month ago
