Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
QuantFactory
/
Meta-Llama-3-70B-Instruct-GGUF-v2
like
16
Follow
Quant Factory
337
Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
Inference Endpoints
conversational
License:
llama3
Model card
Files
Files and versions
Community
1
Deploy
Use this model
2aa0cdd
Meta-Llama-3-70B-Instruct-GGUF-v2
2 contributors
History:
10 commits
0-hero
Upload Meta-Llama-3-70B-Instruct-v2.Q5_0.gguf with huggingface_hub
2aa0cdd
verified
9 months ago
.gitattributes
2.29 kB
Upload Meta-Llama-3-70B-Instruct-v2.Q5_0.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q5_0.gguf
48.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q5_0.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q5_1-00001-of-00002.gguf
32.2 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q5_1-00001-of-00002.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q5_K_M.gguf
50 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q5_K_M.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q5_K_S.gguf
48.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q5_K_S.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q6_K-00001-of-00002.gguf
32.1 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q6_K-00001-of-00002.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q6_K-00002-of-00002.gguf
25.7 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q6_K-00002-of-00002.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q8_0-00001-of-00003.gguf
32 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q8_0-00001-of-00003.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q8_0-00002-of-00003.gguf
32.1 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q8_0-00002-of-00003.gguf with huggingface_hub
9 months ago
Meta-Llama-3-70B-Instruct-v2.Q8_0-00003-of-00003.gguf
10.9 GB
LFS
Upload Meta-Llama-3-70B-Instruct-v2.Q8_0-00003-of-00003.gguf with huggingface_hub
9 months ago
