Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7
MaziyarPanahi commited on
Commit
d540a30
·
verified ·
1 Parent(s): 40d0301

746fb025e4afe5a5a4f5f9f1d66558193414975cda1a23c3125821fe6b1bb9e9

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,4 @@ Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
  Meta-Llama-3.1-70B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
  Meta-Llama-3.1-70B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
39
  Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
  Meta-Llama-3.1-70B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
  Meta-Llama-3.1-70B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-70B-Instruct.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6973a51ab0535ff2b2ab3bc5d1e68f1ac3b7e10ad0c2a6f9a8437005518503ec
3
+ size 49949816960