Hugging Face's logo

lmstudio-community
/
Llama3-ChatQA-1.5-70B-GGUF

Text Generation
GGUF
PyTorch
English
nvidia
chatqa-1.5
chatqa
llama-3
Inference Endpoints
imatrix
Model card Files Community
1
bartowski commited on
Commit
80589f8
·
1 Parent(s): 7403756

Remove files

Browse files
Files changed (23) hide show
  1. Llama3-ChatQA-1.5-70B-IQ1_S.gguf +0 -3
  2. Llama3-ChatQA-1.5-70B-IQ2_M.gguf +0 -3
  3. Llama3-ChatQA-1.5-70B-IQ2_XS.gguf +0 -3
  4. Llama3-ChatQA-1.5-70B-IQ2_XXS.gguf +0 -3
  5. Llama3-ChatQA-1.5-70B-IQ3_S.gguf +0 -3
  6. Llama3-ChatQA-1.5-70B-IQ3_XS.gguf +0 -3
  7. Llama3-ChatQA-1.5-70B-IQ3_XXS.gguf +0 -3
  8. Llama3-ChatQA-1.5-70B-IQ4_XS.gguf +0 -3
  9. Llama3-ChatQA-1.5-70B-Q3_K_M.gguf +0 -3
  10. Llama3-ChatQA-1.5-70B-Q3_K_S.gguf +0 -3
  11. Llama3-ChatQA-1.5-70B-Q4_K_S.gguf +0 -3
  12. Llama3-ChatQA-1.5-70B-Q5_K_S.gguf +0 -3
  13. Llama3-ChatQA-1.5-70B-Q6_K.gguf/Llama3-ChatQA-1.5-70B-Q6_K-00001-of-00002.gguf → Llama3-ChatQA-1.5-70B-Q6_K-00001-of-00002.gguf +0 -0
  14. Llama3-ChatQA-1.5-70B-Q6_K.gguf/Llama3-ChatQA-1.5-70B-Q6_K-00002-of-00002.gguf → Llama3-ChatQA-1.5-70B-Q6_K-00002-of-00002.gguf +0 -0
  15. Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00001-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00001-of-00003.gguf +0 -0
  16. Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00002-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00002-of-00003.gguf +0 -0
  17. Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00003-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00003-of-00003.gguf +0 -0
  18. Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00001-of-00005.gguf +0 -3
  19. Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00002-of-00005.gguf +0 -3
  20. Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00003-of-00005.gguf +0 -3
  21. Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00004-of-00005.gguf +0 -3
  22. Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00005-of-00005.gguf +0 -3
  23. Llama3-ChatQA-1.5-70B.imatrix +0 -3
Llama3-ChatQA-1.5-70B-IQ1_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d80d207e9ba272e5679dbb0585fc202900980b32c45f5fcb60bd9c4e44020de
3
- size 15343482208
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ2_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b095591ccad2cc38f9b08208b576ea943f3d37cb7f325b33e8516f620ae8eb6a
3
- size 24119293280
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ2_XS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7c6754db6dd0d4cb1aabd274300ec3fd135b4eef433eeaa5ac62cfe8d9d1dc2b
3
- size 21142107488
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ2_XXS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:757d3eec9ee94289027edd5bee1dc031b53e1dbbf1edbba29ea52a7a3aed9040
3
- size 19097384288
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ3_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:688a69f03db03793240dcdf9a4b28aeed0283bbfe81f7b6cd3c237f8329802a7
3
- size 30912050528
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ3_XS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:dec11bbfa810b13a63a64a55fbeb669ac1c89d0d88576136aa5468220a378a7c
3
- size 29307729248
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ3_XXS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:475df98c1b037a1154b5607036b2891e28190cc466f9799c93e646deea16abc1
3
- size 27469493600
 
 
 
 
Llama3-ChatQA-1.5-70B-IQ4_XS.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe3da6db448926498dcbf381bc8184a4fa2d5908db79f3ce9f60cf49933e8b08
3
- size 37902660960
 
 
 
 
Llama3-ChatQA-1.5-70B-Q3_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:afffa16653a51fc4e256b8eef70930bc415c15aaa971f3a5d4a16620fd5005bb
3
- size 34267493728
 
 
 
 
Llama3-ChatQA-1.5-70B-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f98a9ee8e4c4b4dc6d3f875349180e35499a2b417799c5532e636e5abf46d075
3
- size 30912050528
 
 
 
 
Llama3-ChatQA-1.5-70B-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:e69de7f9241df7949edd374b40840b04bb0aedb2654f5850ded5ca5420d440a2
3
- size 40347219296
 
 
 
 
Llama3-ChatQA-1.5-70B-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:82382b668db6fbb44b68db38827ee8a9beb75b33d779a979bb9bcb600e4e235e
3
- size 48657446240
 
 
 
 
Llama3-ChatQA-1.5-70B-Q6_K.gguf/Llama3-ChatQA-1.5-70B-Q6_K-00001-of-00002.gguf → Llama3-ChatQA-1.5-70B-Q6_K-00001-of-00002.gguf RENAMED
File without changes
Llama3-ChatQA-1.5-70B-Q6_K.gguf/Llama3-ChatQA-1.5-70B-Q6_K-00002-of-00002.gguf → Llama3-ChatQA-1.5-70B-Q6_K-00002-of-00002.gguf RENAMED
File without changes
Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00001-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00001-of-00003.gguf RENAMED
File without changes
Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00002-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00002-of-00003.gguf RENAMED
File without changes
Llama3-ChatQA-1.5-70B-Q8_0.gguf/Llama3-ChatQA-1.5-70B-Q8_0-00003-of-00003.gguf → Llama3-ChatQA-1.5-70B-Q8_0-00003-of-00003.gguf RENAMED
File without changes
Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00001-of-00005.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a0c2b9c95a5e5f38b976b8b33832f50d2f273ae0c75ead9263d3b3a92aab8ea
3
- size 31973798208
 
 
 
 
Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00002-of-00005.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac83c42f4b69ab6fed05f94fd947f613fc1b4f16e2c3a5cde8cb26d164d2d0f6
3
- size 32045738016
 
 
 
 
Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00003-of-00005.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7a4bcddcac083111cf67aa7b59ddbbcdad5483a3b8535f85bea94610e3c299d
3
- size 31743682240
 
 
 
 
Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00004-of-00005.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b2083c769332b7d94aa13d9b63a8403a0ee6681dd7d98dba3a9834933cfa3d80
3
- size 32045738016
 
 
 
 
Llama3-ChatQA-1.5-70B-fp16.gguf/Llama3-ChatQA-1.5-70B-fp16-00005-of-00005.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a22f84cb85bd60396113ffee18218cdb0e26c8f428f380422f3f47c27f0c8148
3
- size 13308956160
 
 
 
 
Llama3-ChatQA-1.5-70B.imatrix DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ef5b23085789dd69ed26d0be7d4f17af2b2fa18eaacfa83a1550df33597da31
3
- size 24922294