Hugging Face's logo

dranger003
/
bagel-dpo-20b-v04-llama-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
dranger003 commited on
Commit
8512a29
·
verified ·
1 Parent(s): b6cf6fc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -2,4 +2,7 @@
2
  license: other
3
  license_name: internlm2-20b
4
  license_link: https://huggingface.co/internlm/internlm2-20b#open-source-license
 
5
  ---
 
 
 
2
  license: other
3
  license_name: internlm2-20b
4
  license_link: https://huggingface.co/internlm/internlm2-20b#open-source-license
5
+ library_name: gguf
6
  ---
7
+ GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-dpo-20b-v04-llama
8
+ The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.