intervitens
/

dolphin-2.6-mixtral-8x7b-3.7bpw-h6-exl2-rpcal

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

intervitens commited on Dec 27, 2023

Commit

0508974

·

1 Parent(s): 60dc484

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ license: apache-2.0
 ---
-Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset. For purposes other than RP, use quantizations done on a more general dataset, like [these](https://huggingface.co/turboderp/Mixtral-8x7B-instruct-exl2).
 Requires ExllamaV2 version 0.0.11 and up.

 ---
+Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset.
 Requires ExllamaV2 version 0.0.11 and up.