quant of [brucethemoose's](https://huggingface.co/brucethemoose) [Yi-34B-200K-DARE-merge-v5](https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-merge-v5)

fits into 24gb with 16k context on windows

pippa_cleaned used for calibration, with 8192 token length
{"language": ["en"], "license": "other", "library_name": "transformers", "tags": ["text-generation-inference", "merge"], "license_name": "yi-license", "license_link": "https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE", "pipeline_tag": "text-generation"}
transformers safetensors llama text-generation text-generation-inference merge en license:other autotrain_compatible endpoints_compatible region:us