GGUF quant of https://huggingface.co/openerotica/Occult-Roleplay-Mixtral-4x7B

Only Q5_K and FP16 for now, given it seems to be under active development

Prompt format: ChatML, possibly others

All credit to openerotica et al
{"license": "apache-2.0", "library_name": "transformers", "tags": ["text-generation-inference", "not-for-all-audiences", "nsfw"], "pipeline_tag": "text-generation"}
transformers gguf text-generation-inference not-for-all-audiences nsfw text-generation license:apache-2.0 endpoints_compatible region:us