transformers safetensors mixtral text-generation moe merge en license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
language:
- en
tags:
- moe
- merge
---

# Buttercup-4x7B 4bpw

## Description
Exllama quant of [Kquant03/Buttercup-4x7B-bf16](https://huggingface.co/Kquant03/Buttercup-4x7B-bf16)

## Other quants:
EXL2: [6bpw](https://huggingface.co/Kooten/Buttercup-4x7B-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Buttercup-4x7B-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Buttercup-4x7B-4bpw-exl2)

## Prompt format:
Unclear.. they do not mention it and at least one of the merged models mentions multiple

## Contact
Kooten on discord