
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6215ce9abfcb3893344dd0a2/WjEIZzAjv5_E4vHXWun4Q.png)

An ~11B parameter merge of https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B onto itself.

```
slices:
  - sources:
    - model: SanjiWatsuki/Silicon-Maid-7B
      layer_range: [0, 24]
  - sources:
    - model: SanjiWatsuki/Silicon-Maid-7B
      layer_range: [8, 32]
merge_method: passthrough
dtype: float16
```

Example output of this model quantized to 8 bit:
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6215ce9abfcb3893344dd0a2/9-Bc5p2o7hBYP9tlmNErC.png)
{"license": "apache-2.0"}
transformers safetensors mistral text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us