
# Silicon-Maid-7B 4bit MLX
## Description
MLX quants of [SanjiWatsuki/Silicon-Maid-7B](https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B)

## **Important note:** MLX is for use with Apple silicon.
[Documentation on MLX](https://github.com/ml-explore/mlx/)

### Other Quants:

MLX: [8bit](https://huggingface.co/Kooten/Silicon-Maid-7B-8bit-mlx), [4bit](https://huggingface.co/Kooten/Silicon-Maid-7B-4bit-mlx)

### Prompt Template (Alpaca)
The Noromaid template
SillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).

SanjiWatsuki recommends [Text Completion preset](https://huggingface.co/SanjiWatsuki/Loyal-Macaroni-Maid-7B/blob/main/Characters/MinP.json).

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
```

### Contact
Kooten on discord.

{"license": "cc-by-nc-4.0"}
transformers mistral text-generation license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us