
# Noromaid-13b-v0.2 8bit MLX
## Description
MLX quants of [NeverSleep/Noromaid-13b-v0.2](https://huggingface.co/NeverSleep/Noromaid-13b-v0.2)

## **Important note:** MLX is for use with Apple silicon.
[Documentation on MLX](https://github.com/ml-explore/mlx/)

### Other Quants:

MLX: [8bit](https://huggingface.co/Kooten/Noromaid-13b-v0.2-8bit-mlx), [4bit](https://huggingface.co/Kooten/Noromaid-13b-v0.2-4bit-mlx)

### Prompt Template (Alpaca)
SillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
```

### Contact
Kooten on discord.

{"license": "cc-by-nc-4.0"}
transformers llama text-generation license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us