transformers pytorch llama text-generation not-for-all-audiences nsfw license:cc-by-nc-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
- nsfw
---

# Borealis-10.7B 5bpw

## Description
Exllama quant of [Undi95/Borealis-10.7B](https://huggingface.co/Undi95/Borealis-10.7B)

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Borealis-10.7B-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Borealis-10.7B-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Borealis-10.7B-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Borealis-10.7B-4bpw-exl2)

## Prompt format: NsChatml
```
<|im_system|>
{sysprompt}<|im_end|>
<|im_user|>
{input}<|im_end|>
<|im_bot|>
{output}<|im_end|>
```

## Contact
Kooten on discord