license:apache-2.0 region:us
---
license: apache-2.0
---

# mlc-chat-una-cybertron-7b-v2-bf16-q3f16_1

An [MLC](https://mlc.ai/)-compiled version of [Una Cybertron 7B BF16](https://huggingface.co/fblgit/una-cybertron-7b-v2-bf16) quantized to q3f16 for running locally on mobile devices.

Requires a build of MLC Chat for iOS that supports Mistral.  As of 12/12/23, that means you will need to build MLC Chat for iOS from source at [mlc-llm @ MLC.ai on Github](https://github.com/mlc-ai/mlc-llm/).

Its currently configured to support the ChatML conversation template, but really it is supposed to be ChatML + a custom system message.  