license:apache-2.0 region:us
---
license: apache-2.0
---

# mlc-chat-neural-chat-7b-v3-1-q3f16_1

An [MLC](https://mlc.ai/)-compiled version of [Neural Chat 7B v3](https://huggingface.co/Intel/neural-chat-7b-v3-1) quantized to q3f16 for running locally on mobile devices.

Requires a build of MLC Chat for iOS that supports Mistral.  As of 12/12/23, that means you will need to build MLC Chat for iOS from source at [mlc-llm @ MLC.ai on Github](https://github.com/mlc-ai/mlc-llm/).