
# mlx-community/openchat-3.5-0106-4bit-mlx
This model was converted to MLX format from [`openchat/openchat-3.5-0106`]().
Refer to the [original model card](https://huggingface.co/openchat/openchat-3.5-0106) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/openchat-3.5-0106-4bit-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```

{"license": "apache-2.0", "library_name": "transformers", "tags": ["openchat", "mistral", "C-RLFT", "mlx"], "base_model": "mistralai/Mistral-7B-v0.1", "pipeline_tag": "text-generation"}
transformers mistral text-generation openchat C-RLFT mlx conversational base_model:mistralai/Mistral-7B-v0.1 license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us